-- Logs begin at Fri 2022-10-28 19:16:05 UTC, end at Fri 2022-10-28 20:54:32 UTC. -- Oct 28 19:56:32.518898 dv-cinder-862365-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 19:56:32.528105 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 19:56:32.530104 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 19:56:32 2022] *** Oct 28 19:56:32.530104 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 19:56:32.530104 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 19:56:32.530104 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: nodename: dv-cinder-862365-2-iscsi Oct 28 19:56:32.530104 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: machine: x86_64 Oct 28 19:56:32.530104 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: clock source: unix Oct 28 19:56:32.530104 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: pcre jit disabled Oct 28 19:56:32.530104 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: detected number of CPU cores: 4 Oct 28 19:56:32.530104 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: current working directory: / Oct 28 19:56:32.530104 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: detected binary path: /usr/bin/uwsgi-core Oct 28 19:56:32.530795 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: your processes number limit is 47680 Oct 28 19:56:32.530795 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: your memory page size is 4096 bytes Oct 28 19:56:32.530795 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: detected max file descriptor number: 2048 Oct 28 19:56:32.530795 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: lock engine: pthread robust mutexes Oct 28 19:56:32.530795 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: thunder lock: enabled Oct 28 19:56:32.530795 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 19:56:32.530795 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 19:56:32.571199 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: Python main interpreter initialized at 0x55d8e3f7c9c0 Oct 28 19:56:32.571199 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: python threads support enabled Oct 28 19:56:32.571199 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: your server socket listen backlog is limited to 100 connections Oct 28 19:56:32.571199 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: your mercy for graceful operations on workers is 90 seconds Oct 28 19:56:32.571553 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 19:56:32.571630 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: *** Operational MODE: preforking *** Oct 28 19:56:32.571867 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: *** uWSGI is running in multiple interpreter mode *** Oct 28 19:56:32.571867 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: spawned uWSGI master process (pid: 104367) Oct 28 19:56:32.572063 dv-cinder-862365-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 28 19:56:32.572878 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: spawned uWSGI worker 1 (pid: 104368, cores: 1) Oct 28 19:56:32.572984 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: spawned uWSGI worker 2 (pid: 104369, cores: 1) Oct 28 19:56:32.573063 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 19:56:33.236199 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 19:56:33.247963 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 19:56:34.316740 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:56:34.316740 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: from cryptography.utils import int_from_bytes Oct 28 19:56:34.317417 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:56:34.317417 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: from cryptography.utils import int_from_bytes Oct 28 19:56:34.319556 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:56:34.319556 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: from cryptography.utils import int_from_bytes Oct 28 19:56:34.319998 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:56:34.319998 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: from cryptography.utils import int_from_bytes Oct 28 19:56:36.853071 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 19:56:36.853669 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 19:56:36.853862 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 19:56:36.854226 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 19:56:36.854481 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 19:56:36.854565 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 19:56:36.854931 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 19:56:36.855010 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.855180 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.855267 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 19:56:36.855500 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.855600 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 19:56:36.855817 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.855919 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 19:56:36.856146 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.856241 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.856452 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.856536 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.856772 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.856869 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.857090 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.857175 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.857449 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.857537 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.857699 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.857793 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.858013 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.858098 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.858334 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862365-2-iscsi {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.858432 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.858653 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.858738 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.858963 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.859053 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.859271 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.859366 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.859587 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.859682 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862365-2-iscsi {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.859889 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.860018 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.860201 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.860339 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.860502 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.860634 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.860816 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.861001 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.861235 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.861459 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.861578 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.861768 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.861888 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.862078 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.862271 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.862466 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.862618 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.862756 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.862878 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.863014 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.863205 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.863336 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.863490 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.863617 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.863801 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.863927 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.864110 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.864235 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.864426 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.864560 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862365-2-iscsi {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.864733 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.864865 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.865055 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.865180 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.865387 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.865550 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.865782 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862365-2-iscsi {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.865907 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.866103 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.866260 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.866433 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.866575 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.867355 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.867530 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.867825 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.867980 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.868130 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.868267 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.868410 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.868593 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.868744 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.868914 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.869058 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.869242 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.869427 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.869575 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.869712 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.869879 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.870021 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.870174 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.870322 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.870464 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.870599 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.870783 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.870935 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.871081 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.871217 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.871367 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.871508 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.871650 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.871791 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.871936 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.872088 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.872224 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.872358 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.872492 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.872632 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.872815 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.872964 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.873099 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.873234 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.873391 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.873545 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.873692 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.873828 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.873977 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.874122 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.874276 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.874412 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.874595 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.874736 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.874917 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.875068 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.875213 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.875360 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.875519 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.875661 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.875825 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.875985 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.876130 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.876296 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.876432 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.876567 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.876708 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.876843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.876987 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.877123 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.877294 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.877459 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.877633 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.877787 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.877945 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.878086 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.878255 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.878399 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.878562 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.878713 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.878884 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.879029 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.879235 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.879388 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.879538 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.879687 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.879822 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.879957 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.880135 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.880306 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.880443 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.880595 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.880731 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.880863 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.881035 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.881179 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.881375 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.881518 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.881654 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.881787 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.881969 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.882112 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.882343 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.882488 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.882631 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.882827 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.882972 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.883174 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.883343 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.883480 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.883621 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.883756 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.883899 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.884040 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.884184 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.884321 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.884463 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.884608 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.884745 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.884880 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.885023 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.885190 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.885357 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.885523 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.885666 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.885823 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.885961 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.886118 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.886267 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.886404 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.886545 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.886715 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.886859 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.887019 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.887175 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.887311 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.887454 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.887666 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.887804 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.887946 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.888082 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.888217 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.888349 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.888493 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.888629 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.888763 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.888898 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.889074 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.889219 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.889402 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.889543 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.889707 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.889854 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.890011 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.890152 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.890297 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.890440 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.890604 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.890747 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.890913 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.891072 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.891217 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.891353 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.891488 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.891622 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.891806 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.891953 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.892098 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.892235 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.892404 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.892546 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.892688 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.892834 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.893009 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.893146 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.893281 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.893453 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.893591 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.893735 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.893880 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.894016 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.894186 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.894336 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.894472 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.894614 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.894771 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.894913 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.895049 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.895183 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.895348 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.895499 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.895636 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.895770 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.895933 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.896077 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.896225 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.896361 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.896530 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.896682 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.896817 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.896959 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.897101 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.897238 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.897432 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.897585 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.897747 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.897905 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.898101 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.898256 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.898435 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.898578 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.898776 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.898917 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.899089 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.899231 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:56:36.899421 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.899570 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.899808 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.899955 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.900093 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.900228 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.900371 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.900506 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.900652 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.900795 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.900958 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.901102 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.901269 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.901440 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.901590 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.901734 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.901905 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.902048 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.902223 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.902374 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.902540 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.902699 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.902842 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.902996 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.903143 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.903280 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.903447 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.903599 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.903765 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.903908 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.904073 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.904215 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.904390 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.904552 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.904690 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.904824 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.905009 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.905156 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.905301 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.905501 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.905639 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.905773 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.905963 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.906106 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.906284 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.906437 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.906584 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.906721 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.906907 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.907050 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.907219 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.907364 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.907527 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.907669 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.907836 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.907979 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.908196 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.908333 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.908479 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.908626 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.908769 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.908913 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.909049 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.909193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.909403 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.909562 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.909721 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.909872 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.910016 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.910150 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.910326 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.910470 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.910616 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.910765 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.910930 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.911073 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.911236 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.911379 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.911546 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.911699 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.911860 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.912008 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.912176 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.912319 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.912473 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.912608 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.912782 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.912925 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.913097 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.913240 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.913953 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.914169 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.914321 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.914458 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.914617 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.914762 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.914906 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.915053 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.915214 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.915364 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.915504 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.915639 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.915813 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.915957 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.916118 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.916267 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.916437 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.916580 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.916725 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.916870 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.917022 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.917170 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.917306 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.917493 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.917631 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.917767 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.917961 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.918105 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.918270 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.918421 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.918567 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.918703 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.918865 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.919019 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.919177 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.919329 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.919467 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.919601 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.919780 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.919924 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.920083 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.920233 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.920396 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.920538 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.920680 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.920815 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.920998 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.921141 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.921301 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.921491 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.921629 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.921763 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.921910 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.922048 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.922221 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.922371 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.922532 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.922682 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.922840 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.922977 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.923114 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.923249 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.923429 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.923573 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.923721 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.923858 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.924038 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.924183 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.924351 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.924508 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.924676 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.924831 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.924966 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.925115 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.925284 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.925462 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.925631 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.925781 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.925946 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.926100 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.926239 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.926383 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.926532 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.926669 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.926835 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.926978 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.927128 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.927274 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.927411 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.927545 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.927719 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.927862 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.928006 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.928142 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.928308 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.928460 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.928611 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.928757 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.928901 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.929062 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.929892 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.930038 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.930355 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.930717 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.930875 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.931014 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.931149 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.931319 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.931465 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.931612 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.931757 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.931946 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.932096 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.932255 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.932396 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.932542 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.932685 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.932855 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.932998 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.933165 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.933349 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.933537 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.933695 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.933831 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.933966 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.934170 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.934312 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.934482 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.934628 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.934794 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.934937 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.935106 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.935254 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.935399 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.935536 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.935719 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.935864 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.936029 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.936179 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.936343 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.936486 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.936653 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.936795 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.936962 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.937112 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.937274 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.937457 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.937594 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.937753 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.937916 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.938140 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.938280 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.938416 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.938551 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.938694 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.938839 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.938985 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.939144 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.939288 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.939451 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.939593 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.939749 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.939888 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.940090 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.940242 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.940425 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.940568 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.940738 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.940881 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.941048 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.941192 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.941379 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.941523 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.941700 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.941840 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.941976 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.942112 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.942289 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.942440 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.942840 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.942976 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.943158 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.943303 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.943468 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.943611 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.943778 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.943930 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.944067 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.944200 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.944379 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.944531 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.944726 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.944879 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.945130 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.945275 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.945674 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.945827 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.945965 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.946100 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.946254 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.946391 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.946527 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.946670 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.946819 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.946967 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.947109 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.947246 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.947387 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.947531 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.947667 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.947809 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.947952 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.948098 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.948243 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.948389 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.948525 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.948659 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.948793 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.948935 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.949088 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.949226 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.949394 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.949544 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.949710 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.949869 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.950018 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.950156 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.950316 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.950460 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.950612 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.950763 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.950914 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.951057 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.951197 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.951344 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.951486 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.951635 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.951789 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.951938 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.952079 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.952220 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.952394 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.952552 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.952702 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.952844 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.953022 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.953172 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.953361 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.953536 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.953681 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.953842 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.954002 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.954147 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.954298 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.954450 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.954594 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.954745 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.954888 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.955029 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.955182 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.955325 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.955465 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.955608 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.955765 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.955908 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.956060 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.956203 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.956343 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.956496 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.956640 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.956781 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.956954 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.957104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.957246 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.957443 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.957587 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.957740 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.957892 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.958035 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.958176 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.958323 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.958465 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.958619 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.958763 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.958904 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.959044 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.959227 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.959369 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.959528 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.959670 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.959812 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.959953 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.960093 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.960234 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.960501 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.960693 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.960840 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.960990 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.961132 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.961274 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.961460 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.961615 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.961757 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.961899 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.962052 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.962201 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.962369 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.962518 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.962709 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.962933 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.963093 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.963266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.963416 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.963567 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.963730 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.963872 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.964015 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.964209 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.964446 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.964601 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.964753 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.964896 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.965038 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.965186 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.965355 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.965516 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.965671 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.965814 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.965961 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.966105 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.966247 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.966397 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.966541 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.966689 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.966839 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.966995 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.967142 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.967299 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.967442 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.967596 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.967738 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.967880 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.968022 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.968178 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.968327 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.968470 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.968619 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.968762 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.968904 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.969054 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.969198 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.969372 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.969532 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.969676 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.969829 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.969972 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.970113 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.970263 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.970413 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.970562 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.970713 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.970856 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.970999 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.971140 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.971282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.971435 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.971586 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.971729 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.971869 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.972011 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.972153 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.972306 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.972451 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.972598 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.972748 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.972897 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.973045 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.973206 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.973371 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.973522 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.973664 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.973806 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.973959 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.974115 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.974257 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.974405 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.974557 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.974716 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.974867 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.975021 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.975176 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.975318 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.975459 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.975601 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.975750 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.975895 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.976570 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.976713 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.976862 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.977004 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.977152 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.977302 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.977528 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.977690 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.977833 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.977973 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.978123 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.978266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.978407 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.978548 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.978697 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.978839 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.978994 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.979135 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.979283 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.979434 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.979588 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.979739 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.979883 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.980024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.980165 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.980313 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.980456 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.980605 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.980749 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.980897 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.981046 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.981195 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.981380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.981538 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.981682 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.981824 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.981965 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.982106 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.982247 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.982399 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.982542 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.982683 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.982836 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.982978 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.983127 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.983288 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.983430 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.983571 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.983713 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.983853 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.984003 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.984146 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.984293 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.984434 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.984576 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.984717 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.984866 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.985009 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.985174 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.985372 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.985524 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.985678 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.985830 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.985973 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.986114 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.986254 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.986396 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.986549 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.986693 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.986834 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.986982 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.987149 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.987293 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.987452 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.987596 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.987737 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.987878 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.988019 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.988162 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.988311 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.988460 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.988607 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.988749 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.988890 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.989050 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.989202 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.989366 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.989515 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.989666 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.989808 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.990022 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.990168 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.990310 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.990452 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.990600 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.990742 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.990902 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.991044 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.991186 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.991327 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.991475 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.991710 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.991867 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.992009 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.992151 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.992406 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.992554 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.992721 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.992883 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.993044 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.993188 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.993357 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.993507 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.993661 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.993804 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.993946 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.994086 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.994251 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.994402 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.994559 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.994711 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.994860 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.995013 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.995154 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.995295 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.995446 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.995588 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.995752 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.995907 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.996055 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.996197 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.996347 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.996491 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.996664 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.996814 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.996967 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.997107 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.997256 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.997440 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.997603 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.997746 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.997887 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.998042 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.998185 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.998326 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.998467 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.998618 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.998767 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.998928 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.999071 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.999212 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.999375 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.999525 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.999669 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.999818 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:36.999960 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.000108 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.000272 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.000422 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.000563 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.000726 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.000875 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.001016 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.001181 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.001355 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.001517 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.001660 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.001802 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.001943 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.002107 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.002257 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.002407 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.002549 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.002727 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.002878 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.003028 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.003177 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.003331 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.003544 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.003693 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.003863 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.004011 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.004174 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.004332 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.004481 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.004623 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.004775 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.004916 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.005068 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.005218 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.005408 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.005557 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.005700 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.005839 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.005993 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.006136 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.006391 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.006540 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.006695 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.006848 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.007002 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.007149 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.007362 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.007508 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.007667 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.007933 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.008094 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.008239 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.008392 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.008535 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.008682 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.008844 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.008998 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.009141 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.009311 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.009560 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.009705 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.009854 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.009999 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.010141 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.010282 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.010422 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.010572 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.010724 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.010878 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.011020 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.011189 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.011339 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.011482 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.011636 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.011900 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.012051 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.012195 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.012335 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.012490 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.012639 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.012818 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.012988 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.013130 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.013381 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.013555 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.013699 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.013849 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.013991 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.014133 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.014275 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.014424 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.014566 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.014720 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.014896 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.015047 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.015189 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.015331 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.015507 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.015669 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.015813 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.015961 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.016134 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.016285 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.016460 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.016618 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.016762 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.016921 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.017064 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.017207 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.017380 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.017532 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.017706 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.017858 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.018032 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.018183 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.018333 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.018484 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.018659 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.018816 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.019023 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.019172 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.019323 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.019465 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.019631 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.019781 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.019931 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.020072 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.020223 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.020366 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.020537 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.020688 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.020856 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.021009 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.021152 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.021293 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.021471 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.021623 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.021768 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.021917 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.022060 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.022207 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.022350 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.022491 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.022632 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.023326 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.023510 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.023695 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.023840 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.023982 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.024125 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.024275 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.024418 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.024568 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.024719 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.024863 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.025013 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.025158 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.025311 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.025480 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.025622 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.025765 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.025941 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.026099 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.026243 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.026384 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.026526 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.026668 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.026860 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.027010 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.027152 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.027302 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.027465 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.027614 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.027765 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.027916 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.028077 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.028222 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.028388 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.028551 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.028695 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.028838 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.029562 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.029730 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.029925 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.030072 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.030072 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.030340 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.030481 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.030630 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.030779 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.030922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.031073 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.031222 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.031366 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.031518 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.031667 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.031810 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.031958 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.032101 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.032244 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.032394 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.032537 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.032685 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.032834 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.032976 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.033124 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.033276 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.033484 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.033634 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.033777 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.033919 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.034067 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.034219 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.034368 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.034512 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.034653 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.034794 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.034934 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.035084 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.035226 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.035386 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.035530 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.035671 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.035820 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.035962 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.036103 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.036251 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.036404 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.036547 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.036761 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.036906 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.037048 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.037190 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.037364 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.037514 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.037671 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.037814 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.037962 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.038108 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.038249 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.038392 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.039166 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.039312 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.039456 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.039598 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.039598 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.039888 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.040030 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.040173 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.040315 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.040463 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.040607 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.040760 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.040904 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.041045 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.041186 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.041387 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.041501 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.041642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.041743 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.041815 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.041882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.041948 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.042023 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.042246 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.042349 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.042557 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.042810 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.042907 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.043142 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.043233 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.043461 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.043549 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.043771 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.043860 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.044084 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.044173 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.044393 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.044479 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.044706 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.044792 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.045020 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.045109 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.045355 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.045447 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.045670 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.045772 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.045985 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.046081 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.046296 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.046392 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.046611 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.046708 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.046924 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.047012 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.047264 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.047358 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.047576 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.047663 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.047882 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.047968 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.048195 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.048281 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.048508 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.048594 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.048816 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.048903 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.049125 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.049252 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.049465 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.049603 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.049780 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.049868 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.050090 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.050194 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.050398 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.050485 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.050705 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.050793 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.051013 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.051112 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.051321 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.051406 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.051632 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.051718 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.051944 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.052041 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.052254 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.052341 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.052561 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.052645 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.052871 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.052959 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.053183 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.053273 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.053727 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.053816 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.054060 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.054157 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.054399 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.054531 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.054724 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.054858 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.055038 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.055183 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.055502 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.055589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.055820 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.055915 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.056148 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.056235 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.056454 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.056540 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.056757 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.056852 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.057066 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.057153 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.057396 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.057488 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.057702 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.057806 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.058024 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.058119 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.058333 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.058420 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.058636 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.058731 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.058945 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.059031 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.059252 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.059338 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.059588 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.059784 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.059872 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.060140 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.060228 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.060462 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.060559 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.060781 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.060875 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.061108 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.061312 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.061459 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.061682 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.061778 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.062002 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.062097 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.062331 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.062426 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.062664 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.062753 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.062979 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.063064 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.063286 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.063380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.063589 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.063755 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.063887 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.064068 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.064199 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.064377 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.064507 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.064698 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.064812 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.065011 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.065123 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.065342 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.065455 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.065649 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.065781 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.065962 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.066086 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.066273 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.066392 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.066578 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.066698 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.066889 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.067009 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.067194 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.067312 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.067773 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.067868 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.068084 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.068180 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.068391 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.068487 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.068696 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.068791 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.069008 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.069105 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.069376 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.069471 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.069643 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.069745 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.069972 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.070079 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.070280 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.070399 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.070592 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.070734 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.070895 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.070987 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.071203 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.071291 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.071509 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.071605 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.071815 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.071903 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.072135 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.072246 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.072447 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.072540 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.072762 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.072853 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.073071 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.073161 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.073398 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.073489 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.073734 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.073828 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.074046 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.074136 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.074355 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.074578 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.074667 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.074912 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.074999 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.075233 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.075327 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.075564 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.075659 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.075895 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.075983 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.076201 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.076430 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.076525 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.076766 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.076854 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.077090 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.077177 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.077426 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.077532 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.077741 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.077836 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.078051 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.078145 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.078356 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.078443 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.078663 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.078748 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.078972 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.079060 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.079281 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.079369 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.079587 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.079674 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.079895 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.079998 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.080200 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.080289 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.080506 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.080602 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.080812 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.080908 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.081117 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.081205 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.081446 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.081535 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.081757 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.081857 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.082065 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.082154 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.082378 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.082487 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.082690 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.082788 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.082998 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.083089 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.083305 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.083407 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.083615 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.083736 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.083923 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.084023 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.084227 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.084323 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.084535 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.084624 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.084848 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.084937 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.085159 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.085245 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.086017 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.086165 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.086324 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.086739 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.087004 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.087241 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.087330 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.087569 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.087655 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.087898 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.087984 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.088231 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.088318 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.088554 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.088641 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.088869 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.088956 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.089185 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.089533 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.089622 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.089861 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.089963 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.090174 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.090263 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.090509 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.090596 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.090837 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.090926 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.091161 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.091249 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.091466 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.091554 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.091770 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.091858 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.092074 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.092162 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.092385 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.092492 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.092734 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.092835 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.093076 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.093168 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.093415 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.093517 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.093719 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.093819 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.094030 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.094135 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.094330 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.094418 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.094631 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.094729 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.094933 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.095020 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.095235 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.095321 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.095540 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.095636 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.095840 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.095927 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.096142 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.096238 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.096444 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.096532 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.096747 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.096834 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.097045 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.097131 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.097368 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.097460 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.097675 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.097761 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.097974 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.098072 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.098276 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.098364 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.098575 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.098668 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.098874 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.098961 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.099177 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.099265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.099482 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.099570 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.099791 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.099899 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.100099 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.100192 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.100405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.100492 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.100711 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.100807 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.101712 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.101823 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.102047 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.102202 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.102374 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.102535 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.102698 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.102876 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.103017 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.103261 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.103364 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.103537 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.103627 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.103866 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.103974 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.104181 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.104362 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.104505 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.104593 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.104816 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.104905 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.105121 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.105217 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.105452 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.105555 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.105780 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.105868 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.106091 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.106187 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.106397 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.106483 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.106720 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.106816 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.107029 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.107125 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.107343 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.107430 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.107652 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.107738 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.107960 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.108047 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.108270 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.108365 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.108577 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.108663 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.108885 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.108974 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.109197 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.109283 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.109532 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.109621 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.109843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.109932 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.110156 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.110243 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.110463 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.110558 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.110774 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.110862 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.111085 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.111170 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.111397 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.111494 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.111707 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.111793 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.112017 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.112112 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.112323 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.112422 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.112636 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.112723 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.112953 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.113041 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.113263 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.113366 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.113597 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.113685 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.113916 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.114016 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.114233 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.114341 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.114551 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.114652 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.114860 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.114953 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.115163 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.115263 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.115410 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 19:56:37.115510 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.115797 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.116145 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.116464 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.116943 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.117279 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.117617 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.117933 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.118242 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:56:37.118488 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 19:56:37.269984 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO dbcounter [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] Registered counter for database nova_api Oct 28 19:56:37.272583 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO dbcounter [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] Registered counter for database nova_api Oct 28 19:56:37.291940 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG oslo_db.sqlalchemy.engines [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:56:37.293432 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_db.sqlalchemy.engines [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:56:37.298653 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG dbcounter [-] [104368] Writer thread running {{(pid=104368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:56:37.300084 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG dbcounter [-] [104369] Writer thread running {{(pid=104369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:56:37.356272 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.context [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f77e283-8dfe-4ddd-b40e-e3af731a397f(cell1) {{(pid=104368) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 19:56:37.356972 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.context [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f77e283-8dfe-4ddd-b40e-e3af731a397f(cell1) {{(pid=104369) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 19:56:37.360056 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG oslo_concurrency.lockutils [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:37.360525 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG oslo_concurrency.lockutils [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:37.360807 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:37.361275 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:37.362169 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG oslo_concurrency.lockutils [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:37.362876 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG oslo_concurrency.lockutils [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:37.362985 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:37.363321 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG oslo_concurrency.lockutils [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:37.363584 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:37.364027 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:37.365311 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG oslo_concurrency.lockutils [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:37.366034 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:37.367925 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO dbcounter [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] Registered counter for database nova_cell0 Oct 28 19:56:37.368545 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO dbcounter [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] Registered counter for database nova_cell0 Oct 28 19:56:37.371990 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO dbcounter [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] Registered counter for database nova_cell1 Oct 28 19:56:37.372714 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO dbcounter [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] Registered counter for database nova_cell1 Oct 28 19:56:37.379200 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG oslo_db.sqlalchemy.engines [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:56:37.381365 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG oslo_db.sqlalchemy.engines [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:56:37.383528 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_db.sqlalchemy.engines [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:56:37.386297 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_db.sqlalchemy.engines [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:56:37.387017 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG dbcounter [-] [104368] Writer thread running {{(pid=104368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:56:37.389834 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG dbcounter [-] [104368] Writer thread running {{(pid=104368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:56:37.390898 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG dbcounter [-] [104369] Writer thread running {{(pid=104369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:56:37.393653 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG dbcounter [-] [104369] Writer thread running {{(pid=104369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:56:37.533261 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO dbcounter [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] Registered counter for database nova_cell0 Oct 28 19:56:37.537639 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO dbcounter [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] Registered counter for database nova_cell0 Oct 28 19:56:37.543302 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG oslo_db.sqlalchemy.engines [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:56:37.545230 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_db.sqlalchemy.engines [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:56:37.548053 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG dbcounter [-] [104368] Writer thread running {{(pid=104368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:56:37.549700 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG dbcounter [-] [104369] Writer thread running {{(pid=104369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:56:37.990697 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: WARNING keystonemiddleware.auth_token [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 19:56:37.998608 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: WARNING keystonemiddleware.auth_token [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 19:56:38.006649 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: WARNING keystonemiddleware.auth_token [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 19:56:38.014363 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: WARNING keystonemiddleware.auth_token [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 19:56:38.345053 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: WARNING keystonemiddleware.auth_token [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 19:56:38.351091 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: WARNING keystonemiddleware.auth_token [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 19:56:38.356585 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d8e3f7c9c0 pid: 104369 (default app) Oct 28 19:56:38.358706 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:38.359898 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001712 Oct 28 19:56:38.360316 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Fri Oct 28 19:56:38 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:56:38.364660 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: WARNING keystonemiddleware.auth_token [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 19:56:38.371068 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: WARNING keystonemiddleware.auth_token [None req-768ebfbf-3f19-4328-8d32-988523f38e79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 19:56:38.376370 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d8e3f7c9c0 pid: 104368 (default app) Oct 28 19:58:03.057781 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:03.059356 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002016 Oct 28 19:58:03.059905 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 2/2] 10.222.0.66 () {54 vars in 931 bytes} [Fri Oct 28 19:58:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:58:03.072052 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG dbcounter [-] [104368] Writing DB stats nova_api:SELECT=3 {{(pid=104368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:03.073721 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG dbcounter [-] [104368] Writing DB stats nova_cell0:SELECT=3 {{(pid=104368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:03.074435 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG dbcounter [-] [104368] Writing DB stats nova_cell1:SELECT=3 {{(pid=104368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:03.075594 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG dbcounter [-] [104368] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:03.985025 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-53c6cff7-27ae-4f58-82cf-b2e53984363d admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:04.018329 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-53c6cff7-27ae-4f58-82cf-b2e53984363d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.951610 Oct 28 19:58:04.019244 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 1/3] 10.222.0.66 () {60 vars in 1292 bytes} [Fri Oct 28 19:58:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:06.654328 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:06.655320 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-2ea97531-c57c-4d69-95ef-ab0e8c6c27ce None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Oct 28 19:58:06.657724 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 3/4] 10.222.0.66 () {54 vars in 931 bytes} [Fri Oct 28 19:58:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:58:07.106070 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-0741c956-cc53-4209-a546-4c0946bae67f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1"}} {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:07.246029 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-0741c956-cc53-4209-a546-4c0946bae67f admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.584287 Oct 28 19:58:07.246588 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 2/5] 10.222.0.66 () {64 vars in 1283 bytes} [Fri Oct 28 19:58:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:58:07.260960 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG dbcounter [-] [104369] Writing DB stats nova_api:SELECT=3 {{(pid=104369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:07.261822 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG dbcounter [-] [104369] Writing DB stats nova_cell1:SELECT=3 {{(pid=104369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:07.263764 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG dbcounter [-] [104369] Writing DB stats nova_cell0:SELECT=3 {{(pid=104369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:07.264532 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG dbcounter [-] [104369] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:07.478286 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-13182316-34d5-409a-ba76-6967affe9547 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:07.617471 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-13182316-34d5-409a-ba76-6967affe9547 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.361949 Oct 28 19:58:07.618066 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 4/6] 10.222.0.66 () {64 vars in 1336 bytes} [Fri Oct 28 19:58:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:10.271408 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-0741c956-cc53-4209-a546-4c0946bae67f admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:10.272447 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-0741c956-cc53-4209-a546-4c0946bae67f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 28 19:58:10.272857 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 3/7] 10.222.0.66 () {54 vars in 931 bytes} [Fri Oct 28 19:58:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:58:10.963348 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-97e57b72-0621-4225-8733-cc9ce148e9f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:11.089289 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-97e57b72-0621-4225-8733-cc9ce148e9f8 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.810022 Oct 28 19:58:11.091613 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 5/8] 10.222.0.66 () {64 vars in 1283 bytes} [Fri Oct 28 19:58:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:58:11.105013 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-b0a1d0a2-b5ac-4e89-a6ae-6925cef62491 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:11.255328 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-b0a1d0a2-b5ac-4e89-a6ae-6925cef62491 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.153970 Oct 28 19:58:11.256662 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 4/9] 10.222.0.66 () {64 vars in 1336 bytes} [Fri Oct 28 19:58:11 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:13.904854 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-97e57b72-0621-4225-8733-cc9ce148e9f8 admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:13.905830 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-97e57b72-0621-4225-8733-cc9ce148e9f8 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 28 19:58:13.906245 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 6/10] 10.222.0.66 () {54 vars in 931 bytes} [Fri Oct 28 19:58:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:58:14.326921 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-54a4a748-6e3c-467b-9771-4855db3639aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "disk": 10, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:14.402661 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-54a4a748-6e3c-467b-9771-4855db3639aa admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489186 Oct 28 19:58:14.403220 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 5/11] 10.222.0.66 () {64 vars in 1283 bytes} [Fri Oct 28 19:58:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:58:14.416433 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-8236b9c0-8c2e-4e02-bdfb-e5b091a810e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:14.530099 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-8236b9c0-8c2e-4e02-bdfb-e5b091a810e4 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117355 Oct 28 19:58:14.530383 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 7/12] 10.222.0.66 () {64 vars in 1336 bytes} [Fri Oct 28 19:58:14 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:58:17.161955 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-54a4a748-6e3c-467b-9771-4855db3639aa admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:17.163577 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-54a4a748-6e3c-467b-9771-4855db3639aa admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 Oct 28 19:58:17.164160 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 6/13] 10.222.0.66 () {54 vars in 931 bytes} [Fri Oct 28 19:58:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:58:17.595541 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-c19e99bb-3fb6-4b65-9306-d98ae7120073 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "name": "ds2G", "id": "d3"}} {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:17.672834 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-c19e99bb-3fb6-4b65-9306-d98ae7120073 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.500810 Oct 28 19:58:17.673712 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 8/14] 10.222.0.66 () {64 vars in 1283 bytes} [Fri Oct 28 19:58:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:58:17.686948 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-23d98d94-152e-4836-9689-c770de55c82b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:17.779412 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-23d98d94-152e-4836-9689-c770de55c82b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096474 Oct 28 19:58:17.780212 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 7/15] 10.222.0.66 () {64 vars in 1336 bytes} [Fri Oct 28 19:58:17 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:20.465831 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-c19e99bb-3fb6-4b65-9306-d98ae7120073 admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:20.466871 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-c19e99bb-3fb6-4b65-9306-d98ae7120073 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001711 Oct 28 19:58:20.467277 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 9/16] 10.222.0.66 () {54 vars in 931 bytes} [Fri Oct 28 19:58:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:58:20.913034 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-cac301a9-f0d3-4fc0-9679-4bcf32bec683 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "swap": 0, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:20.990651 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-cac301a9-f0d3-4fc0-9679-4bcf32bec683 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.516741 Oct 28 19:58:20.991386 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 8/17] 10.222.0.66 () {64 vars in 1283 bytes} [Fri Oct 28 19:58:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:58:21.003495 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-e8ffcd9d-9e2c-4f38-906f-2f357acf96de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:21.096678 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-e8ffcd9d-9e2c-4f38-906f-2f357acf96de admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096675 Oct 28 19:58:21.098106 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 10/18] 10.222.0.66 () {64 vars in 1336 bytes} [Fri Oct 28 19:58:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:24.321584 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-cac301a9-f0d3-4fc0-9679-4bcf32bec683 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:24.322610 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-cac301a9-f0d3-4fc0-9679-4bcf32bec683 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Oct 28 19:58:24.323017 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 9/19] 10.222.0.66 () {54 vars in 931 bytes} [Fri Oct 28 19:58:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:58:24.764090 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-eb4baf0f-d7f2-4e65-97bb-fc0e01f59936 admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:24.789415 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-eb4baf0f-d7f2-4e65-97bb-fc0e01f59936 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.460102 Oct 28 19:58:24.789964 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 11/20] 10.222.0.66 () {60 vars in 1292 bytes} [Fri Oct 28 19:58:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:58:27.573879 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-cac301a9-f0d3-4fc0-9679-4bcf32bec683 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:27.575101 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-cac301a9-f0d3-4fc0-9679-4bcf32bec683 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001703 Oct 28 19:58:27.575506 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 10/21] 10.222.0.66 () {54 vars in 931 bytes} [Fri Oct 28 19:58:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:58:27.999635 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-7d7a18f0-9bed-48d8-a759-17f4c3a1c95e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "ram": 512, "id": "1", "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1}} {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:28.095243 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-7d7a18f0-9bed-48d8-a759-17f4c3a1c95e admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.512819 Oct 28 19:58:28.095939 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 12/22] 10.222.0.66 () {64 vars in 1283 bytes} [Fri Oct 28 19:58:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:58:28.108546 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-44bc8cdf-8c6d-4722-b6e9-ebd7b4f94f95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:28.194542 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-44bc8cdf-8c6d-4722-b6e9-ebd7b4f94f95 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089369 Oct 28 19:58:28.195139 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 11/23] 10.222.0.66 () {64 vars in 1333 bytes} [Fri Oct 28 19:58:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:30.885543 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-7d7a18f0-9bed-48d8-a759-17f4c3a1c95e admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:30.886549 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-7d7a18f0-9bed-48d8-a759-17f4c3a1c95e admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 28 19:58:30.886948 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 13/24] 10.222.0.66 () {54 vars in 931 bytes} [Fri Oct 28 19:58:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:58:31.370817 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-da645ace-785f-43ca-85e0-69a0b5f32554 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "ram": 2048, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:31.453708 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-da645ace-785f-43ca-85e0-69a0b5f32554 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.559341 Oct 28 19:58:31.454864 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 12/25] 10.222.0.66 () {64 vars in 1283 bytes} [Fri Oct 28 19:58:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:58:31.466895 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-c71f5bfe-3de6-4783-ac80-e4afb6bac114 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:31.557213 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-c71f5bfe-3de6-4783-ac80-e4afb6bac114 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093876 Oct 28 19:58:31.559178 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 14/26] 10.222.0.66 () {64 vars in 1333 bytes} [Fri Oct 28 19:58:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:34.326298 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-da645ace-785f-43ca-85e0-69a0b5f32554 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:34.328415 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-da645ace-785f-43ca-85e0-69a0b5f32554 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002604 Oct 28 19:58:34.328829 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 13/27] 10.222.0.66 () {54 vars in 931 bytes} [Fri Oct 28 19:58:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:58:34.778433 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-bc2f21b2-349a-47c3-a57c-e208251c6052 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "swap": 0, "vcpus": 2}} {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:34.850154 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-bc2f21b2-349a-47c3-a57c-e208251c6052 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.513933 Oct 28 19:58:34.850992 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 15/28] 10.222.0.66 () {64 vars in 1283 bytes} [Fri Oct 28 19:58:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:58:34.863592 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-04447b4b-7031-4756-bc7c-0eb023e5677d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:34.868925 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG dbcounter [-] [104368] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:34.965769 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-04447b4b-7031-4756-bc7c-0eb023e5677d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106022 Oct 28 19:58:34.969113 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 14/29] 10.222.0.66 () {64 vars in 1333 bytes} [Fri Oct 28 19:58:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:37.578326 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-bc2f21b2-349a-47c3-a57c-e208251c6052 admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:37.579975 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-bc2f21b2-349a-47c3-a57c-e208251c6052 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002179 Oct 28 19:58:37.580496 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 16/30] 10.222.0.66 () {54 vars in 931 bytes} [Fri Oct 28 19:58:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:58:38.041927 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-96ffaabb-6d31-4423-ae64-bd8de1ae78db admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:38.125888 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-96ffaabb-6d31-4423-ae64-bd8de1ae78db admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.539002 Oct 28 19:58:38.126479 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 15/31] 10.222.0.66 () {64 vars in 1283 bytes} [Fri Oct 28 19:58:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:58:38.138711 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-92e5509c-e1fb-4792-8e61-91a065727ee0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:38.242664 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-92e5509c-e1fb-4792-8e61-91a065727ee0 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107508 Oct 28 19:58:38.258737 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 17/32] 10.222.0.66 () {64 vars in 1333 bytes} [Fri Oct 28 19:58:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:40.942338 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-96ffaabb-6d31-4423-ae64-bd8de1ae78db admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:40.943365 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-96ffaabb-6d31-4423-ae64-bd8de1ae78db admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Oct 28 19:58:40.943774 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 16/33] 10.222.0.66 () {54 vars in 931 bytes} [Fri Oct 28 19:58:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:58:41.405182 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-0ff384a0-3f56-42d7-a1e6-c79a7ed9a0ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "id": "5", "vcpus": 8, "swap": 0}} {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:41.413368 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG dbcounter [-] [104369] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:41.472536 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-0ff384a0-3f56-42d7-a1e6-c79a7ed9a0ef admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.522287 Oct 28 19:58:41.473535 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 18/34] 10.222.0.66 () {64 vars in 1283 bytes} [Fri Oct 28 19:58:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:58:41.485348 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-07d55329-3e16-4c5d-98ae-d125f3838e25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:41.576875 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-07d55329-3e16-4c5d-98ae-d125f3838e25 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093384 Oct 28 19:58:41.577586 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 17/35] 10.222.0.66 () {64 vars in 1333 bytes} [Fri Oct 28 19:58:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:58:58.590365 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-0ff384a0-3f56-42d7-a1e6-c79a7ed9a0ef admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:58.591415 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-0ff384a0-3f56-42d7-a1e6-c79a7ed9a0ef admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 28 19:58:58.591825 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 19/36] 10.222.0.66 () {54 vars in 931 bytes} [Fri Oct 28 19:58:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:58:58.603217 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG dbcounter [-] [104368] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:58.983156 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-570d2fa4-043e-478d-a6cc-71a94716f912 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:59.001454 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-570d2fa4-043e-478d-a6cc-71a94716f912 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402690 Oct 28 19:58:59.001991 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1292 bytes} [Fri Oct 28 19:58:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:59:00.296662 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-0ff384a0-3f56-42d7-a1e6-c79a7ed9a0ef admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:00.297730 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-0ff384a0-3f56-42d7-a1e6-c79a7ed9a0ef admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 28 19:59:00.298134 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 20/38] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Oct 28 19:59:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:59:00.827820 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-9d75b9a8-5441-40c9-8142-5890b9e69f5b admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:00.833648 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.wsgi [None req-9d75b9a8-5441-40c9-8142-5890b9e69f5b admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-9d75b9a8-5441-40c9-8142-5890b9e69f5b admin admin] Request method failure captured: Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Accept: application/json Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Accept-Encoding: gzip, deflate Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Connection: keep-alive Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Content-Length: 0 Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Host: 10.222.0.66 Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Openstack-Api-Version: compute 2.92 Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Openstack-System-Scope: None Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: User-Agent: python-novaclient Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Auth-Token: gAAAAABjXDSEvyb_OxlLXBN_qF7Dv9gfGOjwuZBGJUH0DeFrhrDOQ2VI6632xdNDGl4BProwghj2LK7RAX_B5nPMwezL08Ad_Oq2EY5eZEhM1icWZ3rrRw3JVBjlT9eRvKVoVjS96otXPXtiTlWMYDKLIExTNf_sDOWBVhvZUKNrwv8YxZs2SF4 Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Domain-Id: None Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Domain-Name: None Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Identity-Status: Confirmed Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Is-Admin-Project: True Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Project-Domain-Id: default Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Project-Domain-Name: Default Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Project-Id: 9255f3850e094deb824d58d03e377387 Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Project-Name: admin Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Role: admin,reader,member Oct 28 19:59:00.836843 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Roles: admin,reader,member Oct 28 19:59:00.838606 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9255f3850e094deb824d58d03e377387"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9255f3850e094deb824d58d03e377387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9255f3850e094deb824d58d03e377387"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9255f3850e094deb824d58d03e377387", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 19:59:00.838606 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Tenant: admin Oct 28 19:59:00.838606 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Tenant-Id: 9255f3850e094deb824d58d03e377387 Oct 28 19:59:00.838606 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Tenant-Name: admin Oct 28 19:59:00.838606 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-User: admin Oct 28 19:59:00.838606 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-User-Domain-Id: default Oct 28 19:59:00.838606 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-User-Domain-Name: Default Oct 28 19:59:00.838606 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-User-Id: 8481404e88e44e68b2c70669768eebe2 Oct 28 19:59:00.838606 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-User-Name: admin Oct 28 19:59:00.838606 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: method: > Oct 28 19:59:00.838606 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: exception: Flavor 42 could not be found. Oct 28 19:59:00.838606 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: action_args: {'id': '42'} Oct 28 19:59:00.838606 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:59:00.838606 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:59:00.839642 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Oct 28 19:59:00.841104 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-9d75b9a8-5441-40c9-8142-5890b9e69f5b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:59:00.842640 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-9d75b9a8-5441-40c9-8142-5890b9e69f5b admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.394339 Oct 28 19:59:00.842640 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 19/39] 10.222.0.66 () {60 vars in 1190 bytes} [Fri Oct 28 19:59:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:00.848830 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-7cecd47a-e82c-4f21-b38b-65a7fb2eac5a admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:00.870343 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-7cecd47a-e82c-4f21-b38b-65a7fb2eac5a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025974 Oct 28 19:59:00.870965 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 21/40] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Oct 28 19:59:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:59:00.882135 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-f343f81d-3333-4e83-9569-b2c5fb9d02ff admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:00.904287 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-f343f81d-3333-4e83-9569-b2c5fb9d02ff admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027219 Oct 28 19:59:00.904836 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Oct 28 19:59:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:59:00.914260 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-b60b777e-3113-4a43-ae5f-1283bc3a7c02 admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:00.919997 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.wsgi [None req-b60b777e-3113-4a43-ae5f-1283bc3a7c02 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-b60b777e-3113-4a43-ae5f-1283bc3a7c02 admin admin] Request method failure captured: Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Accept: application/json Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Accept-Encoding: gzip, deflate Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Connection: keep-alive Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Content-Length: 0 Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Host: 10.222.0.66 Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Openstack-Api-Version: compute 2.92 Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Openstack-System-Scope: None Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: User-Agent: python-novaclient Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Auth-Token: gAAAAABjXDSEvyb_OxlLXBN_qF7Dv9gfGOjwuZBGJUH0DeFrhrDOQ2VI6632xdNDGl4BProwghj2LK7RAX_B5nPMwezL08Ad_Oq2EY5eZEhM1icWZ3rrRw3JVBjlT9eRvKVoVjS96otXPXtiTlWMYDKLIExTNf_sDOWBVhvZUKNrwv8YxZs2SF4 Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Domain-Id: None Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Domain-Name: None Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Identity-Status: Confirmed Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Is-Admin-Project: True Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Project-Domain-Id: default Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Project-Domain-Name: Default Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Project-Id: 9255f3850e094deb824d58d03e377387 Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Project-Name: admin Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Role: admin,reader,member Oct 28 19:59:00.923282 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Roles: admin,reader,member Oct 28 19:59:00.925059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9255f3850e094deb824d58d03e377387"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9255f3850e094deb824d58d03e377387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9255f3850e094deb824d58d03e377387"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9255f3850e094deb824d58d03e377387", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 19:59:00.925059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Tenant: admin Oct 28 19:59:00.925059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Tenant-Id: 9255f3850e094deb824d58d03e377387 Oct 28 19:59:00.925059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Tenant-Name: admin Oct 28 19:59:00.925059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-User: admin Oct 28 19:59:00.925059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-User-Domain-Id: default Oct 28 19:59:00.925059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-User-Domain-Name: Default Oct 28 19:59:00.925059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-User-Id: 8481404e88e44e68b2c70669768eebe2 Oct 28 19:59:00.925059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-User-Name: admin Oct 28 19:59:00.925059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: method: > Oct 28 19:59:00.925059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: exception: Flavor 42 could not be found. Oct 28 19:59:00.925059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: action_args: {'id': '42'} Oct 28 19:59:00.925059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:59:00.925059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:59:00.929589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Oct 28 19:59:00.930882 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-b60b777e-3113-4a43-ae5f-1283bc3a7c02 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:59:00.932083 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-b60b777e-3113-4a43-ae5f-1283bc3a7c02 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013997 Oct 28 19:59:00.932083 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 22/42] 10.222.0.66 () {60 vars in 1190 bytes} [Fri Oct 28 19:59:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:02.130423 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-f343f81d-3333-4e83-9569-b2c5fb9d02ff admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:02.131451 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-f343f81d-3333-4e83-9569-b2c5fb9d02ff admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 28 19:59:02.131852 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 21/43] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Oct 28 19:59:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:59:02.653850 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-9ab72702-ba46-4718-8506-bbe568c1e142 admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:02.658903 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.wsgi [None req-9ab72702-ba46-4718-8506-bbe568c1e142 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-9ab72702-ba46-4718-8506-bbe568c1e142 admin admin] Request method failure captured: Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Accept: application/json Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Accept-Encoding: gzip, deflate Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Connection: keep-alive Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Content-Length: 0 Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Host: 10.222.0.66 Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Openstack-Api-Version: compute 2.92 Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Openstack-System-Scope: None Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: User-Agent: python-novaclient Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Auth-Token: gAAAAABjXDSG4XRMqT1BhNbFl1FiH56CrBwwOqiZRxZSACta6sPf40Nej8-PUXHW2_3YQ1yojq1K1qDrOqiSIdrx3a7DZGoCNfES42c8YljGMm7scQndSax-3pPtDYwEl3mo1EV8klK6em-kKWd8o0kiYo0xszsQ23SeZE5IVwd3E3lqTV-Rw-w Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Domain-Id: None Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Domain-Name: None Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Identity-Status: Confirmed Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Is-Admin-Project: True Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Project-Domain-Id: default Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Project-Domain-Name: Default Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Project-Id: 9255f3850e094deb824d58d03e377387 Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Project-Name: admin Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Role: admin,reader,member Oct 28 19:59:02.660405 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Roles: admin,reader,member Oct 28 19:59:02.661964 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9255f3850e094deb824d58d03e377387"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9255f3850e094deb824d58d03e377387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9255f3850e094deb824d58d03e377387"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9255f3850e094deb824d58d03e377387", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 19:59:02.661964 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Tenant: admin Oct 28 19:59:02.661964 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Tenant-Id: 9255f3850e094deb824d58d03e377387 Oct 28 19:59:02.661964 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Tenant-Name: admin Oct 28 19:59:02.661964 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-User: admin Oct 28 19:59:02.661964 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-User-Domain-Id: default Oct 28 19:59:02.661964 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-User-Domain-Name: Default Oct 28 19:59:02.661964 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-User-Id: 8481404e88e44e68b2c70669768eebe2 Oct 28 19:59:02.661964 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-User-Name: admin Oct 28 19:59:02.661964 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: method: > Oct 28 19:59:02.661964 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: exception: Flavor 84 could not be found. Oct 28 19:59:02.661964 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: action_args: {'id': '84'} Oct 28 19:59:02.661964 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:59:02.661964 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:59:02.662922 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Oct 28 19:59:02.664266 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-9ab72702-ba46-4718-8506-bbe568c1e142 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:59:02.665497 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-9ab72702-ba46-4718-8506-bbe568c1e142 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.393433 Oct 28 19:59:02.665497 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 23/44] 10.222.0.66 () {60 vars in 1190 bytes} [Fri Oct 28 19:59:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:02.671303 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-d9ae9b02-e8be-4073-92ca-4e487233db67 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:02.686684 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-d9ae9b02-e8be-4073-92ca-4e487233db67 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018976 Oct 28 19:59:02.687229 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 22/45] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Oct 28 19:59:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:59:02.697216 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-9f19a7bb-8bc4-49dd-9f28-425e8d93e4d1 admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:02.712335 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-9f19a7bb-8bc4-49dd-9f28-425e8d93e4d1 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018855 Oct 28 19:59:02.712856 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 24/46] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Oct 28 19:59:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:59:02.721893 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-5fac837d-84b2-42dc-9d39-e7193ad3b1ee admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:02.726881 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.wsgi [None req-5fac837d-84b2-42dc-9d39-e7193ad3b1ee admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-5fac837d-84b2-42dc-9d39-e7193ad3b1ee admin admin] Request method failure captured: Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Accept: application/json Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Accept-Encoding: gzip, deflate Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Connection: keep-alive Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Content-Length: 0 Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Host: 10.222.0.66 Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Openstack-Api-Version: compute 2.92 Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Openstack-System-Scope: None Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: User-Agent: python-novaclient Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Auth-Token: gAAAAABjXDSG4XRMqT1BhNbFl1FiH56CrBwwOqiZRxZSACta6sPf40Nej8-PUXHW2_3YQ1yojq1K1qDrOqiSIdrx3a7DZGoCNfES42c8YljGMm7scQndSax-3pPtDYwEl3mo1EV8klK6em-kKWd8o0kiYo0xszsQ23SeZE5IVwd3E3lqTV-Rw-w Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Domain-Id: None Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Domain-Name: None Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Identity-Status: Confirmed Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Is-Admin-Project: True Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Project-Domain-Id: default Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Project-Domain-Name: Default Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Project-Id: 9255f3850e094deb824d58d03e377387 Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Project-Name: admin Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Role: admin,reader,member Oct 28 19:59:02.728380 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Roles: admin,reader,member Oct 28 19:59:02.729999 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9255f3850e094deb824d58d03e377387"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9255f3850e094deb824d58d03e377387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9255f3850e094deb824d58d03e377387"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9255f3850e094deb824d58d03e377387", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 19:59:02.729999 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Tenant: admin Oct 28 19:59:02.729999 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Tenant-Id: 9255f3850e094deb824d58d03e377387 Oct 28 19:59:02.729999 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Tenant-Name: admin Oct 28 19:59:02.729999 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-User: admin Oct 28 19:59:02.729999 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-User-Domain-Id: default Oct 28 19:59:02.729999 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-User-Domain-Name: Default Oct 28 19:59:02.729999 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-User-Id: 8481404e88e44e68b2c70669768eebe2 Oct 28 19:59:02.729999 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-User-Name: admin Oct 28 19:59:02.729999 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: method: > Oct 28 19:59:02.729999 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: exception: Flavor 84 could not be found. Oct 28 19:59:02.729999 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: action_args: {'id': '84'} Oct 28 19:59:02.729999 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:59:02.729999 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:59:02.730969 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Oct 28 19:59:02.732265 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-5fac837d-84b2-42dc-9d39-e7193ad3b1ee admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:59:02.733527 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-5fac837d-84b2-42dc-9d39-e7193ad3b1ee admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011434 Oct 28 19:59:02.733527 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 23/47] 10.222.0.66 () {60 vars in 1190 bytes} [Fri Oct 28 19:59:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:03.930250 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-9f19a7bb-8bc4-49dd-9f28-425e8d93e4d1 admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:03.931259 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-9f19a7bb-8bc4-49dd-9f28-425e8d93e4d1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 28 19:59:03.931688 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 25/48] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Oct 28 19:59:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:59:04.461723 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-222ddfd1-072a-44c4-879e-ceb2dc6fef21 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:04.467617 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.wsgi [None req-222ddfd1-072a-44c4-879e-ceb2dc6fef21 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-222ddfd1-072a-44c4-879e-ceb2dc6fef21 admin admin] Request method failure captured: Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Accept: application/json Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Accept-Encoding: gzip, deflate Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Connection: keep-alive Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Content-Length: 0 Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Host: 10.222.0.66 Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Openstack-Api-Version: compute 2.92 Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Openstack-System-Scope: None Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: User-Agent: python-novaclient Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Auth-Token: gAAAAABjXDSHvcx_fjegk0X_ZoPW_P4jeCPqC0aQZUJqEiSohtuox5S_Vlz0Ps6Ge--GKo2SR5LmwuWj8yhf85jejEELzjNF1OFYG3Z0buftT7cwVesKvKAF-G2dyPrR8pfk9EFIhtCbvN28FP69V4IymJ1aDqJpHIrUMw4yr4BzmiswJ0H7BPg Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Domain-Id: None Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Domain-Name: None Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Identity-Status: Confirmed Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Is-Admin-Project: True Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Project-Domain-Id: default Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Project-Domain-Name: Default Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Project-Id: 9255f3850e094deb824d58d03e377387 Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Project-Name: admin Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Role: admin,reader,member Oct 28 19:59:04.469286 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Roles: admin,reader,member Oct 28 19:59:04.470806 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9255f3850e094deb824d58d03e377387"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9255f3850e094deb824d58d03e377387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9255f3850e094deb824d58d03e377387"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9255f3850e094deb824d58d03e377387", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 19:59:04.470806 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Tenant: admin Oct 28 19:59:04.470806 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Tenant-Id: 9255f3850e094deb824d58d03e377387 Oct 28 19:59:04.470806 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-Tenant-Name: admin Oct 28 19:59:04.470806 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-User: admin Oct 28 19:59:04.470806 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-User-Domain-Id: default Oct 28 19:59:04.470806 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-User-Domain-Name: Default Oct 28 19:59:04.470806 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-User-Id: 8481404e88e44e68b2c70669768eebe2 Oct 28 19:59:04.470806 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: X-User-Name: admin Oct 28 19:59:04.470806 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: method: > Oct 28 19:59:04.470806 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: exception: Flavor 451 could not be found. Oct 28 19:59:04.470806 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: action_args: {'id': '451'} Oct 28 19:59:04.470806 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:59:04.470806 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:59:04.471823 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: ERROR nova.api.openstack.wsgi Oct 28 19:59:04.473193 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-222ddfd1-072a-44c4-879e-ceb2dc6fef21 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:59:04.474387 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-222ddfd1-072a-44c4-879e-ceb2dc6fef21 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.393835 Oct 28 19:59:04.474387 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 24/49] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Oct 28 19:59:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:04.480412 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-32bcb239-89b1-4502-898f-08280aabe3f2 admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:04.495427 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-32bcb239-89b1-4502-898f-08280aabe3f2 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018560 Oct 28 19:59:04.495978 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 26/50] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Oct 28 19:59:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:59:04.506217 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-af03df4e-8ec3-476f-99f3-fbb979890cc7 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:04.521998 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-af03df4e-8ec3-476f-99f3-fbb979890cc7 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019918 Oct 28 19:59:04.522523 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 25/51] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Oct 28 19:59:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:59:04.531942 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-9b70d2f9-8d75-42f8-bbcf-bb5704c9a549 admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:04.537050 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.wsgi [None req-9b70d2f9-8d75-42f8-bbcf-bb5704c9a549 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-9b70d2f9-8d75-42f8-bbcf-bb5704c9a549 admin admin] Request method failure captured: Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Accept: application/json Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Accept-Encoding: gzip, deflate Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Connection: keep-alive Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Content-Length: 0 Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Host: 10.222.0.66 Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Openstack-Api-Version: compute 2.92 Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Openstack-System-Scope: None Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: User-Agent: python-novaclient Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Auth-Token: gAAAAABjXDSHvcx_fjegk0X_ZoPW_P4jeCPqC0aQZUJqEiSohtuox5S_Vlz0Ps6Ge--GKo2SR5LmwuWj8yhf85jejEELzjNF1OFYG3Z0buftT7cwVesKvKAF-G2dyPrR8pfk9EFIhtCbvN28FP69V4IymJ1aDqJpHIrUMw4yr4BzmiswJ0H7BPg Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Domain-Id: None Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Domain-Name: None Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Identity-Status: Confirmed Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Is-Admin-Project: True Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Project-Domain-Id: default Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Project-Domain-Name: Default Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Project-Id: 9255f3850e094deb824d58d03e377387 Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Project-Name: admin Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Role: admin,reader,member Oct 28 19:59:04.545272 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Roles: admin,reader,member Oct 28 19:59:04.547059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9255f3850e094deb824d58d03e377387"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9255f3850e094deb824d58d03e377387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9255f3850e094deb824d58d03e377387"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9255f3850e094deb824d58d03e377387", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 19:59:04.547059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Tenant: admin Oct 28 19:59:04.547059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Tenant-Id: 9255f3850e094deb824d58d03e377387 Oct 28 19:59:04.547059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-Tenant-Name: admin Oct 28 19:59:04.547059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-User: admin Oct 28 19:59:04.547059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-User-Domain-Id: default Oct 28 19:59:04.547059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-User-Domain-Name: Default Oct 28 19:59:04.547059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-User-Id: 8481404e88e44e68b2c70669768eebe2 Oct 28 19:59:04.547059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: X-User-Name: admin Oct 28 19:59:04.547059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: method: > Oct 28 19:59:04.547059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: exception: Flavor 451 could not be found. Oct 28 19:59:04.547059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: action_args: {'id': '451'} Oct 28 19:59:04.547059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:59:04.547059 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:59:04.548024 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: ERROR nova.api.openstack.wsgi Oct 28 19:59:04.549395 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-9b70d2f9-8d75-42f8-bbcf-bb5704c9a549 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:59:04.551542 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-9b70d2f9-8d75-42f8-bbcf-bb5704c9a549 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011656 Oct 28 19:59:04.551542 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 27/52] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Oct 28 19:59:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:05.746690 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-af03df4e-8ec3-476f-99f3-fbb979890cc7 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:05.747705 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-af03df4e-8ec3-476f-99f3-fbb979890cc7 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Oct 28 19:59:05.748102 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 26/53] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Oct 28 19:59:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:59:06.279473 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-4e617d26-2f7a-4fce-84e3-76401a90500c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:59:06.360461 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-4e617d26-2f7a-4fce-84e3-76401a90500c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.474349 Oct 28 19:59:06.361017 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 28/54] 10.222.0.66 () {64 vars in 1235 bytes} [Fri Oct 28 19:59:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:59:07.568814 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-af03df4e-8ec3-476f-99f3-fbb979890cc7 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:07.570145 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-af03df4e-8ec3-476f-99f3-fbb979890cc7 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 28 19:59:07.570542 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 27/55] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Oct 28 19:59:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:59:08.097670 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-34d12f6d-de9c-48a2-b68b-ab3ffd493c01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:59:08.197903 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-34d12f6d-de9c-48a2-b68b-ab3ffd493c01 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.485738 Oct 28 19:59:08.198519 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 29/56] 10.222.0.66 () {64 vars in 1235 bytes} [Fri Oct 28 19:59:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:59:09.406276 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-af03df4e-8ec3-476f-99f3-fbb979890cc7 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:09.407281 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-af03df4e-8ec3-476f-99f3-fbb979890cc7 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Oct 28 19:59:09.407705 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 28/57] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Oct 28 19:59:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:59:09.929856 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-5a5a827f-274b-40a1-bbb3-a9d55e609d23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:59:10.007249 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-5a5a827f-274b-40a1-bbb3-a9d55e609d23 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.461524 Oct 28 19:59:10.007820 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 30/58] 10.222.0.66 () {64 vars in 1235 bytes} [Fri Oct 28 19:59:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:59:11.215269 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-af03df4e-8ec3-476f-99f3-fbb979890cc7 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:11.216285 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-af03df4e-8ec3-476f-99f3-fbb979890cc7 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Oct 28 19:59:11.216687 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 29/59] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Oct 28 19:59:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:59:11.738351 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-9e79bed2-f06b-4959-a60a-1df73c638281 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:59:11.854093 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-9e79bed2-f06b-4959-a60a-1df73c638281 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.498516 Oct 28 19:59:11.854572 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 31/60] 10.222.0.66 () {64 vars in 1235 bytes} [Fri Oct 28 19:59:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:59:13.098691 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-af03df4e-8ec3-476f-99f3-fbb979890cc7 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:13.099693 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-af03df4e-8ec3-476f-99f3-fbb979890cc7 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 28 19:59:13.100273 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 30/61] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Oct 28 19:59:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:59:13.619030 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-f83a1a76-d7f2-4c5b-be0d-62a829043f46 admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:13.640791 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-f83a1a76-d7f2-4c5b-be0d-62a829043f46 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.405189 Oct 28 19:59:13.641617 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 32/62] 10.222.0.66 () {60 vars in 1202 bytes} [Fri Oct 28 19:59:13 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:00:11.431987 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-af03df4e-8ec3-476f-99f3-fbb979890cc7 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:00:11.433009 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-af03df4e-8ec3-476f-99f3-fbb979890cc7 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 28 20:00:11.433449 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 31/63] 10.222.0.66 () {54 vars in 931 bytes} [Fri Oct 28 20:00:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:00:11.444859 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG dbcounter [-] [104369] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:11.829107 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-1dcc982a-6079-409b-aef1-db6c7678642f admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:00:11.851304 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-1dcc982a-6079-409b-aef1-db6c7678642f admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411757 Oct 28 20:00:11.851791 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 33/64] 10.222.0.66 () {60 vars in 1292 bytes} [Fri Oct 28 20:00:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:00:11.872552 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG dbcounter [-] [104368] Writing DB stats nova_api:SELECT=14 {{(pid=104368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:11.876578 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-ec2432d2-c1cd-4d75-9e38-bc07ff4eb7d1 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:00:11.883716 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-ec2432d2-c1cd-4d75-9e38-bc07ff4eb7d1 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012559 Oct 28 20:00:11.884235 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 32/65] 10.222.0.66 () {60 vars in 1283 bytes} [Fri Oct 28 20:00:11 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:00:11.896475 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-5de43b3f-3f13-4ff4-a29b-ca566962acd2 admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:00:11.903712 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-5de43b3f-3f13-4ff4-a29b-ca566962acd2 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011697 Oct 28 20:00:11.904233 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 34/66] 10.222.0.66 () {60 vars in 1286 bytes} [Fri Oct 28 20:00:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:00:11.916245 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-56b6e336-450f-46ec-9ef4-95e78e049213 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:00:11.923571 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-56b6e336-450f-46ec-9ef4-95e78e049213 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011097 Oct 28 20:00:11.924079 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 33/67] 10.222.0.66 () {60 vars in 1286 bytes} [Fri Oct 28 20:00:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:00:11.934981 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-0fc83df0-e8a0-4569-a02b-ed2026463d3b admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:00:11.942025 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-0fc83df0-e8a0-4569-a02b-ed2026463d3b admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010471 Oct 28 20:00:11.942741 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 35/68] 10.222.0.66 () {60 vars in 1283 bytes} [Fri Oct 28 20:00:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:24.280230 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-56b6e336-450f-46ec-9ef4-95e78e049213 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:24.281294 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-56b6e336-450f-46ec-9ef4-95e78e049213 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 28 20:03:24.281685 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 34/69] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Oct 28 20:03:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:03:24.422713 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG dbcounter [-] [104369] Writing DB stats nova_api:SELECT=6 {{(pid=104369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:24.585687 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-34343d13-d436-43e7-a6e3-b5fa378e9b16 admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:24.595904 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-34343d13-d436-43e7-a6e3-b5fa378e9b16 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:24.595904 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-34343d13-d436-43e7-a6e3-b5fa378e9b16 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:24.595904 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-34343d13-d436-43e7-a6e3-b5fa378e9b16 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:24.595904 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-34343d13-d436-43e7-a6e3-b5fa378e9b16 admin admin] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:24.595904 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-34343d13-d436-43e7-a6e3-b5fa378e9b16 admin admin] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:24.596374 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-34343d13-d436-43e7-a6e3-b5fa378e9b16 admin admin] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:24.624493 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-34343d13-d436-43e7-a6e3-b5fa378e9b16 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.202995 Oct 28 20:03:24.625054 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 36/70] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Oct 28 20:03:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:03:25.743119 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-56b6e336-450f-46ec-9ef4-95e78e049213 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:25.745203 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-56b6e336-450f-46ec-9ef4-95e78e049213 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 Oct 28 20:03:25.745747 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 35/71] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Oct 28 20:03:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:03:25.943469 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-de920c15-7815-4e3d-a717-588b2336c96d admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:25.947570 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-de920c15-7815-4e3d-a717-588b2336c96d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:25.947992 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-de920c15-7815-4e3d-a717-588b2336c96d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:25.948414 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-de920c15-7815-4e3d-a717-588b2336c96d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:25.949120 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-de920c15-7815-4e3d-a717-588b2336c96d admin admin] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:25.949589 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-de920c15-7815-4e3d-a717-588b2336c96d admin admin] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:25.950003 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-de920c15-7815-4e3d-a717-588b2336c96d admin admin] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:25.970013 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-de920c15-7815-4e3d-a717-588b2336c96d admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.079828 Oct 28 20:03:25.970581 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 37/72] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Oct 28 20:03:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:03:37.555449 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-56b6e336-450f-46ec-9ef4-95e78e049213 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:37.556470 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-56b6e336-450f-46ec-9ef4-95e78e049213 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 28 20:03:37.556881 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 36/73] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Oct 28 20:03:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:03:37.700563 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG dbcounter [-] [104369] Writing DB stats nova_cell0:SELECT=4 {{(pid=104369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:37.701361 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG dbcounter [-] [104369] Writing DB stats nova_cell1:SELECT=4 {{(pid=104369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:37.702217 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG dbcounter [-] [104369] Writing DB stats nova_api:SELECT=8 {{(pid=104369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:37.762419 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-b65a7954-9a59-4963-adcd-9de12890d12a admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:37.765865 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-b65a7954-9a59-4963-adcd-9de12890d12a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:37.766339 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-b65a7954-9a59-4963-adcd-9de12890d12a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:37.766767 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-b65a7954-9a59-4963-adcd-9de12890d12a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:37.767469 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-b65a7954-9a59-4963-adcd-9de12890d12a admin admin] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:37.767912 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-b65a7954-9a59-4963-adcd-9de12890d12a admin admin] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:37.768325 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-b65a7954-9a59-4963-adcd-9de12890d12a admin admin] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:37.794777 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-b65a7954-9a59-4963-adcd-9de12890d12a admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.099274 Oct 28 20:03:37.795332 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 38/74] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Oct 28 20:03:37 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:03:38.891467 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG nova.api.openstack.wsgi [None req-56b6e336-450f-46ec-9ef4-95e78e049213 admin admin] Calling method '>' {{(pid=104368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:38.892469 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: INFO nova.api.openstack.requestlog [None req-56b6e336-450f-46ec-9ef4-95e78e049213 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Oct 28 20:03:38.892873 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: [pid: 104368|app: 0|req: 37/75] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Oct 28 20:03:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:03:39.085720 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG nova.api.openstack.wsgi [None req-29d42f8a-8fbd-4f7d-a9de-0a35023cf8b4 admin admin] Calling method '>' {{(pid=104369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:39.089089 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-29d42f8a-8fbd-4f7d-a9de-0a35023cf8b4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:39.089749 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-29d42f8a-8fbd-4f7d-a9de-0a35023cf8b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:39.090201 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-29d42f8a-8fbd-4f7d-a9de-0a35023cf8b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:39.090908 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-29d42f8a-8fbd-4f7d-a9de-0a35023cf8b4 admin admin] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:39.091366 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-29d42f8a-8fbd-4f7d-a9de-0a35023cf8b4 admin admin] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:39.091775 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: DEBUG oslo_concurrency.lockutils [None req-29d42f8a-8fbd-4f7d-a9de-0a35023cf8b4 admin admin] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:39.113095 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: INFO nova.api.openstack.requestlog [None req-29d42f8a-8fbd-4f7d-a9de-0a35023cf8b4 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.080492 Oct 28 20:03:39.113620 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: [pid: 104369|app: 0|req: 39/76] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Oct 28 20:03:39 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:04:35.809659 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: Fri Oct 28 20:04:35 2022 - graceful shutdown triggered... Oct 28 20:04:35.809779 dv-cinder-862365-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 28 20:04:35.810676 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: Gracefully killing worker 1 (pid: 104368)... Oct 28 20:04:35.811058 dv-cinder-862365-2-iscsi devstack@n-api.service[104369]: Gracefully killing worker 2 (pid: 104369)... Oct 28 20:04:35.937027 dv-cinder-862365-2-iscsi devstack@n-api.service[104368]: DEBUG dbcounter [-] [104368] Writing DB stats nova_api:SELECT=4 {{(pid=104368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:36.811323 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: worker 1 buried after 1 seconds Oct 28 20:04:36.811323 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: worker 2 buried after 1 seconds Oct 28 20:04:36.811323 dv-cinder-862365-2-iscsi devstack@n-api.service[104367]: goodbye to uWSGI. Oct 28 20:04:36.812909 dv-cinder-862365-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 28 20:04:36.813500 dv-cinder-862365-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 28 20:04:36.816235 dv-cinder-862365-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 20:04:36.830511 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 20:04:36.832516 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 20:04:36 2022] *** Oct 28 20:04:36.832516 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 20:04:36.832516 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 20:04:36.832516 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: nodename: dv-cinder-862365-2-iscsi Oct 28 20:04:36.832516 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: machine: x86_64 Oct 28 20:04:36.832516 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: clock source: unix Oct 28 20:04:36.832516 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: pcre jit disabled Oct 28 20:04:36.832516 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: detected number of CPU cores: 4 Oct 28 20:04:36.832516 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: current working directory: / Oct 28 20:04:36.832516 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: detected binary path: /usr/bin/uwsgi-core Oct 28 20:04:36.833269 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: your processes number limit is 47680 Oct 28 20:04:36.833269 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: your memory page size is 4096 bytes Oct 28 20:04:36.833269 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: detected max file descriptor number: 2048 Oct 28 20:04:36.833269 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: lock engine: pthread robust mutexes Oct 28 20:04:36.833269 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: thunder lock: enabled Oct 28 20:04:36.833269 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 20:04:36.833269 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 20:04:36.872609 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: Python main interpreter initialized at 0x555c344d99c0 Oct 28 20:04:36.873248 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: python threads support enabled Oct 28 20:04:36.873403 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: your server socket listen backlog is limited to 100 connections Oct 28 20:04:36.873921 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: your mercy for graceful operations on workers is 90 seconds Oct 28 20:04:36.874363 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 20:04:36.874583 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: *** Operational MODE: preforking *** Oct 28 20:04:36.875407 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: *** uWSGI is running in multiple interpreter mode *** Oct 28 20:04:36.880112 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: spawned uWSGI master process (pid: 119392) Oct 28 20:04:36.880112 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: spawned uWSGI worker 1 (pid: 119406, cores: 1) Oct 28 20:04:36.880112 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: spawned uWSGI worker 2 (pid: 119407, cores: 1) Oct 28 20:04:36.880112 dv-cinder-862365-2-iscsi devstack@n-api.service[119392]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 20:04:36.875745 dv-cinder-862365-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 28 20:04:37.537044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 20:04:37.565881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 20:04:38.871136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 20:04:38.871136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: from cryptography.utils import int_from_bytes Oct 28 20:04:38.871136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 20:04:38.871136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: from cryptography.utils import int_from_bytes Oct 28 20:04:38.893879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 20:04:38.893879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: from cryptography.utils import int_from_bytes Oct 28 20:04:38.894615 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 20:04:38.894615 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: from cryptography.utils import int_from_bytes Oct 28 20:04:41.349061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 20:04:41.349665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 20:04:41.349911 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 20:04:41.350284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 20:04:41.350550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 20:04:41.350948 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.351287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.351618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.351945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.352282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.352598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.352928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.353253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.353626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.353893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.354214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.354544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862365-2-iscsi {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.354869 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.355182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.355497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.355820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.356753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.357138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.357480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.357989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.358446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.358763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.359085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.359431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.359754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.360072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.360399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.360715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.361046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.361392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.361802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862365-2-iscsi {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.362128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.362450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.362772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.363198 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.363519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.363836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.364167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.364498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.364813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.365148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.365503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.365833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.366170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.366479 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.366808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.367110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.367443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.367754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.368074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.368322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.368648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.368971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.369302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.369887 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.370152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.370411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.370758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.371058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.371375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.371851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.372081 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.372333 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.372651 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.372967 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.373279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.373617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.373946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.374269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.374600 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.374918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.375274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.375682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.375939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.376262 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.376611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.376937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.377255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.377611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.377939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.378255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.378573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.378891 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.379221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.379565 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.379881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.380137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.380446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.380761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.381089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.381429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.381746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.382060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.382369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.382684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.383065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.383385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.383718 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.384017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.384331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.384645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.384959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.385271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.385610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.385937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.386272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.386590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.386903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.387216 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.387556 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.387892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.388206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.388520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.388849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.389160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.389496 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.389829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.390147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.390461 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.390787 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.391097 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.391413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.391736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.392053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.392366 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.392679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.392992 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.393302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.393645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.393955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.394268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.394578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.394903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.395232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.395546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.395859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.396175 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.396502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.396845 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.397186 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.397566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.397892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.398230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.398568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.398898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.399216 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.399541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.399881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.400203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.400523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.400843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.401172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.401525 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.401864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.402189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.402513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.402839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.403716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.404087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.404445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.404776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.405096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.405470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.405829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.406160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.406497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.406829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.407160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.407470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.407788 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.408146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.408376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 20:04:41.408782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.408878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 20:04:41.408985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.409087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.409170 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 20:04:41.409423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.409563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 20:04:41.409755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.409861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 20:04:41.410076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.410207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.410397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.410540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.410719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.410869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.411037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.411195 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.411358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.411530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.411703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.411847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.412030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.412177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.412362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.412502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.412688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.412835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.413010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.413107 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.413391 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.413498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.413682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.413782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862365-2-iscsi {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.414002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.414102 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.414321 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.414419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.414633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.414731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.414947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.415038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.415262 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.415352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.415579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.415671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.415899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.415994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.416228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.416423 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.416564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.416741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.416879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.417054 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.417229 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.417401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.417567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.417749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.417891 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.418163 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.418275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.418370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.418519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.418705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.418969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.419484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.419594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.419812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.419910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.420132 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.420229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.420470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.420570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862365-2-iscsi {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.420795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.420887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.421115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.421213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.421476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.421584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.421801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.421972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.422126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.422275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.422467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.422554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.422753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.422891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.423075 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.423229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.423398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.423525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.423719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.423861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.424069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.424176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.424378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.424503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.424700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.424834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.425043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.425143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.425405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.425499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.425722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.425813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.426061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.426160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.426388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.426484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.426699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.426795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.426960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.427060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.427278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.427375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.427609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.427700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.427920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.428010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.428237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.428348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.428505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.428609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.428762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.428854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.429093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.429185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.429451 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.429571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.429777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.429880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.430087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.430184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.430401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.430500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.430719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.430817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.431031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.431133 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.431343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.431441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.431656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.431754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.431968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.432066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.432296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.432394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.432620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.432715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.432951 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.433036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.433267 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.433395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.433624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.433716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.433956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.434051 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.434802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.434943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.435289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.435578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.435670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.435922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.436011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.436242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.436335 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.436561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.436654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.436884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.436969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.437212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.437311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.437556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.437647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.437873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.437973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.438190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.438303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.438520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.438629 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.438834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.438934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.439163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.439289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.439421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.439537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.439734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.439848 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.440053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.440160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.440383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.440482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.440701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.440806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.441019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.441110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.441351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.441457 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.441666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.441765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.441981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.442080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.442298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.442390 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.442612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.442712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.442926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.443023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.443243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.443339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.443559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.443659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.443870 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.443959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.444184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.444276 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.444499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.444590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.444808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.444899 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.445131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.445228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.445490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.445583 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.445807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.445897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.446123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.446228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.446440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.446538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.446755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.446858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.447069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.447164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.447386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.447578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.447700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.447790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.448009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.448098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.448321 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.448412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.448635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.448734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.448957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.449048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.449272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.449400 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.449613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.449713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.450056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.450290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.450383 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.450659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.450802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.450971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.451130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.451282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.451462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.451602 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.451785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.451933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.452103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.452254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.452421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.452584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.452739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.452911 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.453056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.453223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.453625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.453812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.453951 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.454143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.454268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.454459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.454579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.454772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.454909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.455084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.455246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.455393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.455564 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.455745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.455881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.456064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.456197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.456385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.456526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:04:41.456710 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.456868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.457039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.457212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.457444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.457591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.457772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.457917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.458093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.458258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.458411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.458599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.458727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.458926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.459050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.459246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.459349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.459572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.459663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.459908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.460005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.460252 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.460370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.460546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.460638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.460866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.460964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.461189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.461341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.461541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.461692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.461857 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.461981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.462168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.462270 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.462488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.462578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.462813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.462904 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.463129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.463397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.463495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.463740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.463872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.464064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.464164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.464392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.464491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.464741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.464829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.465066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.465167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.465432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.466037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.466314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.466637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.466912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.467010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.467260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.467386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.467576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.468231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.468355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.468471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.468579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.468696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.468820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.468928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.469043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.469158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.469293 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.469457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.469595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.469724 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.469850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.469976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.470113 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.470248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.470464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.470594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.470731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.470867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.471005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.471134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.471261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.471402 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.471537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.471709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.471851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.472132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.472272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.472408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.472544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.472680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.472808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.473064 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.473182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.473299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.473453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.473647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.473776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.474069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.474207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.474335 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.474422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.474582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.474672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.474896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.474995 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.475209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.475307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.475524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.475621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.475850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.475941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.476164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.476255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.476495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.476584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.476810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.476900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.477129 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.477227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.477470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.477582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.477782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.477880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.478102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.478192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.478422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.478519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.478738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.478845 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.479050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.479142 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.479357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.479460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.479672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.479769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.479982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.480077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.480301 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.480399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.480620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.480713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.480933 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.481020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.481421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.481749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.481843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.482067 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.482158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.482378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.482467 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.482697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.482796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.483010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.483110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.483335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.483439 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.483648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.483748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.483961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.484081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.484270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.484414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.484621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.484884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.484975 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.485208 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.485298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.485554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.485656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.485891 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.485982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.486213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.486303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.486528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.486627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.486850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.486942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.487168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.487267 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.487482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.487572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.487792 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.487880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.488107 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.488207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.488419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.488524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.488736 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.488827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.489046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.489188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.489382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.489494 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.489697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.489795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.490009 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.490101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.490319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.490416 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.490672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.490782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.490942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.491042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.491251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.491397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.491620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.491721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.491867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.491964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.492173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.492269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.492502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.492601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.492816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.492908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.493130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.493220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.493464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.493575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.493778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.493878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.494133 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.494276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.494449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.494639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.494764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.494853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.495084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.495183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.495404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.495504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.495729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.495820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.496047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.496144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.496362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.496460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.497197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.497392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.497546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.497870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.498070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.498194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.498415 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.498514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.498742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.498834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.499077 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.499219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.499397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.499490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.499737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.499844 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.500043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.500145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.500371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.500465 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.500778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.500882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.501036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.501127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.501367 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.501517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.501727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.501830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.502001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.502099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.502315 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.502405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.502630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.502733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.502946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.503037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.503269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.503366 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.503604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.503707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.503889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.503982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.504202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.504319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.504517 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.504657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.504835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.504929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.505152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.505247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.505499 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.505605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.505816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.505916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.506148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.506249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.506462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.506554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.506780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.506871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.507098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.507190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.507410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.507509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.507729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.507818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.508040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.508130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.508354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.508666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.508763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.508979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.509077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.509295 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.509483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.509643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.509734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.509962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.510061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.510280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.510379 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.510594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.510692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.510918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.511027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.511229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.511328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.511541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.511655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.511853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.511962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.512171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.512303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.512708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.513026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.513124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.513360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.513469 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.513686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.513785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.514020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.514111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.514336 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.514441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.514653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.514752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.514968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.515062 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.515299 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.515392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.515615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.515705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.515932 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.516020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.516301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.516475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.516588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.516689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.516908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.517008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.517222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.517410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.517579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.517733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.517909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.518052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.518227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.518384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.518551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.519101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.519200 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.519293 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.519367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.519492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.519795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.523561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.523561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.523872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.524018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.524161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.524292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.524434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.524567 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.524699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.524841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.524972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.525108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.525245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.525402 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.525542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.525680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.525816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.525952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.526088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.526226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.526363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.526491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.526619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.526747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.526953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.527093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.527230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.527359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.527495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.527624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.527766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.527896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.528560 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.528705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.528845 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.528982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.529111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.529246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.529410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.529410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.529410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.529792 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.529920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.530049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.530188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.530335 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.530464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.530464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.530674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.530768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.530855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.530951 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.531052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.531262 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.531364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.531450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.531542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.531634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.531719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.531858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.531954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.532068 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.532225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.532327 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.532413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.532504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.532589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.532673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.532764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.532856 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.532949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.533033 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.533125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.533216 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.533313 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.533479 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.533578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.533734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.533882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.534048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.534203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.534403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.534516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.534723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.534819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.535057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.535150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.535398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.535490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.535739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.535833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.536060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.536154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.536404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.536495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.536746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.536844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.537078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.537169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.537418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.537525 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.537747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.537851 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.538061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.538150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.538375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.538466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.538688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.538785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.539003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.539093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.539318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.539414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.539628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.539777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.539942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.540035 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.540257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.540348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.540569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.540719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.540884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.540983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.541196 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.541364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.541540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.541640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.541853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.541997 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.542178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.542313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.542497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.542595 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.542805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.542896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.543116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.543214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.543430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.543532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.543851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.544168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.544304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.544511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.544652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.544830 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.544986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.545165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.545311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.545532 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.545666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.545859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.545987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.546184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.546311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.546510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.546631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.546842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.546956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.547170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.547269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.547495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.547597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.547813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.547905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.548141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.548240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.548471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.548612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.548799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.548910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.549123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.549387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.549507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.549771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.549936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.550102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.550334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.550434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.550521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.550731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.550869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.551046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.551146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.551366 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.551501 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.551677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.551781 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.551990 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.552091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.552303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.552395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.552618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.552722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.552927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.553030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.553236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.553375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.553634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.553726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.553946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.554048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.554256 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.554348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.554592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.554736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.554954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.555063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.555254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.555347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.555531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.555637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.555834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.555941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.556193 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.556292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.556506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.556605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.556833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.556929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.557158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.557255 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.557505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.557630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.557830 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.558014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.558179 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.558343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.558508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.558654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.558798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.558940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.559089 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.559810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.560082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.560238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.560390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.560528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.560716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.560882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.561049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.561186 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.561392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.561502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.561714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.561816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.562050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.562200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.562379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.562689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.562784 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.563015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.563108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.563347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.563439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.563680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.563779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.563994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.564086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.564315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.564415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.564639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.564739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.564970 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.565070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.565276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.565418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.565615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.565718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.565935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.566036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.566254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.566354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.566566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.566667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.566888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.566986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.567208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.567300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.567522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.567636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.567849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.567950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.568165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.568265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.568481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.568714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.568814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.569081 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.569181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.569443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.569554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.569766 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.569859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.570112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.570246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.570439 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.570558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.570754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.570872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.571088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.571403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.571510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.571725 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.571850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.572050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.572144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.572371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.572475 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.572688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.572788 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.573005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.573097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.573356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.573470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.573671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.573771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.573985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.574081 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.574313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.574455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.574619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.574718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.575036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.575408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.575653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.575771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.575992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.576091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.576314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.576425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.576638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.576733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.576965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.577061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.577282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.577407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.577625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.577721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.577941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.578035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.578253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.578346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.578828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.578932 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.579145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.579240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.579515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.579615 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.579833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.579928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.580154 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.580244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.580471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.580587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.580807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.580989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.581149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.581289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.581447 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.581558 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.581775 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.581912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.582095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.582195 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.582428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.582530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.582751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.582850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.583101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.583199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.583442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.583546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.583769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.583867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.584113 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.584319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.584428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.584665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.584757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.584999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.585092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.585373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.585552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.585709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.585801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.586033 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.586126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.586371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.586471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.586686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.586785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.587020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.587120 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.587345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.587446 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.587667 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.587759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.587988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.588080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.588309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.588402 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.588626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.588726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.588944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.589036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.589258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.589377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.589603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.589713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.589928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.590034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.590241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.590344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.591103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.591248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.591495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.591820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.591975 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.592142 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.592236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.592467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.592560 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.592822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.592930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.593152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.593261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.593504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.593619 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.593831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.593934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.594154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.594254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.594475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.594578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.594793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.594888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.595111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.595219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.595430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.595546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.595746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.595839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.596063 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.596165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.596380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.596479 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.596700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.596810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.597054 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.597156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.597394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.597514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.597744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.597844 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.598065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.598166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.598406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.598501 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.598727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.598820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.599056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.599157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.599378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.599496 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.599708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.599819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.600029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.600122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.600360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.600453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.600700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.600800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.601016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.601132 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.601374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.601542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.601692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.601836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.601986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.602168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.602319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.602463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.602629 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.602778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.602926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.603072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.603213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.603362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.603502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.603650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.603798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.603961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.604126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.604266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.604439 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.604598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.604745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.604899 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.605047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.605236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.605443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.605587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.605735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.605876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.606038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.606239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.606388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.606809 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.606957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.607131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.607274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.607446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.607590 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.607765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.607917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.608085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.608235 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.608385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.608526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.608698 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.608853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.609002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.609143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.609290 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.609459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.609633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.609794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.609973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.610123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.610314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.610452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.610636 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.610774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.610966 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.611102 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.611288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.611434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.611620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.611731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.611936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.612264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.612357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.612593 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.612737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.612917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.613014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.613230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.613342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.613576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.613669 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.613901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.613991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.614222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.614321 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.614539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.614668 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.614852 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.614943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.615169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.615280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.615491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.615606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.615825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.615923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.616155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.616336 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.616467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.616561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.616801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.616896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.617129 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.617237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.617475 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.617580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.617806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.617900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.618124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.618229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.618465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.618559 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.618784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.618877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.619102 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.619195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.619415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.619508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.619734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.619836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.620051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.620155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.620368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.620465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.620689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.620789 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.621001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.621112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.621348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.621450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.621798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.621963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.622174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.622514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.622665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.622837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.622947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.623176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.623283 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.623512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.623614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.623863 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.623975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.624184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.624301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.624517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.624618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.624848 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.624963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.625168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.625262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.625536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.625726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.625851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.626056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.626151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 20:04:41.626402 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.626747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.627086 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.627416 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.627746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.628084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.628402 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.628718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.629041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.629386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.629706 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.630039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.630363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.630682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.631014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.631333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.631884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.632247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.632578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.632918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.633256 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.633627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.633949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.634284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.634602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.634919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.635247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.635571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.635886 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.636204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.636534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.636854 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.637168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.638471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.638800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.639145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.639466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.639785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.640103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.640426 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.640743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.641060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.641407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.641726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.642049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.642362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.642681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.642998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.643320 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.643689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.644007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.644323 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.644658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.644973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.645287 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.645637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.645958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.646293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.646615 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.646939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.647295 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.647621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.648172 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.648522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.648858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.649208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.649584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.649908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.650231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.650553 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.650889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.651214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.651566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.651892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.652213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.652580 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.652853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.653754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.654087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.654412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.654736 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.655061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.655385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.655707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.656029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.656354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.656707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.657036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.657391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.657723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.658055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.658375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.658695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.659015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.659333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.659662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.660004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.660327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.660642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.661074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.661418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.661749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.662084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.662405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.662737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.663067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.663388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.663717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.664037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.664378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.664729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.665068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.665425 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.665747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.666081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.666396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.666716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.667051 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.667370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.667683 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.667996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.668316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.669203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.670065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.670393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.670712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.671034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.671354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.671671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.671986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.672312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.672616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.672932 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.673251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.673608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.673910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.674225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.674539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.674850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.675193 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.675538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.675858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.676190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.676511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.676844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.677169 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.677523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.677855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.678181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.678500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.678842 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.679161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.679484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.679806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.680323 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.680427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.680741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.681076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.681436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.681751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.682085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.682413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.682744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.683073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.683389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.683727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.684047 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.684862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.685192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.685546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.685870 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.686198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.686520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.686842 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.687169 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.687502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.687840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.688176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.688497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.688835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.688926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO dbcounter [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] Registered counter for database nova_api Oct 28 20:04:41.689170 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.689553 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.689880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.690233 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.690573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.690897 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.691220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.691537 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:04:41.691786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 20:04:41.710027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_db.sqlalchemy.engines [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 20:04:41.717689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writer thread running {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 20:04:41.757584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO dbcounter [None req-740f5281-b81a-4894-9711-fc244b4514da None None] Registered counter for database nova_api Oct 28 20:04:41.774943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.context [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f77e283-8dfe-4ddd-b40e-e3af731a397f(cell1) {{(pid=119407) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 20:04:41.779148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_db.sqlalchemy.engines [None req-740f5281-b81a-4894-9711-fc244b4514da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 20:04:41.779291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:41.779631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:41.781223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:41.782002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:41.782460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:41.784494 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:41.785952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writer thread running {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 20:04:41.786588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO dbcounter [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] Registered counter for database nova_cell0 Oct 28 20:04:41.791006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO dbcounter [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] Registered counter for database nova_cell1 Oct 28 20:04:41.800117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_db.sqlalchemy.engines [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 20:04:41.800997 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_db.sqlalchemy.engines [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 20:04:41.808089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writer thread running {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 20:04:41.810080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writer thread running {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 20:04:41.845013 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.context [None req-740f5281-b81a-4894-9711-fc244b4514da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f77e283-8dfe-4ddd-b40e-e3af731a397f(cell1) {{(pid=119406) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 20:04:41.848940 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740f5281-b81a-4894-9711-fc244b4514da None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:41.849461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740f5281-b81a-4894-9711-fc244b4514da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:41.851056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740f5281-b81a-4894-9711-fc244b4514da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:41.851788 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740f5281-b81a-4894-9711-fc244b4514da None None] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:41.852240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740f5281-b81a-4894-9711-fc244b4514da None None] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:41.854306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740f5281-b81a-4894-9711-fc244b4514da None None] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:41.857019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO dbcounter [None req-740f5281-b81a-4894-9711-fc244b4514da None None] Registered counter for database nova_cell0 Oct 28 20:04:41.861343 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO dbcounter [None req-740f5281-b81a-4894-9711-fc244b4514da None None] Registered counter for database nova_cell1 Oct 28 20:04:41.869027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_db.sqlalchemy.engines [None req-740f5281-b81a-4894-9711-fc244b4514da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 20:04:41.871508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_db.sqlalchemy.engines [None req-740f5281-b81a-4894-9711-fc244b4514da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 20:04:41.879073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writer thread running {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 20:04:41.881217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writer thread running {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 20:04:41.959799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO dbcounter [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] Registered counter for database nova_cell0 Oct 28 20:04:41.967058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_db.sqlalchemy.engines [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 20:04:41.971936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writer thread running {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 20:04:42.029760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO dbcounter [None req-740f5281-b81a-4894-9711-fc244b4514da None None] Registered counter for database nova_cell0 Oct 28 20:04:42.035878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_db.sqlalchemy.engines [None req-740f5281-b81a-4894-9711-fc244b4514da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 20:04:42.040406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writer thread running {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 20:04:42.303793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: WARNING keystonemiddleware.auth_token [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 20:04:42.312035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: WARNING keystonemiddleware.auth_token [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 20:04:42.362771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: WARNING keystonemiddleware.auth_token [None req-740f5281-b81a-4894-9711-fc244b4514da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 20:04:42.370105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: WARNING keystonemiddleware.auth_token [None req-740f5281-b81a-4894-9711-fc244b4514da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 20:04:42.659835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: WARNING keystonemiddleware.auth_token [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 20:04:42.665815 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: WARNING keystonemiddleware.auth_token [None req-099681f5-13f5-4868-bdc9-38350b29805d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 20:04:42.672233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555c344d99c0 pid: 119407 (default app) Oct 28 20:04:42.717477 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: WARNING keystonemiddleware.auth_token [None req-740f5281-b81a-4894-9711-fc244b4514da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 20:04:42.723506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: WARNING keystonemiddleware.auth_token [None req-740f5281-b81a-4894-9711-fc244b4514da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 20:04:42.728799 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555c344d99c0 pid: 119406 (default app) Oct 28 20:05:20.212178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:20.213625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:20.217988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:20.217988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:21.019991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d83ddf09-ef34-41f8-9bfc-1412ac59ed68 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Action: 'create', calling method: .version_select at 0x7f1f4df31940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1410841017"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:23.713280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d83ddf09-ef34-41f8-9bfc-1412ac59ed68 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.515512 Oct 28 20:05:23.714624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1/1] 10.222.0.66 () {60 vars in 1155 bytes} [Fri Oct 28 20:05:20 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3519 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 20:05:23.733617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:23.735186 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:23.736378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:23.738015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:24.143937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5114d8a0-78ee-4f16-8ad5-2e8c23d02d48 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Calling method '.version_select at 0x7f1f4df0bb80>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:24.620856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5114d8a0-78ee-4f16-8ad5-2e8c23d02d48 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/78df1afb-7b34-44b1-9782-341c7e7a0e29" status: 200 len: 346 microversion: 2.1 time: 0.893479 Oct 28 20:05:24.621997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1/2] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Oct 28 20:05:23 2022] GET /compute/v2.1/os-volumes/78df1afb-7b34-44b1-9782-341c7e7a0e29 => generated 346 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:24.640466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-90fe88a4-6793-49a7-850c-24cc75bec04b tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Action: 'create', calling method: .version_select at 0x7f1f4dd9bd30>, body: {"snapshot": {"volume_id": "78df1afb-7b34-44b1-9782-341c7e7a0e29", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-696534642"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:25.227509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-90fe88a4-6793-49a7-850c-24cc75bec04b tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.591904 Oct 28 20:05:25.228111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2/3] 10.222.0.66 () {60 vars in 1162 bytes} [Fri Oct 28 20:05:24 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:25.240884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8ca26dd7-3406-430c-9f8f-cd982161e637 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Calling method '.version_select at 0x7f1f4ddd4f70>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:25.307594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8ca26dd7-3406-430c-9f8f-cd982161e637 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5" status: 200 len: 286 microversion: 2.1 time: 0.071359 Oct 28 20:05:25.309188 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2/4] 10.222.0.66 () {58 vars in 1251 bytes} [Fri Oct 28 20:05:25 2022] GET /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:25.327165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d37d5a63-4dea-40ea-9ed1-758a504f2e34 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Calling method '.version_select at 0x7f1f4dd2eca0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:25.412089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d37d5a63-4dea-40ea-9ed1-758a504f2e34 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.094887 Oct 28 20:05:25.413102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3/5] 10.222.0.66 () {58 vars in 1140 bytes} [Fri Oct 28 20:05:25 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:25.425867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-59b781f7-1e46-4930-aa61-d684d97a225d tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Calling method '.version_select at 0x7f1f4dd93430>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:25.729890 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-59b781f7-1e46-4930-aa61-d684d97a225d tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5" status: 200 len: 286 microversion: 2.1 time: 0.309253 Oct 28 20:05:25.731364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3/6] 10.222.0.66 () {58 vars in 1251 bytes} [Fri Oct 28 20:05:25 2022] GET /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5 => generated 286 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:26.743680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-971a8c71-8108-419c-b756-ac7b152c2fde tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Calling method '.version_select at 0x7f1f4dd37040>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:26.781072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-971a8c71-8108-419c-b756-ac7b152c2fde tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5" status: 200 len: 286 microversion: 2.1 time: 0.041055 Oct 28 20:05:26.782365 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 4/7] 10.222.0.66 () {58 vars in 1251 bytes} [Fri Oct 28 20:05:26 2022] GET /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:27.810792 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32be7b97-a69d-4eed-b946-d858bbd9a69c tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Calling method '.version_select at 0x7f1f4ddd4f70>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:27.879401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-32be7b97-a69d-4eed-b946-d858bbd9a69c tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5" status: 200 len: 286 microversion: 2.1 time: 0.085244 Oct 28 20:05:27.881507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 4/8] 10.222.0.66 () {58 vars in 1251 bytes} [Fri Oct 28 20:05:27 2022] GET /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5 => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:28.894424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b58d91ba-5226-4a2e-af04-957bdf027312 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Calling method '.version_select at 0x7f1f4dd32c10>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:28.969087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b58d91ba-5226-4a2e-af04-957bdf027312 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5" status: 200 len: 287 microversion: 2.1 time: 0.078997 Oct 28 20:05:28.970432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 5/9] 10.222.0.66 () {58 vars in 1251 bytes} [Fri Oct 28 20:05:28 2022] GET /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:28.988466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4a78c874-6145-4cec-912a-c6eff5555283 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Calling method '.version_select at 0x7f1f4dd93700>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:29.240132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4a78c874-6145-4cec-912a-c6eff5555283 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5" status: 202 len: 0 microversion: 2.1 time: 0.262308 Oct 28 20:05:29.241874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 5/10] 10.222.0.66 () {58 vars in 1254 bytes} [Fri Oct 28 20:05:28 2022] DELETE /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:05:29.257184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5158d31e-9717-460b-ba27-610f56b90a2f tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Calling method '.version_select at 0x7f1f4dd32550>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:29.336049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5158d31e-9717-460b-ba27-610f56b90a2f tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5" status: 200 len: 286 microversion: 2.1 time: 0.089967 Oct 28 20:05:29.337526 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 6/11] 10.222.0.66 () {58 vars in 1251 bytes} [Fri Oct 28 20:05:29 2022] GET /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5 => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:30.350506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03474e53-4b8d-4f79-9199-470303065cf0 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Calling method '.version_select at 0x7f1f4dd93c10>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:30.396471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-03474e53-4b8d-4f79-9199-470303065cf0 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] HTTP exception thrown: Snapshot a1a2b3f5-e291-4d79-9a56-13e7218e37e5 could not be found. Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03474e53-4b8d-4f79-9199-470303065cf0 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Request method failure captured: Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: GET /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5 HTTP/1.1 Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDYALUeUDy6qM_O3Ty155kt1JtJhvuFK93IKebODkX7rJRw4qa2fWRchSNp7uaoVK_5d6O6NN95ZCWTTa4agFxJiZPzDxfYkIf3CiBKeqHt33iykhWqiNT5l1YSs-qXMcveBeQkGOVV5fD5v_FD4rHKdFvpUcwsC4NX7BgIDMD1QSls Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: f6c2f7094bcf43c49ea03ea775595f51 Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-725730136 Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:05:30.405545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:05:30.407165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f6c2f7094bcf43c49ea03ea775595f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f6c2f7094bcf43c49ea03ea775595f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f6c2f7094bcf43c49ea03ea775595f51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f6c2f7094bcf43c49ea03ea775595f51", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:05:30.407165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-VolumesSnapshotsTestJSON-725730136 Oct 28 20:05:30.407165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: f6c2f7094bcf43c49ea03ea775595f51 Oct 28 20:05:30.407165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-725730136 Oct 28 20:05:30.407165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-VolumesSnapshotsTestJSON-725730136-project Oct 28 20:05:30.407165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:05:30.407165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:05:30.407165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: f9eaff8ed7204e6e8fddbd983f1d20ee Oct 28 20:05:30.407165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-VolumesSnapshotsTestJSON-725730136-project Oct 28 20:05:30.407165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: Oct 28 20:05:30.407165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Snapshot a1a2b3f5-e291-4d79-9a56-13e7218e37e5 could not be found. Oct 28 20:05:30.407165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': 'a1a2b3f5-e291-4d79-9a56-13e7218e37e5'} Oct 28 20:05:30.407165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a1a2b3f5-e291-4d79-9a56-13e7218e37e5 could not be found. (HTTP 404) (Request-ID: req-9e33e525-4f69-4f39-8c20-67bf1e29bf14) Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:05:30.408031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 20:05:30.409298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a1a2b3f5-e291-4d79-9a56-13e7218e37e5 could not be found. Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 28 20:05:30.410522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:05:30.411765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a1a2b3f5-e291-4d79-9a56-13e7218e37e5 could not be found. Oct 28 20:05:30.411765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:05:30.411765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:05:30.411765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:05:30.411765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:05:30.411765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:05:30.411765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:05:30.411765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:05:30.411765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:05:30.411765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a1a2b3f5-e291-4d79-9a56-13e7218e37e5 could not be found. Oct 28 20:05:30.411765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:05:30.411765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03474e53-4b8d-4f79-9199-470303065cf0 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Returning 404 to user: Snapshot a1a2b3f5-e291-4d79-9a56-13e7218e37e5 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:05:30.411765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-03474e53-4b8d-4f79-9199-470303065cf0 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5" status: 404 len: 111 microversion: 2.1 time: 0.062987 Oct 28 20:05:30.411765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 6/12] 10.222.0.66 () {58 vars in 1251 bytes} [Fri Oct 28 20:05:30 2022] GET /compute/v2.1/os-snapshots/a1a2b3f5-e291-4d79-9a56-13e7218e37e5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:05:30.420661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d204a919-c7db-455b-82d0-797501aa4e9b tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Calling method '.version_select at 0x7f1f4dd2ee50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:30.702738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d204a919-c7db-455b-82d0-797501aa4e9b tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/78df1afb-7b34-44b1-9782-341c7e7a0e29" status: 202 len: 0 microversion: 2.1 time: 0.287930 Oct 28 20:05:30.704265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 7/13] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Oct 28 20:05:30 2022] DELETE /compute/v2.1/os-volumes/78df1afb-7b34-44b1-9782-341c7e7a0e29 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:05:30.713055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cd84194d-ddcd-414e-be45-bcb934ad070d tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Calling method '.version_select at 0x7f1f4dd20670>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:30.822876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cd84194d-ddcd-414e-be45-bcb934ad070d tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/78df1afb-7b34-44b1-9782-341c7e7a0e29" status: 200 len: 345 microversion: 2.1 time: 0.114437 Oct 28 20:05:30.823911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 7/14] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Oct 28 20:05:30 2022] GET /compute/v2.1/os-volumes/78df1afb-7b34-44b1-9782-341c7e7a0e29 => generated 345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:31.841267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-486262a4-60e5-47ab-a938-ddf6abef03c5 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Calling method '.version_select at 0x7f1f4dd321f0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:31.914788 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-486262a4-60e5-47ab-a938-ddf6abef03c5 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] HTTP exception thrown: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-486262a4-60e5-47ab-a938-ddf6abef03c5 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Request method failure captured: Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/os-volumes/78df1afb-7b34-44b1-9782-341c7e7a0e29 HTTP/1.1 Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYALUeUDy6qM_O3Ty155kt1JtJhvuFK93IKebODkX7rJRw4qa2fWRchSNp7uaoVK_5d6O6NN95ZCWTTa4agFxJiZPzDxfYkIf3CiBKeqHt33iykhWqiNT5l1YSs-qXMcveBeQkGOVV5fD5v_FD4rHKdFvpUcwsC4NX7BgIDMD1QSls Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: f6c2f7094bcf43c49ea03ea775595f51 Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-725730136 Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:05:31.921742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:05:31.923674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f6c2f7094bcf43c49ea03ea775595f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f6c2f7094bcf43c49ea03ea775595f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f6c2f7094bcf43c49ea03ea775595f51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f6c2f7094bcf43c49ea03ea775595f51", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:05:31.923674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-VolumesSnapshotsTestJSON-725730136 Oct 28 20:05:31.923674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: f6c2f7094bcf43c49ea03ea775595f51 Oct 28 20:05:31.923674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-725730136 Oct 28 20:05:31.923674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-VolumesSnapshotsTestJSON-725730136-project Oct 28 20:05:31.923674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:05:31.923674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:05:31.923674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: f9eaff8ed7204e6e8fddbd983f1d20ee Oct 28 20:05:31.923674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-VolumesSnapshotsTestJSON-725730136-project Oct 28 20:05:31.923674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: Oct 28 20:05:31.923674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. Oct 28 20:05:31.923674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': '78df1afb-7b34-44b1-9782-341c7e7a0e29'} Oct 28 20:05:31.923674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. (HTTP 404) (Request-ID: req-b498b729-8f20-49d9-b579-4d33de3a7434) Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:05:31.924505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 20:05:31.928937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 20:05:31.930204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:05:31.931738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. Oct 28 20:05:31.931738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:05:31.931738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:05:31.931738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:05:31.931738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:05:31.931738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:05:31.931738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:05:31.931738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:05:31.931738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:05:31.931738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. Oct 28 20:05:31.931738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:05:31.933257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-486262a4-60e5-47ab-a938-ddf6abef03c5 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Returning 404 to user: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:05:31.936296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-486262a4-60e5-47ab-a938-ddf6abef03c5 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/78df1afb-7b34-44b1-9782-341c7e7a0e29" status: 404 len: 109 microversion: 2.1 time: 0.100259 Oct 28 20:05:31.958920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 8/15] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Oct 28 20:05:31 2022] GET /compute/v2.1/os-volumes/78df1afb-7b34-44b1-9782-341c7e7a0e29 => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:05:31.960630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f1df6796-cbba-4dd4-8543-504f79ced064 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Calling method '.version_select at 0x7f1f4dd20d30>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:32.021440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-f1df6796-cbba-4dd4-8543-504f79ced064 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] HTTP exception thrown: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f1df6796-cbba-4dd4-8543-504f79ced064 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Request method failure captured: Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-volumes/78df1afb-7b34-44b1-9782-341c7e7a0e29 HTTP/1.1 Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDYALUeUDy6qM_O3Ty155kt1JtJhvuFK93IKebODkX7rJRw4qa2fWRchSNp7uaoVK_5d6O6NN95ZCWTTa4agFxJiZPzDxfYkIf3CiBKeqHt33iykhWqiNT5l1YSs-qXMcveBeQkGOVV5fD5v_FD4rHKdFvpUcwsC4NX7BgIDMD1QSls Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: f6c2f7094bcf43c49ea03ea775595f51 Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-725730136 Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:05:32.029243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:05:32.030903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f6c2f7094bcf43c49ea03ea775595f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f6c2f7094bcf43c49ea03ea775595f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f6c2f7094bcf43c49ea03ea775595f51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f6c2f7094bcf43c49ea03ea775595f51", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:05:32.030903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-VolumesSnapshotsTestJSON-725730136 Oct 28 20:05:32.030903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: f6c2f7094bcf43c49ea03ea775595f51 Oct 28 20:05:32.030903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-725730136 Oct 28 20:05:32.030903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-VolumesSnapshotsTestJSON-725730136-project Oct 28 20:05:32.030903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:05:32.030903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:05:32.030903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: f9eaff8ed7204e6e8fddbd983f1d20ee Oct 28 20:05:32.030903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-VolumesSnapshotsTestJSON-725730136-project Oct 28 20:05:32.030903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: Oct 28 20:05:32.030903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. Oct 28 20:05:32.030903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': '78df1afb-7b34-44b1-9782-341c7e7a0e29'} Oct 28 20:05:32.030903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. (HTTP 404) (Request-ID: req-b827b91e-b88a-4262-9a89-04f65a923c2a) Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:05:32.031836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 20:05:32.034191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 20:05:32.035470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:05:32.036969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. Oct 28 20:05:32.036969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:05:32.036969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:05:32.036969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:05:32.036969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:05:32.036969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:05:32.036969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:05:32.036969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:05:32.036969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:05:32.036969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. Oct 28 20:05:32.036969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:05:32.036969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f1df6796-cbba-4dd4-8543-504f79ced064 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Returning 404 to user: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:05:32.036969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f1df6796-cbba-4dd4-8543-504f79ced064 tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/78df1afb-7b34-44b1-9782-341c7e7a0e29" status: 404 len: 109 microversion: 2.1 time: 0.080178 Oct 28 20:05:32.039011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 8/16] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Oct 28 20:05:31 2022] DELETE /compute/v2.1/os-volumes/78df1afb-7b34-44b1-9782-341c7e7a0e29 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:05:32.042876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a95b6c0d-6b0f-4b5a-9aeb-356881d5675b tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Calling method '.version_select at 0x7f1f4e71a550>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-a95b6c0d-6b0f-4b5a-9aeb-356881d5675b tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] HTTP exception thrown: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a95b6c0d-6b0f-4b5a-9aeb-356881d5675b tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Request method failure captured: Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/os-volumes/78df1afb-7b34-44b1-9782-341c7e7a0e29 HTTP/1.1 Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYALUeUDy6qM_O3Ty155kt1JtJhvuFK93IKebODkX7rJRw4qa2fWRchSNp7uaoVK_5d6O6NN95ZCWTTa4agFxJiZPzDxfYkIf3CiBKeqHt33iykhWqiNT5l1YSs-qXMcveBeQkGOVV5fD5v_FD4rHKdFvpUcwsC4NX7BgIDMD1QSls Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: f6c2f7094bcf43c49ea03ea775595f51 Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-725730136 Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:05:32.102509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:05:32.104506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f6c2f7094bcf43c49ea03ea775595f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f6c2f7094bcf43c49ea03ea775595f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f6c2f7094bcf43c49ea03ea775595f51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f6c2f7094bcf43c49ea03ea775595f51", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:05:32.104506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-VolumesSnapshotsTestJSON-725730136 Oct 28 20:05:32.104506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: f6c2f7094bcf43c49ea03ea775595f51 Oct 28 20:05:32.104506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-725730136 Oct 28 20:05:32.104506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-VolumesSnapshotsTestJSON-725730136-project Oct 28 20:05:32.104506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:05:32.104506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:05:32.104506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: f9eaff8ed7204e6e8fddbd983f1d20ee Oct 28 20:05:32.104506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-VolumesSnapshotsTestJSON-725730136-project Oct 28 20:05:32.104506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: Oct 28 20:05:32.104506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. Oct 28 20:05:32.104506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': '78df1afb-7b34-44b1-9782-341c7e7a0e29'} Oct 28 20:05:32.104506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. (HTTP 404) (Request-ID: req-3f0d28cb-5413-4963-ae9f-24e282aa6a07) Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:05:32.105445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 20:05:32.106831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 20:05:32.108778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:05:32.110143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. Oct 28 20:05:32.110143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:05:32.110143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:05:32.110143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:05:32.110143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:05:32.110143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:05:32.110143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:05:32.110143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:05:32.110143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:05:32.110143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. Oct 28 20:05:32.110143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:05:32.110143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a95b6c0d-6b0f-4b5a-9aeb-356881d5675b tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] Returning 404 to user: Volume 78df1afb-7b34-44b1-9782-341c7e7a0e29 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:05:32.110143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a95b6c0d-6b0f-4b5a-9aeb-356881d5675b tempest-VolumesSnapshotsTestJSON-725730136 tempest-VolumesSnapshotsTestJSON-725730136-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/78df1afb-7b34-44b1-9782-341c7e7a0e29" status: 404 len: 109 microversion: 2.1 time: 0.060465 Oct 28 20:05:32.110143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 9/17] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Oct 28 20:05:32 2022] GET /compute/v2.1/os-volumes/78df1afb-7b34-44b1-9782-341c7e7a0e29 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:05:33.327462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34551599-dc37-4858-a882-b2f02769019a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Action: 'create', calling method: .version_select at 0x7f1f4dd20550>, body: {"keypair": {"name": "tempest-keypair-1337679790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+gxdFQtN0q8grwKnylXc3ga3hYxSZTq4sDYSfAoQ7pwfXJNk0iKGK5Xf7Jj9xq+xJQ/r5CdOjsn8bENRseGJIeTaTEj2eAAHAntx39lq8HSfjXbcKSQ9J0n46gQMydDg=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:33.384810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-34551599-dc37-4858-a882-b2f02769019a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Getting quotas for project 940ce72c42534c5196dfb909cc2a8d54. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:05:33.397685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-34551599-dc37-4858-a882-b2f02769019a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Getting quotas for user 724baaa4aa834e609fe4f513f9fc0b4b and project 940ce72c42534c5196dfb909cc2a8d54. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:05:33.529356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34551599-dc37-4858-a882-b2f02769019a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.467080 Oct 28 20:05:33.529356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 9/18] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Oct 28 20:05:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:38.054320 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7794bd64-6d92-4673-9e79-c3e3389d7eab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Action: 'create', calling method: .version_select at 0x7f1f4dd37940>, body: {"keypair": {"name": "tempest-keypair-1479577245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKR5rj3qYkmLXuVWC63bhvqHCqCOWExu/5fvo2IahPOqUHaUlrhxwi9BKF50FFNsiaOeXNPMAfNya4x4o7tW/BFjqGK7dgi9Fn8EJx8cPNy8aHVukCzyrm9hVhRfrfsAyQ=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:38.193276 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-7794bd64-6d92-4673-9e79-c3e3389d7eab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Getting quotas for project 8b163bdfc7544a3d833bd69dc027c7d6. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:05:38.204599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-7794bd64-6d92-4673-9e79-c3e3389d7eab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Getting quotas for user 15db5106efbd434f99a4d102810cc7a6 and project 8b163bdfc7544a3d833bd69dc027c7d6. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:05:38.431094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7794bd64-6d92-4673-9e79-c3e3389d7eab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.392808 Oct 28 20:05:38.438020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 10/19] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Oct 28 20:05:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:40.864650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8a28edb5-0acd-4224-9147-8148fd7a03ff tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Action: 'create', calling method: .version_select at 0x7f1f4dc71e50>, body: {"keypair": {"name": "tempest-keypair-1218580343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9Kuo7yKMT1NF8tlFTNJjPGjWkmyJyhcB2mztfJ7wmtRmh6m/TOtPhNpFtRABKrTFU4j2uWBFzUS+fw1HoHprOzXT0lr9k1c6V/GOnSjSy8tpM4nPuAhSpONyhHDlqIbg=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:40.904577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-8a28edb5-0acd-4224-9147-8148fd7a03ff tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Getting quotas for project 34d30fbe6fa645bd9ea3d88ea5f68449. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:05:40.917831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-8a28edb5-0acd-4224-9147-8148fd7a03ff tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Getting quotas for user e0ba6bf2459d4a98a3a1f5684bdad2b2 and project 34d30fbe6fa645bd9ea3d88ea5f68449. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:05:41.136757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8a28edb5-0acd-4224-9147-8148fd7a03ff tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.536055 Oct 28 20:05:41.138579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 10/20] 10.222.0.66 () {62 vars in 1200 bytes} [Fri Oct 28 20:05:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 538 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 20:05:42.272920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1771750265", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:42.411636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-600439493", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9279e057-17ab-422f-8ee0-b121068c9ee3"}], "security_groups": [{"name": "tempest-securitygroup--275667411"}], "key_name": "tempest-keypair-1337679790", "user_data": "}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:42.439593 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] validate_networks() for [('c983a099-9298-4ad4-a46a-5c42259ab55a', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:05:43.273410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] validate_networks() for [('9279e057-17ab-422f-8ee0-b121068c9ee3', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:05:44.845418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:05:44.845872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:05:44.846618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:05:44.847100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:05:44.847627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:05:44.861243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:44.861848 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:44.862474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:44.863206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:44.863666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:44.864095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:44.891278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Getting quotas for project ab907bf956554681beae45b8973db6e5. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:05:44.895833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Getting quotas for user ce7f52b7f96c400fb7d5fb0453c94362 and project ab907bf956554681beae45b8973db6e5. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:05:44.934271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:05:44.938198 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:05:45.112895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-51716203-482d-4ce2-b51b-8f158e388078 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.295764 Oct 28 20:05:45.114353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 11/21] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:05:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 3299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:05:45.643954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-780034369", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452", "networks": [{"uuid": "449708fc-544e-4d0e-977d-a46cd8dc9297"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:45.742895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] validate_networks() for [('449708fc-544e-4d0e-977d-a46cd8dc9297', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:05:46.100566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:05:46.101773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:05:46.102652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:05:46.103517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:05:46.104106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:05:46.119912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:46.120693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:46.125147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:46.126206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:46.126875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:46.127527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:46.156796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Getting quotas for project 940ce72c42534c5196dfb909cc2a8d54. Resources: {'instances', 'ram', 'cores'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:05:46.161839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Getting quotas for user 724baaa4aa834e609fe4f513f9fc0b4b and project 940ce72c42534c5196dfb909cc2a8d54. Resources: {'instances', 'ram', 'cores'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:05:46.174570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:05:46.177397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:05:46.359081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-39d85dd6-3677-478a-8a7d-fbefe53f5ba4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.949717 Oct 28 20:05:46.360277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 11/22] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:05:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 3954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:05:46.367661 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4ed0cf9c-65c4-40e5-becf-09156a941e60 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:46.369018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4ed0cf9c-65c4-40e5-becf-09156a941e60 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:46.621835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4ed0cf9c-65c4-40e5-becf-09156a941e60 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:46.665613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4ed0cf9c-65c4-40e5-becf-09156a941e60 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1222 microversion: 2.1 time: 0.303535 Oct 28 20:05:46.697102 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 12/23] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:46 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1222 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:46.718711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-279630069", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6255763f-9ff1-4793-9cc5-629a698a3207"}], "security_groups": [{"name": "tempest-securitygroup--734520267"}], "key_name": "tempest-keypair-1479577245", "user_data": "}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:46.822948 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:05:46.823474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:05:46.824149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:05:46.830950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:05:46.833431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:05:46.870150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:46.870645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:46.871086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:46.871821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:46.872435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:46.873175 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:46.954488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Getting quotas for project 40fa4f575da04bc39b8df1e74fb77035. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:05:46.967759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Getting quotas for user 1b3396bc67ae4f6c9c8808653fef4676 and project 40fa4f575da04bc39b8df1e74fb77035. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:05:47.023314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:05:47.026302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:05:47.249491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee0ab208-63db-4834-963a-0a94678e2089 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.133857 Oct 28 20:05:47.250623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 12/24] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:05:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:05:47.256545 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-056b9a2d-73ad-4fd3-971f-64fedb311ac7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:47.257510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-056b9a2d-73ad-4fd3-971f-64fedb311ac7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:47.261490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] validate_networks() for [('6255763f-9ff1-4793-9cc5-629a698a3207', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:05:47.466951 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-056b9a2d-73ad-4fd3-971f-64fedb311ac7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:47.526028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-056b9a2d-73ad-4fd3-971f-64fedb311ac7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1241 microversion: 2.1 time: 0.271614 Oct 28 20:05:47.526962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 13/25] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:47 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1241 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:47.561158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1727092150", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:47.668255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] validate_networks() for [('c983a099-9298-4ad4-a46a-5c42259ab55a', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:05:48.651635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:05:48.652116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:05:48.652537 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:05:48.659833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:05:48.659833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:05:48.684270 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:48.684703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:48.688814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:48.690931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:48.691417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:48.695098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:48.759370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Getting quotas for project 8b163bdfc7544a3d833bd69dc027c7d6. Resources: {'instances', 'ram', 'cores'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:05:48.768401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Getting quotas for user 15db5106efbd434f99a4d102810cc7a6 and project 8b163bdfc7544a3d833bd69dc027c7d6. Resources: {'instances', 'ram', 'cores'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:05:48.791137 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:05:48.795789 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:05:49.067608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f5496e8e-d20f-45dc-a275-79fb94bba985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.364470 Oct 28 20:05:49.069751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 13/26] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:05:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 2372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:05:49.079388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-acdad778-0876-409e-87b2-e202466eb51c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:49.089883 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-acdad778-0876-409e-87b2-e202466eb51c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:49.096231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:05:49.097298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:05:49.097954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:05:49.098555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:05:49.099142 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:05:49.103054 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acdad778-0876-409e-87b2-e202466eb51c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:49.103669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acdad778-0876-409e-87b2-e202466eb51c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:49.105200 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acdad778-0876-409e-87b2-e202466eb51c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:49.107536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acdad778-0876-409e-87b2-e202466eb51c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:49.112544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acdad778-0876-409e-87b2-e202466eb51c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:49.113161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acdad778-0876-409e-87b2-e202466eb51c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:49.115373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:49.116405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:49.117474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:49.119883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:49.120530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:49.124606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:49.170732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Getting quotas for project ab907bf956554681beae45b8973db6e5. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:05:49.178927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Getting quotas for user ce7f52b7f96c400fb7d5fb0453c94362 and project ab907bf956554681beae45b8973db6e5. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:05:49.207845 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:05:49.210884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:05:49.447363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-838812db-1576-41be-b54a-c32d06aa2e0c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.914611 Oct 28 20:05:49.448451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 14/27] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:05:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:05:49.463906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b908318d-7e81-4b7b-82c5-90d2fd3c59aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:49.464398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b908318d-7e81-4b7b-82c5-90d2fd3c59aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:49.493791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b908318d-7e81-4b7b-82c5-90d2fd3c59aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:49.497819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b908318d-7e81-4b7b-82c5-90d2fd3c59aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:49.497819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b908318d-7e81-4b7b-82c5-90d2fd3c59aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:49.497819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b908318d-7e81-4b7b-82c5-90d2fd3c59aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:49.497819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b908318d-7e81-4b7b-82c5-90d2fd3c59aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:49.498156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b908318d-7e81-4b7b-82c5-90d2fd3c59aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:49.652380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-acdad778-0876-409e-87b2-e202466eb51c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:49.677656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-acdad778-0876-409e-87b2-e202466eb51c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1218 microversion: 2.1 time: 0.604881 Oct 28 20:05:49.696933 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 14/28] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:49 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1218 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:49.726894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-33c134d0-1988-4f64-8d01-94be041354a3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:49.733968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-33c134d0-1988-4f64-8d01-94be041354a3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:49.851239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b908318d-7e81-4b7b-82c5-90d2fd3c59aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:49.883912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b908318d-7e81-4b7b-82c5-90d2fd3c59aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1245 microversion: 2.1 time: 0.434226 Oct 28 20:05:49.884489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 15/29] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:49 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1245 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:49.943869 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e31f6e60-62d9-4181-979c-c271bc0bf776 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:49.954801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e31f6e60-62d9-4181-979c-c271bc0bf776 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:50.052935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-33c134d0-1988-4f64-8d01-94be041354a3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:50.072385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-33c134d0-1988-4f64-8d01-94be041354a3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1237 microversion: 2.1 time: 0.372988 Oct 28 20:05:50.073936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 15/30] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:49 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1237 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:50.081614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1365034189", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "176b1458-53d0-433d-a820-0c0b0e4c8472"}], "security_groups": [{"name": "tempest-securitygroup--2134875011"}], "key_name": "tempest-keypair-1218580343", "user_data": "}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:50.146112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e31f6e60-62d9-4181-979c-c271bc0bf776 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:50.156039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e31f6e60-62d9-4181-979c-c271bc0bf776 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1222 microversion: 2.1 time: 0.228537 Oct 28 20:05:50.156934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 16/31] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:49 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1222 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:50.336979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] validate_networks() for [('176b1458-53d0-433d-a820-0c0b0e4c8472', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:05:50.707939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5d1828a2-53f3-4654-b64d-e0820e6edc23 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:50.708690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5d1828a2-53f3-4654-b64d-e0820e6edc23 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:50.719168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d1828a2-53f3-4654-b64d-e0820e6edc23 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:50.719668 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d1828a2-53f3-4654-b64d-e0820e6edc23 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:50.721305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d1828a2-53f3-4654-b64d-e0820e6edc23 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:50.726515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d1828a2-53f3-4654-b64d-e0820e6edc23 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:50.727936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d1828a2-53f3-4654-b64d-e0820e6edc23 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:50.728415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d1828a2-53f3-4654-b64d-e0820e6edc23 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:51.055271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5d1828a2-53f3-4654-b64d-e0820e6edc23 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:51.064823 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5d1828a2-53f3-4654-b64d-e0820e6edc23 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1266 microversion: 2.1 time: 0.362730 Oct 28 20:05:51.070306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 17/32] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:50 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1266 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:05:51.088515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-37fc8ddf-2d3c-4e56-af95-f457bed72394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:51.094268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-37fc8ddf-2d3c-4e56-af95-f457bed72394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:51.106058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37fc8ddf-2d3c-4e56-af95-f457bed72394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:51.110855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37fc8ddf-2d3c-4e56-af95-f457bed72394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:51.114019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37fc8ddf-2d3c-4e56-af95-f457bed72394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:51.114869 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37fc8ddf-2d3c-4e56-af95-f457bed72394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:51.116792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37fc8ddf-2d3c-4e56-af95-f457bed72394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:51.119318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37fc8ddf-2d3c-4e56-af95-f457bed72394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:51.351476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-37fc8ddf-2d3c-4e56-af95-f457bed72394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:51.364920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-37fc8ddf-2d3c-4e56-af95-f457bed72394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1237 microversion: 2.1 time: 0.291158 Oct 28 20:05:51.367098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 18/33] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:51 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1237 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:51.374054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cdfc4ee3-23ad-4dba-b3e5-62afb74077c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:51.374965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cdfc4ee3-23ad-4dba-b3e5-62afb74077c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:51.403535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdfc4ee3-23ad-4dba-b3e5-62afb74077c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:51.405953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdfc4ee3-23ad-4dba-b3e5-62afb74077c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:51.407383 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdfc4ee3-23ad-4dba-b3e5-62afb74077c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:51.416705 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdfc4ee3-23ad-4dba-b3e5-62afb74077c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:51.422513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdfc4ee3-23ad-4dba-b3e5-62afb74077c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:51.426796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdfc4ee3-23ad-4dba-b3e5-62afb74077c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:51.584972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:05:51.586042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:05:51.586679 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:05:51.587248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:05:51.587936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:05:51.611125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:51.611918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:51.612549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:51.613510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:51.621528 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:51.622275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:51.666613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Getting quotas for project 34d30fbe6fa645bd9ea3d88ea5f68449. Resources: {'instances', 'ram', 'cores'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:05:51.674733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Getting quotas for user e0ba6bf2459d4a98a3a1f5684bdad2b2 and project 34d30fbe6fa645bd9ea3d88ea5f68449. Resources: {'instances', 'ram', 'cores'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:05:51.690926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cdfc4ee3-23ad-4dba-b3e5-62afb74077c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:51.703334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:05:51.716935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:05:51.717132 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cdfc4ee3-23ad-4dba-b3e5-62afb74077c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1241 microversion: 2.1 time: 0.346088 Oct 28 20:05:51.717826 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 19/34] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:51 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1241 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:51.751812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2bd50dd0-6c9b-4d58-9725-05df3fc9b2af tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:51.758153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2bd50dd0-6c9b-4d58-9725-05df3fc9b2af tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:51.779633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bd50dd0-6c9b-4d58-9725-05df3fc9b2af tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:51.786195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bd50dd0-6c9b-4d58-9725-05df3fc9b2af tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:51.788601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bd50dd0-6c9b-4d58-9725-05df3fc9b2af tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:51.793811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bd50dd0-6c9b-4d58-9725-05df3fc9b2af tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:51.795325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bd50dd0-6c9b-4d58-9725-05df3fc9b2af tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:51.796556 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bd50dd0-6c9b-4d58-9725-05df3fc9b2af tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:51.948323 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d55a0474-67ff-4fca-aa8c-0179644aa8a6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.871183 Oct 28 20:05:51.958056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 16/35] 10.222.0.66 () {62 vars in 1188 bytes} [Fri Oct 28 20:05:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1877 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 20:05:51.970990 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03c3c375-7cfe-4542-b7d0-738a2d0b276e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:51.972144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-03c3c375-7cfe-4542-b7d0-738a2d0b276e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:52.209990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2bd50dd0-6c9b-4d58-9725-05df3fc9b2af tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:52.225592 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2bd50dd0-6c9b-4d58-9725-05df3fc9b2af tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1218 microversion: 2.1 time: 0.491544 Oct 28 20:05:52.230589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 20/36] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:51 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1218 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:52.241079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9b409ad7-b258-4090-82ac-905c6cf55d9e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:52.241747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9b409ad7-b258-4090-82ac-905c6cf55d9e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:52.249030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b409ad7-b258-4090-82ac-905c6cf55d9e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:52.250182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b409ad7-b258-4090-82ac-905c6cf55d9e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:52.250826 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b409ad7-b258-4090-82ac-905c6cf55d9e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:52.251777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b409ad7-b258-4090-82ac-905c6cf55d9e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:52.252385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b409ad7-b258-4090-82ac-905c6cf55d9e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:52.252964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b409ad7-b258-4090-82ac-905c6cf55d9e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:52.289047 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-03c3c375-7cfe-4542-b7d0-738a2d0b276e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:52.334488 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-03c3c375-7cfe-4542-b7d0-738a2d0b276e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:52.339938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-03c3c375-7cfe-4542-b7d0-738a2d0b276e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:52.343738 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-03c3c375-7cfe-4542-b7d0-738a2d0b276e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1282 microversion: 2.20 time: 0.379812 Oct 28 20:05:52.368175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 17/37] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:05:51 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1282 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:05:52.400505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e57c26c-8b3b-41b3-b38e-5b2ce4f664b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:52.402184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4e57c26c-8b3b-41b3-b38e-5b2ce4f664b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:52.420806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e57c26c-8b3b-41b3-b38e-5b2ce4f664b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:52.423323 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e57c26c-8b3b-41b3-b38e-5b2ce4f664b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:52.424575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e57c26c-8b3b-41b3-b38e-5b2ce4f664b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:52.425492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e57c26c-8b3b-41b3-b38e-5b2ce4f664b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:52.428633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e57c26c-8b3b-41b3-b38e-5b2ce4f664b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:52.431018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e57c26c-8b3b-41b3-b38e-5b2ce4f664b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:52.937901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e57c26c-8b3b-41b3-b38e-5b2ce4f664b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:52.946093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4e57c26c-8b3b-41b3-b38e-5b2ce4f664b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1293 microversion: 2.1 time: 0.553881 Oct 28 20:05:52.947864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9b409ad7-b258-4090-82ac-905c6cf55d9e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:52.948976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 18/38] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:52 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1293 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:52.970521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d0946e91-0fa7-4439-bd3a-945f03f39d87 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:52.971271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d0946e91-0fa7-4439-bd3a-945f03f39d87 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:52.975783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9b409ad7-b258-4090-82ac-905c6cf55d9e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1284 microversion: 2.1 time: 0.739894 Oct 28 20:05:52.976906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 21/39] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:52 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1284 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:52.985130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0946e91-0fa7-4439-bd3a-945f03f39d87 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:52.985870 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0946e91-0fa7-4439-bd3a-945f03f39d87 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:52.986483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0946e91-0fa7-4439-bd3a-945f03f39d87 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:52.987368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0946e91-0fa7-4439-bd3a-945f03f39d87 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:52.988715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0946e91-0fa7-4439-bd3a-945f03f39d87 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:52.989355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0946e91-0fa7-4439-bd3a-945f03f39d87 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:53.204085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d0946e91-0fa7-4439-bd3a-945f03f39d87 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:53.213313 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d0946e91-0fa7-4439-bd3a-945f03f39d87 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1289 microversion: 2.1 time: 0.262847 Oct 28 20:05:53.219048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 19/40] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:52 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1289 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:53.252267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6cde0dd1-e92e-475f-992c-a4fbb57e5b31 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:53.252896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6cde0dd1-e92e-475f-992c-a4fbb57e5b31 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:53.261447 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cde0dd1-e92e-475f-992c-a4fbb57e5b31 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:53.261941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cde0dd1-e92e-475f-992c-a4fbb57e5b31 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:53.262381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cde0dd1-e92e-475f-992c-a4fbb57e5b31 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:53.269280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cde0dd1-e92e-475f-992c-a4fbb57e5b31 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:53.272696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cde0dd1-e92e-475f-992c-a4fbb57e5b31 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:53.273117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cde0dd1-e92e-475f-992c-a4fbb57e5b31 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:53.373608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-db7cabda-1f6b-4590-9b5f-65b5e39d5033 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:53.374233 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-db7cabda-1f6b-4590-9b5f-65b5e39d5033 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:53.394824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6cde0dd1-e92e-475f-992c-a4fbb57e5b31 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:53.398747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:53.407411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6cde0dd1-e92e-475f-992c-a4fbb57e5b31 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1218 microversion: 2.1 time: 0.158240 Oct 28 20:05:53.412946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 22/41] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:53 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1218 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:53.593300 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-db7cabda-1f6b-4590-9b5f-65b5e39d5033 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:53.605729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-db7cabda-1f6b-4590-9b5f-65b5e39d5033 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:53.614589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-db7cabda-1f6b-4590-9b5f-65b5e39d5033 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:53.621854 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-db7cabda-1f6b-4590-9b5f-65b5e39d5033 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1282 microversion: 2.20 time: 0.249548 Oct 28 20:05:53.625484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 20/42] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:05:53 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1282 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:05:53.972451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c759f41f-6f92-4543-8c95-991c47af5e0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:53.973799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c759f41f-6f92-4543-8c95-991c47af5e0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:53.980353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c759f41f-6f92-4543-8c95-991c47af5e0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:53.987443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c759f41f-6f92-4543-8c95-991c47af5e0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:53.989086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c759f41f-6f92-4543-8c95-991c47af5e0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:53.991786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c759f41f-6f92-4543-8c95-991c47af5e0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:53.992439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c759f41f-6f92-4543-8c95-991c47af5e0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:54.001297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ff9f3da0-420d-4d23-9877-1bda5aeba2d7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:54.006222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ff9f3da0-420d-4d23-9877-1bda5aeba2d7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:54.008998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c759f41f-6f92-4543-8c95-991c47af5e0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:54.036585 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff9f3da0-420d-4d23-9877-1bda5aeba2d7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:54.043555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff9f3da0-420d-4d23-9877-1bda5aeba2d7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:54.047474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff9f3da0-420d-4d23-9877-1bda5aeba2d7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:54.052719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff9f3da0-420d-4d23-9877-1bda5aeba2d7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:54.056476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff9f3da0-420d-4d23-9877-1bda5aeba2d7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:54.058596 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff9f3da0-420d-4d23-9877-1bda5aeba2d7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:54.804031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c759f41f-6f92-4543-8c95-991c47af5e0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:54.819283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c759f41f-6f92-4543-8c95-991c47af5e0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1299 microversion: 2.1 time: 0.844442 Oct 28 20:05:54.821635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 23/43] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:53 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1299 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:54.832488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8adc9715-0b81-4c70-9ac5-2b67017b5b7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:54.833096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8adc9715-0b81-4c70-9ac5-2b67017b5b7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:54.837968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ff9f3da0-420d-4d23-9877-1bda5aeba2d7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:55.042322 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ff9f3da0-420d-4d23-9877-1bda5aeba2d7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1272 microversion: 2.1 time: 0.852821 Oct 28 20:05:55.042322 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 21/44] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:53 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1272 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:05:55.044762 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8adc9715-0b81-4c70-9ac5-2b67017b5b7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:55.045578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2df24be6-0682-400a-ba6e-5c946aed6d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:55.046025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8adc9715-0b81-4c70-9ac5-2b67017b5b7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:55.046612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2df24be6-0682-400a-ba6e-5c946aed6d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:55.046859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8adc9715-0b81-4c70-9ac5-2b67017b5b7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:55.046859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8adc9715-0b81-4c70-9ac5-2b67017b5b7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:55.046859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8adc9715-0b81-4c70-9ac5-2b67017b5b7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:55.046859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8adc9715-0b81-4c70-9ac5-2b67017b5b7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:55.047160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df24be6-0682-400a-ba6e-5c946aed6d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:55.047160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df24be6-0682-400a-ba6e-5c946aed6d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:55.047160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df24be6-0682-400a-ba6e-5c946aed6d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:55.047160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df24be6-0682-400a-ba6e-5c946aed6d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:55.047454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df24be6-0682-400a-ba6e-5c946aed6d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:55.047454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df24be6-0682-400a-ba6e-5c946aed6d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:55.195569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2df24be6-0682-400a-ba6e-5c946aed6d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:55.195689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8adc9715-0b81-4c70-9ac5-2b67017b5b7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:55.195689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8adc9715-0b81-4c70-9ac5-2b67017b5b7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1295 microversion: 2.1 time: 0.327825 Oct 28 20:05:55.195689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 24/45] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:54 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1295 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:55.195689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-952969f3-0a23-4810-b5b6-7cc1069d51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:55.196042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-952969f3-0a23-4810-b5b6-7cc1069d51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:55.196112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2df24be6-0682-400a-ba6e-5c946aed6d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1274 microversion: 2.1 time: 0.311845 Oct 28 20:05:55.196112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 22/46] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:54 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1274 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:55.196241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-952969f3-0a23-4810-b5b6-7cc1069d51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:55.196241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-952969f3-0a23-4810-b5b6-7cc1069d51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:55.196241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-952969f3-0a23-4810-b5b6-7cc1069d51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:55.196241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-952969f3-0a23-4810-b5b6-7cc1069d51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:55.196478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-952969f3-0a23-4810-b5b6-7cc1069d51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:55.196478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-952969f3-0a23-4810-b5b6-7cc1069d51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:55.547810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-952969f3-0a23-4810-b5b6-7cc1069d51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:55.560819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-952969f3-0a23-4810-b5b6-7cc1069d51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:55.567555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-952969f3-0a23-4810-b5b6-7cc1069d51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:55.595892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-952969f3-0a23-4810-b5b6-7cc1069d51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1278 microversion: 2.20 time: 0.418082 Oct 28 20:05:55.595892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 25/47] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:05:55 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1278 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:05:55.942679 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bfed46ef-3de7-47fc-8f64-b52c3ae197f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:55.944746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bfed46ef-3de7-47fc-8f64-b52c3ae197f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:55.953264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2b4ec6a6-7945-41c8-9145-a5ed796fae01 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:55.954069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2b4ec6a6-7945-41c8-9145-a5ed796fae01 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:55.960620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b4ec6a6-7945-41c8-9145-a5ed796fae01 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:55.965550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b4ec6a6-7945-41c8-9145-a5ed796fae01 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:55.971899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b4ec6a6-7945-41c8-9145-a5ed796fae01 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:55.973723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b4ec6a6-7945-41c8-9145-a5ed796fae01 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:55.976322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b4ec6a6-7945-41c8-9145-a5ed796fae01 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:55.977108 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b4ec6a6-7945-41c8-9145-a5ed796fae01 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:55.981236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfed46ef-3de7-47fc-8f64-b52c3ae197f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:55.990873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfed46ef-3de7-47fc-8f64-b52c3ae197f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:55.991384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfed46ef-3de7-47fc-8f64-b52c3ae197f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:55.998438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfed46ef-3de7-47fc-8f64-b52c3ae197f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:56.005682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfed46ef-3de7-47fc-8f64-b52c3ae197f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:56.006155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfed46ef-3de7-47fc-8f64-b52c3ae197f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:56.364778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bfed46ef-3de7-47fc-8f64-b52c3ae197f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:56.375746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bfed46ef-3de7-47fc-8f64-b52c3ae197f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1299 microversion: 2.1 time: 0.446276 Oct 28 20:05:56.396361 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 23/48] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:55 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1299 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:56.406538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f6eeb84-7903-488b-b16a-e9c5deef0e67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:56.408752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0f6eeb84-7903-488b-b16a-e9c5deef0e67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:56.421275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f6eeb84-7903-488b-b16a-e9c5deef0e67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:56.422382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f6eeb84-7903-488b-b16a-e9c5deef0e67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:56.424102 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f6eeb84-7903-488b-b16a-e9c5deef0e67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:56.428294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f6eeb84-7903-488b-b16a-e9c5deef0e67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:56.429100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f6eeb84-7903-488b-b16a-e9c5deef0e67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:56.433805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f6eeb84-7903-488b-b16a-e9c5deef0e67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:56.710583 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0f6eeb84-7903-488b-b16a-e9c5deef0e67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:56.725540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0f6eeb84-7903-488b-b16a-e9c5deef0e67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1295 microversion: 2.1 time: 0.327227 Oct 28 20:05:56.726397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 24/49] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:56 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1295 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:56.766317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a64def4d-8091-43ad-a4bd-f0768c1f0bd1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:56.773288 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a64def4d-8091-43ad-a4bd-f0768c1f0bd1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:56.801274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a64def4d-8091-43ad-a4bd-f0768c1f0bd1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:56.802296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a64def4d-8091-43ad-a4bd-f0768c1f0bd1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:56.803351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a64def4d-8091-43ad-a4bd-f0768c1f0bd1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:56.814483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a64def4d-8091-43ad-a4bd-f0768c1f0bd1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:56.816210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a64def4d-8091-43ad-a4bd-f0768c1f0bd1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:56.817436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a64def4d-8091-43ad-a4bd-f0768c1f0bd1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:56.892028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2b4ec6a6-7945-41c8-9145-a5ed796fae01 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:56.917589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2b4ec6a6-7945-41c8-9145-a5ed796fae01 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.971797 Oct 28 20:05:56.937765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 26/50] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:55 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:56.952384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b163f282-4f70-457c-bc99-0d0c3a1cc6ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:56.958758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b163f282-4f70-457c-bc99-0d0c3a1cc6ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:56.979026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b163f282-4f70-457c-bc99-0d0c3a1cc6ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:56.979026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b163f282-4f70-457c-bc99-0d0c3a1cc6ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:56.979026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b163f282-4f70-457c-bc99-0d0c3a1cc6ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:56.979026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b163f282-4f70-457c-bc99-0d0c3a1cc6ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:56.979695 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b163f282-4f70-457c-bc99-0d0c3a1cc6ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:56.986051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b163f282-4f70-457c-bc99-0d0c3a1cc6ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:57.103972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a64def4d-8091-43ad-a4bd-f0768c1f0bd1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:57.133627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a64def4d-8091-43ad-a4bd-f0768c1f0bd1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1280 microversion: 2.1 time: 0.389117 Oct 28 20:05:57.134908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 25/51] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:56 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1280 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:57.315641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b163f282-4f70-457c-bc99-0d0c3a1cc6ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:57.352110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b163f282-4f70-457c-bc99-0d0c3a1cc6ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:57.372711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b163f282-4f70-457c-bc99-0d0c3a1cc6ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:57.378999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b163f282-4f70-457c-bc99-0d0c3a1cc6ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1334 microversion: 2.20 time: 0.439588 Oct 28 20:05:57.395254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 27/52] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:05:56 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1334 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:05:57.404329 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0d95bc99-fcb3-44c5-bc16-4b644756e434 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:57.405646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0d95bc99-fcb3-44c5-bc16-4b644756e434 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:57.412644 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d95bc99-fcb3-44c5-bc16-4b644756e434 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:57.418285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d95bc99-fcb3-44c5-bc16-4b644756e434 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:57.418285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d95bc99-fcb3-44c5-bc16-4b644756e434 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:57.418285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d95bc99-fcb3-44c5-bc16-4b644756e434 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:57.418285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d95bc99-fcb3-44c5-bc16-4b644756e434 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:57.418621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d95bc99-fcb3-44c5-bc16-4b644756e434 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:57.754785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-99db8a8f-b6ca-487a-863d-36ae95688bf6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:57.774309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-99db8a8f-b6ca-487a-863d-36ae95688bf6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:57.774309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99db8a8f-b6ca-487a-863d-36ae95688bf6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:57.774309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99db8a8f-b6ca-487a-863d-36ae95688bf6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:57.774309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99db8a8f-b6ca-487a-863d-36ae95688bf6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:57.775055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99db8a8f-b6ca-487a-863d-36ae95688bf6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:57.775055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99db8a8f-b6ca-487a-863d-36ae95688bf6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:57.775055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99db8a8f-b6ca-487a-863d-36ae95688bf6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:58.164737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0d95bc99-fcb3-44c5-bc16-4b644756e434 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:58.175198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0d95bc99-fcb3-44c5-bc16-4b644756e434 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1299 microversion: 2.1 time: 0.775998 Oct 28 20:05:58.176577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 26/53] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:57 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1299 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:58.187233 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca4fff5b-49a8-4010-9f24-4cd321fba568 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:58.187878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ca4fff5b-49a8-4010-9f24-4cd321fba568 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:58.197853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca4fff5b-49a8-4010-9f24-4cd321fba568 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:58.202499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca4fff5b-49a8-4010-9f24-4cd321fba568 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:58.203018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca4fff5b-49a8-4010-9f24-4cd321fba568 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:58.204931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca4fff5b-49a8-4010-9f24-4cd321fba568 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:58.205591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca4fff5b-49a8-4010-9f24-4cd321fba568 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:58.206450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca4fff5b-49a8-4010-9f24-4cd321fba568 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:58.857874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-99db8a8f-b6ca-487a-863d-36ae95688bf6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:58.870249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-99db8a8f-b6ca-487a-863d-36ae95688bf6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 1.119744 Oct 28 20:05:58.871166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 28/54] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:57 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:58.883195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-547a3c0e-f151-47cd-bc55-794107319baf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:58.887154 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-547a3c0e-f151-47cd-bc55-794107319baf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:58.896053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-547a3c0e-f151-47cd-bc55-794107319baf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:58.896970 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-547a3c0e-f151-47cd-bc55-794107319baf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:58.897739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-547a3c0e-f151-47cd-bc55-794107319baf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:58.899993 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-547a3c0e-f151-47cd-bc55-794107319baf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:58.901684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-547a3c0e-f151-47cd-bc55-794107319baf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:58.906833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ca4fff5b-49a8-4010-9f24-4cd321fba568 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:58.907351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-547a3c0e-f151-47cd-bc55-794107319baf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:58.914384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ca4fff5b-49a8-4010-9f24-4cd321fba568 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.736634 Oct 28 20:05:58.920945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 27/55] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:58 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:58.944192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6cf9c76f-c231-4922-a65e-ae79210eb648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:58.945713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6cf9c76f-c231-4922-a65e-ae79210eb648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:58.958235 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cf9c76f-c231-4922-a65e-ae79210eb648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:58.958735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cf9c76f-c231-4922-a65e-ae79210eb648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:58.959177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cf9c76f-c231-4922-a65e-ae79210eb648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:58.963157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cf9c76f-c231-4922-a65e-ae79210eb648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:58.963941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cf9c76f-c231-4922-a65e-ae79210eb648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:58.964614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cf9c76f-c231-4922-a65e-ae79210eb648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:59.031012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-547a3c0e-f151-47cd-bc55-794107319baf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:59.040385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-547a3c0e-f151-47cd-bc55-794107319baf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1280 microversion: 2.1 time: 0.168073 Oct 28 20:05:59.057520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 29/56] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:58 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1280 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:59.104474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6cf9c76f-c231-4922-a65e-ae79210eb648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:59.115068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6cf9c76f-c231-4922-a65e-ae79210eb648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:59.118335 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6cf9c76f-c231-4922-a65e-ae79210eb648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:59.118605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6cf9c76f-c231-4922-a65e-ae79210eb648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1340 microversion: 2.20 time: 0.195763 Oct 28 20:05:59.119828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 28/57] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:05:58 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1340 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:05:59.209505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9d202eea-17bb-48d3-909a-ae89d3c87aed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:59.209505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9d202eea-17bb-48d3-909a-ae89d3c87aed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:59.209505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:59.222160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d202eea-17bb-48d3-909a-ae89d3c87aed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:59.223147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d202eea-17bb-48d3-909a-ae89d3c87aed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:59.224503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d202eea-17bb-48d3-909a-ae89d3c87aed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:59.227666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d202eea-17bb-48d3-909a-ae89d3c87aed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:59.228826 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d202eea-17bb-48d3-909a-ae89d3c87aed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:59.231172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d202eea-17bb-48d3-909a-ae89d3c87aed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:59.416686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9d202eea-17bb-48d3-909a-ae89d3c87aed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:59.426168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9d202eea-17bb-48d3-909a-ae89d3c87aed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.225765 Oct 28 20:05:59.426757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 30/58] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:59 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:59.849603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1d053859-7b9f-4675-94ad-98e28f0497a0 req-425c906e-aac6-4177-a6fb-e41d03e36109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e31cf1aa-d94a-4bda-aa9c-1119bfb932bb", "tag": "94c8fbd6-55bd-42ab-9636-b03f381a547b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:59.865928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1d053859-7b9f-4675-94ad-98e28f0497a0 req-425c906e-aac6-4177-a6fb-e41d03e36109 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:59.866498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1d053859-7b9f-4675-94ad-98e28f0497a0 req-425c906e-aac6-4177-a6fb-e41d03e36109 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:59.867143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1d053859-7b9f-4675-94ad-98e28f0497a0 req-425c906e-aac6-4177-a6fb-e41d03e36109 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:59.892413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1d053859-7b9f-4675-94ad-98e28f0497a0 req-425c906e-aac6-4177-a6fb-e41d03e36109 service nova] Creating event network-changed:94c8fbd6-55bd-42ab-9636-b03f381a547b for instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb on hv-cinder-86236 Oct 28 20:05:59.893428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1d053859-7b9f-4675-94ad-98e28f0497a0 req-425c906e-aac6-4177-a6fb-e41d03e36109 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 20:05:59.894032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1d053859-7b9f-4675-94ad-98e28f0497a0 req-425c906e-aac6-4177-a6fb-e41d03e36109 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 20:05:59.895299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eac77a30-b168-40c1-a616-16523e8810de None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:59.895959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eac77a30-b168-40c1-a616-16523e8810de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:59.896556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eac77a30-b168-40c1-a616-16523e8810de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:59.898104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eac77a30-b168-40c1-a616-16523e8810de None None] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:59.898721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eac77a30-b168-40c1-a616-16523e8810de None None] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:59.899202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-97e707a4-0cb8-4810-ac08-b271e71f4f1b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:59.899941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-97e707a4-0cb8-4810-ac08-b271e71f4f1b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:59.901798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eac77a30-b168-40c1-a616-16523e8810de None None] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:59.904941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:59.913253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.compute.rpcapi [None req-eac77a30-b168-40c1-a616-16523e8810de None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 28 20:05:59.913919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97e707a4-0cb8-4810-ac08-b271e71f4f1b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:59.914980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eac77a30-b168-40c1-a616-16523e8810de None None] Releasing lock "compute-rpcapi-router" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 20:05:59.916282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97e707a4-0cb8-4810-ac08-b271e71f4f1b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:59.917242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97e707a4-0cb8-4810-ac08-b271e71f4f1b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:59.919956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97e707a4-0cb8-4810-ac08-b271e71f4f1b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:59.934013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97e707a4-0cb8-4810-ac08-b271e71f4f1b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:59.940412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eac77a30-b168-40c1-a616-16523e8810de None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202296 Oct 28 20:05:59.941663 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 29/59] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:59.945655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97e707a4-0cb8-4810-ac08-b271e71f4f1b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:59.962591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd3d97ab-a66f-4af5-9365-ebdb158f262f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:59.962591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd3d97ab-a66f-4af5-9365-ebdb158f262f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:59.969310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd3d97ab-a66f-4af5-9365-ebdb158f262f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:59.970158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd3d97ab-a66f-4af5-9365-ebdb158f262f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:59.970837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd3d97ab-a66f-4af5-9365-ebdb158f262f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:59.972502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd3d97ab-a66f-4af5-9365-ebdb158f262f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:59.974096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd3d97ab-a66f-4af5-9365-ebdb158f262f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:59.974904 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd3d97ab-a66f-4af5-9365-ebdb158f262f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:59.977011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:00.156085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=26 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:00.245845 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fd3d97ab-a66f-4af5-9365-ebdb158f262f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:00.253880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-97e707a4-0cb8-4810-ac08-b271e71f4f1b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:00.254877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd3d97ab-a66f-4af5-9365-ebdb158f262f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.304490 Oct 28 20:06:00.255466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 30/60] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:59 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:00.263836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-97e707a4-0cb8-4810-ac08-b271e71f4f1b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.369487 Oct 28 20:06:00.264540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 31/61] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:59 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:00.272101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-57862568-0779-431f-a184-2440533617a9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:00.273012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-57862568-0779-431f-a184-2440533617a9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:00.286474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57862568-0779-431f-a184-2440533617a9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:00.287045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9a94963-d9bb-4bd5-9b75-959c44c2e847 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:00.287597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f9a94963-d9bb-4bd5-9b75-959c44c2e847 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:00.288053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57862568-0779-431f-a184-2440533617a9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:00.288598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57862568-0779-431f-a184-2440533617a9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:00.289611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57862568-0779-431f-a184-2440533617a9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:00.290450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57862568-0779-431f-a184-2440533617a9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:00.291123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57862568-0779-431f-a184-2440533617a9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:00.297173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9a94963-d9bb-4bd5-9b75-959c44c2e847 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:00.297702 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9a94963-d9bb-4bd5-9b75-959c44c2e847 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:00.298326 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9a94963-d9bb-4bd5-9b75-959c44c2e847 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:00.299197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9a94963-d9bb-4bd5-9b75-959c44c2e847 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:00.300151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9a94963-d9bb-4bd5-9b75-959c44c2e847 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:00.300740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9a94963-d9bb-4bd5-9b75-959c44c2e847 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:00.412737 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-57862568-0779-431f-a184-2440533617a9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:00.421847 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-57862568-0779-431f-a184-2440533617a9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:00.423425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-57862568-0779-431f-a184-2440533617a9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:00.424547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-57862568-0779-431f-a184-2440533617a9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1340 microversion: 2.20 time: 0.158560 Oct 28 20:06:00.425108 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 32/62] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:00 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1340 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:00.453409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-97ccd760-bb06-48ea-b942-0d1bbbf41719 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:00.454076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-97ccd760-bb06-48ea-b942-0d1bbbf41719 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:00.460320 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97ccd760-bb06-48ea-b942-0d1bbbf41719 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:00.460808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97ccd760-bb06-48ea-b942-0d1bbbf41719 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:00.461241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97ccd760-bb06-48ea-b942-0d1bbbf41719 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:00.461958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97ccd760-bb06-48ea-b942-0d1bbbf41719 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:00.462403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97ccd760-bb06-48ea-b942-0d1bbbf41719 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:00.462898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97ccd760-bb06-48ea-b942-0d1bbbf41719 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:00.545882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f9a94963-d9bb-4bd5-9b75-959c44c2e847 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:00.553836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f9a94963-d9bb-4bd5-9b75-959c44c2e847 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.297328 Oct 28 20:06:00.554476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 31/63] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:00 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:00.666326 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-97ccd760-bb06-48ea-b942-0d1bbbf41719 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:00.667010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-8c4ba9f5-f38d-4cdb-b036-7742ada759e1 req-847ccd9c-28ea-49f4-87a2-bcd34a87ad90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e927409-017d-4d1b-9028-4b1ad64d9744", "tag": "82ea1ef3-ed28-48ca-8041-9192ffe5d711"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:00.677057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-97ccd760-bb06-48ea-b942-0d1bbbf41719 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.227547 Oct 28 20:06:00.677248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8c4ba9f5-f38d-4cdb-b036-7742ada759e1 req-847ccd9c-28ea-49f4-87a2-bcd34a87ad90 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:00.678126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 33/64] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:00 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:00.678703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8c4ba9f5-f38d-4cdb-b036-7742ada759e1 req-847ccd9c-28ea-49f4-87a2-bcd34a87ad90 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:00.679254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8c4ba9f5-f38d-4cdb-b036-7742ada759e1 req-847ccd9c-28ea-49f4-87a2-bcd34a87ad90 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:00.691785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-8c4ba9f5-f38d-4cdb-b036-7742ada759e1 req-847ccd9c-28ea-49f4-87a2-bcd34a87ad90 service nova] Creating event network-changed:82ea1ef3-ed28-48ca-8041-9192ffe5d711 for instance 1e927409-017d-4d1b-9028-4b1ad64d9744 on hv-cinder-86236 Oct 28 20:06:00.699356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-8c4ba9f5-f38d-4cdb-b036-7742ada759e1 req-847ccd9c-28ea-49f4-87a2-bcd34a87ad90 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087948 Oct 28 20:06:00.700030 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 32/65] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:06:01.287616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7e978538-67cc-42a5-a8e2-bc87e297a4f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:01.288419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7e978538-67cc-42a5-a8e2-bc87e297a4f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:01.293453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5c34964f-8a7b-4685-a7f6-284b82688444 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:01.294355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5c34964f-8a7b-4685-a7f6-284b82688444 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:01.301390 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c34964f-8a7b-4685-a7f6-284b82688444 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:01.306345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e978538-67cc-42a5-a8e2-bc87e297a4f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:01.307280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e978538-67cc-42a5-a8e2-bc87e297a4f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:01.307875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e978538-67cc-42a5-a8e2-bc87e297a4f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:01.308979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e978538-67cc-42a5-a8e2-bc87e297a4f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:01.310349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c34964f-8a7b-4685-a7f6-284b82688444 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:01.310851 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e978538-67cc-42a5-a8e2-bc87e297a4f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:01.311426 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e978538-67cc-42a5-a8e2-bc87e297a4f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:01.312155 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c34964f-8a7b-4685-a7f6-284b82688444 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:01.313581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c34964f-8a7b-4685-a7f6-284b82688444 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:01.318052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c34964f-8a7b-4685-a7f6-284b82688444 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:01.321965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c34964f-8a7b-4685-a7f6-284b82688444 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:01.542329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5c34964f-8a7b-4685-a7f6-284b82688444 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:01.560239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5c34964f-8a7b-4685-a7f6-284b82688444 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.282354 Oct 28 20:06:01.561088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 34/66] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:01 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:01.577912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fed772d2-6d3b-4243-9d6c-70f1e203e54c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:01.578883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fed772d2-6d3b-4243-9d6c-70f1e203e54c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:01.581077 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7e978538-67cc-42a5-a8e2-bc87e297a4f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:01.586257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed772d2-6d3b-4243-9d6c-70f1e203e54c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:01.586776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed772d2-6d3b-4243-9d6c-70f1e203e54c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:01.587211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed772d2-6d3b-4243-9d6c-70f1e203e54c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:01.587902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed772d2-6d3b-4243-9d6c-70f1e203e54c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:01.588349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed772d2-6d3b-4243-9d6c-70f1e203e54c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:01.588789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed772d2-6d3b-4243-9d6c-70f1e203e54c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:01.589536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7e978538-67cc-42a5-a8e2-bc87e297a4f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.305895 Oct 28 20:06:01.590121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 33/67] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:01 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:01.595538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7dd9815b-75d7-4f2a-a3ab-3aab7391fbbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:01.596359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7dd9815b-75d7-4f2a-a3ab-3aab7391fbbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:01.608555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dd9815b-75d7-4f2a-a3ab-3aab7391fbbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:01.610048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dd9815b-75d7-4f2a-a3ab-3aab7391fbbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:01.610048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dd9815b-75d7-4f2a-a3ab-3aab7391fbbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:01.611043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dd9815b-75d7-4f2a-a3ab-3aab7391fbbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:01.611630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dd9815b-75d7-4f2a-a3ab-3aab7391fbbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:01.612208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dd9815b-75d7-4f2a-a3ab-3aab7391fbbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:01.642723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:01.662002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fed772d2-6d3b-4243-9d6c-70f1e203e54c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:01.671019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fed772d2-6d3b-4243-9d6c-70f1e203e54c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:01.672583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fed772d2-6d3b-4243-9d6c-70f1e203e54c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:01.673807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fed772d2-6d3b-4243-9d6c-70f1e203e54c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1340 microversion: 2.20 time: 0.111384 Oct 28 20:06:01.674427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 35/68] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:01 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1340 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:01.711075 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b651be77-7661-4544-a744-58b7f861f253 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:01.714328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b651be77-7661-4544-a744-58b7f861f253 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:01.726928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b651be77-7661-4544-a744-58b7f861f253 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:01.726928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b651be77-7661-4544-a744-58b7f861f253 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:01.726928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b651be77-7661-4544-a744-58b7f861f253 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:01.726928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b651be77-7661-4544-a744-58b7f861f253 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:01.727343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b651be77-7661-4544-a744-58b7f861f253 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:01.727343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b651be77-7661-4544-a744-58b7f861f253 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:01.783028 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7dd9815b-75d7-4f2a-a3ab-3aab7391fbbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:01.789010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7dd9815b-75d7-4f2a-a3ab-3aab7391fbbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.197883 Oct 28 20:06:01.790435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 34/69] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:01 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:01.917218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b651be77-7661-4544-a744-58b7f861f253 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:01.945930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b651be77-7661-4544-a744-58b7f861f253 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.241893 Oct 28 20:06:01.947672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 36/70] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:01 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:02.585709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-54a722b0-04da-4f40-b4d1-5e87c676960f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:02.586254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-54a722b0-04da-4f40-b4d1-5e87c676960f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:02.592989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54a722b0-04da-4f40-b4d1-5e87c676960f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:02.593510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54a722b0-04da-4f40-b4d1-5e87c676960f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:02.593956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54a722b0-04da-4f40-b4d1-5e87c676960f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:02.594647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54a722b0-04da-4f40-b4d1-5e87c676960f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:02.595173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54a722b0-04da-4f40-b4d1-5e87c676960f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:02.595606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54a722b0-04da-4f40-b4d1-5e87c676960f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:02.619023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bfcbac5d-886b-4d08-b519-2d5a2b19a221 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:02.620272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bfcbac5d-886b-4d08-b519-2d5a2b19a221 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:02.627908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfcbac5d-886b-4d08-b519-2d5a2b19a221 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:02.628642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfcbac5d-886b-4d08-b519-2d5a2b19a221 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:02.629227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfcbac5d-886b-4d08-b519-2d5a2b19a221 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:02.630087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfcbac5d-886b-4d08-b519-2d5a2b19a221 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:02.630831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfcbac5d-886b-4d08-b519-2d5a2b19a221 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:02.631447 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfcbac5d-886b-4d08-b519-2d5a2b19a221 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:02.814274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-54a722b0-04da-4f40-b4d1-5e87c676960f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:02.823496 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-54a722b0-04da-4f40-b4d1-5e87c676960f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.242251 Oct 28 20:06:02.825336 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 35/71] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:02 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:02.831654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9ac45e4e-397d-48df-8403-d828cb82f2a1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:02.832144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bfcbac5d-886b-4d08-b519-2d5a2b19a221 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:02.832653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9ac45e4e-397d-48df-8403-d828cb82f2a1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:02.839700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ac45e4e-397d-48df-8403-d828cb82f2a1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:02.840288 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ac45e4e-397d-48df-8403-d828cb82f2a1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:02.840738 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ac45e4e-397d-48df-8403-d828cb82f2a1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:02.841454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ac45e4e-397d-48df-8403-d828cb82f2a1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:02.842056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ac45e4e-397d-48df-8403-d828cb82f2a1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:02.842616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ac45e4e-397d-48df-8403-d828cb82f2a1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:02.846835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bfcbac5d-886b-4d08-b519-2d5a2b19a221 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.231765 Oct 28 20:06:02.847507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 37/72] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:02 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:02.852058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-52c2afd9-fa03-445e-9fd1-2b0a1c7ba01f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:02.852927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-52c2afd9-fa03-445e-9fd1-2b0a1c7ba01f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:02.864144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52c2afd9-fa03-445e-9fd1-2b0a1c7ba01f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:02.864980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52c2afd9-fa03-445e-9fd1-2b0a1c7ba01f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:02.867251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52c2afd9-fa03-445e-9fd1-2b0a1c7ba01f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:02.868287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52c2afd9-fa03-445e-9fd1-2b0a1c7ba01f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:02.874318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52c2afd9-fa03-445e-9fd1-2b0a1c7ba01f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:02.875268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52c2afd9-fa03-445e-9fd1-2b0a1c7ba01f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:02.936123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9ac45e4e-397d-48df-8403-d828cb82f2a1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:02.944302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9ac45e4e-397d-48df-8403-d828cb82f2a1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:02.947646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9ac45e4e-397d-48df-8403-d828cb82f2a1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:02.947646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9ac45e4e-397d-48df-8403-d828cb82f2a1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1340 microversion: 2.20 time: 0.120365 Oct 28 20:06:02.947646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 36/73] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:02 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1340 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:02.973902 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-958a1977-7bd5-4c1c-9969-9d145a912086 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:02.974591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-958a1977-7bd5-4c1c-9969-9d145a912086 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:02.980540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-958a1977-7bd5-4c1c-9969-9d145a912086 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:02.981217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-958a1977-7bd5-4c1c-9969-9d145a912086 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:02.982322 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-958a1977-7bd5-4c1c-9969-9d145a912086 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:02.983296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-958a1977-7bd5-4c1c-9969-9d145a912086 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:02.983888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-958a1977-7bd5-4c1c-9969-9d145a912086 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:02.984459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-958a1977-7bd5-4c1c-9969-9d145a912086 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:03.094767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-52c2afd9-fa03-445e-9fd1-2b0a1c7ba01f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:03.110367 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-52c2afd9-fa03-445e-9fd1-2b0a1c7ba01f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.261672 Oct 28 20:06:03.126984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 38/74] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:02 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:03.180213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-958a1977-7bd5-4c1c-9969-9d145a912086 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:03.190844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-958a1977-7bd5-4c1c-9969-9d145a912086 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.221840 Oct 28 20:06:03.191531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 37/75] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:02 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:03.848094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-06a22608-42b3-498b-a2ad-c5ec1555f93e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:03.849078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-06a22608-42b3-498b-a2ad-c5ec1555f93e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:03.855658 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06a22608-42b3-498b-a2ad-c5ec1555f93e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:03.856142 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06a22608-42b3-498b-a2ad-c5ec1555f93e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:03.857161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06a22608-42b3-498b-a2ad-c5ec1555f93e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:03.858083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06a22608-42b3-498b-a2ad-c5ec1555f93e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:03.858541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06a22608-42b3-498b-a2ad-c5ec1555f93e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:03.858972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06a22608-42b3-498b-a2ad-c5ec1555f93e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:03.873176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e976cb3f-7deb-4bb9-9ee1-f2eb221bd252 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:03.874436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e976cb3f-7deb-4bb9-9ee1-f2eb221bd252 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:03.876741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=34 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:03.882216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e976cb3f-7deb-4bb9-9ee1-f2eb221bd252 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:03.882886 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e976cb3f-7deb-4bb9-9ee1-f2eb221bd252 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:03.883524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e976cb3f-7deb-4bb9-9ee1-f2eb221bd252 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:03.884561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e976cb3f-7deb-4bb9-9ee1-f2eb221bd252 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:03.885160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e976cb3f-7deb-4bb9-9ee1-f2eb221bd252 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:03.885785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e976cb3f-7deb-4bb9-9ee1-f2eb221bd252 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:04.065893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-06a22608-42b3-498b-a2ad-c5ec1555f93e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:04.074519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-06a22608-42b3-498b-a2ad-c5ec1555f93e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.230830 Oct 28 20:06:04.075326 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 39/76] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:03 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:04.079897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f08a100e-58a9-4b10-b733-355e8fb3c541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:04.080768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f08a100e-58a9-4b10-b733-355e8fb3c541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:04.087118 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f08a100e-58a9-4b10-b733-355e8fb3c541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:04.087870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f08a100e-58a9-4b10-b733-355e8fb3c541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:04.088498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f08a100e-58a9-4b10-b733-355e8fb3c541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:04.089421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f08a100e-58a9-4b10-b733-355e8fb3c541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:04.090082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f08a100e-58a9-4b10-b733-355e8fb3c541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:04.090814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f08a100e-58a9-4b10-b733-355e8fb3c541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:04.097222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e976cb3f-7deb-4bb9-9ee1-f2eb221bd252 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:04.102920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e976cb3f-7deb-4bb9-9ee1-f2eb221bd252 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.234864 Oct 28 20:06:04.103721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 38/77] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:03 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:04.133924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8b0167b7-9414-48a5-89c8-08d5c00149da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:04.134841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8b0167b7-9414-48a5-89c8-08d5c00149da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:04.142828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b0167b7-9414-48a5-89c8-08d5c00149da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:04.143319 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b0167b7-9414-48a5-89c8-08d5c00149da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:04.143762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b0167b7-9414-48a5-89c8-08d5c00149da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:04.149359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b0167b7-9414-48a5-89c8-08d5c00149da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:04.149359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b0167b7-9414-48a5-89c8-08d5c00149da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:04.149359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b0167b7-9414-48a5-89c8-08d5c00149da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:04.175389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f08a100e-58a9-4b10-b733-355e8fb3c541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:04.185204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f08a100e-58a9-4b10-b733-355e8fb3c541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:04.186942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f08a100e-58a9-4b10-b733-355e8fb3c541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:04.188527 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f08a100e-58a9-4b10-b733-355e8fb3c541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1340 microversion: 2.20 time: 0.112219 Oct 28 20:06:04.189385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 40/78] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:04 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1340 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:04.213754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0f4ace7e-0a6a-4312-8235-67d6a9af9d11 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:04.214482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0f4ace7e-0a6a-4312-8235-67d6a9af9d11 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:04.234548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f4ace7e-0a6a-4312-8235-67d6a9af9d11 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:04.235288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f4ace7e-0a6a-4312-8235-67d6a9af9d11 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:04.235917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f4ace7e-0a6a-4312-8235-67d6a9af9d11 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:04.236632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f4ace7e-0a6a-4312-8235-67d6a9af9d11 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:04.237093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f4ace7e-0a6a-4312-8235-67d6a9af9d11 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:04.237545 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f4ace7e-0a6a-4312-8235-67d6a9af9d11 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:04.331683 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8b0167b7-9414-48a5-89c8-08d5c00149da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:04.339603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8b0167b7-9414-48a5-89c8-08d5c00149da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.209457 Oct 28 20:06:04.340471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 39/79] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:04 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:04.397698 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0f4ace7e-0a6a-4312-8235-67d6a9af9d11 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:04.409006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0f4ace7e-0a6a-4312-8235-67d6a9af9d11 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.198986 Oct 28 20:06:04.415103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 41/80] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:04 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:05.101344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8e79847c-13d6-45da-8237-86c0c60cd95b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:05.101991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8e79847c-13d6-45da-8237-86c0c60cd95b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:05.110638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e79847c-13d6-45da-8237-86c0c60cd95b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:05.111074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e79847c-13d6-45da-8237-86c0c60cd95b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:05.111717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e79847c-13d6-45da-8237-86c0c60cd95b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:05.112608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e79847c-13d6-45da-8237-86c0c60cd95b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:05.113234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e79847c-13d6-45da-8237-86c0c60cd95b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:05.113703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e79847c-13d6-45da-8237-86c0c60cd95b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:05.127584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72920ebb-05c2-4e03-bb74-da6fdcbb13c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:05.129154 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-72920ebb-05c2-4e03-bb74-da6fdcbb13c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:05.134939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72920ebb-05c2-4e03-bb74-da6fdcbb13c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:05.135476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72920ebb-05c2-4e03-bb74-da6fdcbb13c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:05.135886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72920ebb-05c2-4e03-bb74-da6fdcbb13c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:05.136758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72920ebb-05c2-4e03-bb74-da6fdcbb13c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:05.137214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72920ebb-05c2-4e03-bb74-da6fdcbb13c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:05.138288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72920ebb-05c2-4e03-bb74-da6fdcbb13c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:05.330074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8e79847c-13d6-45da-8237-86c0c60cd95b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:05.339351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8e79847c-13d6-45da-8237-86c0c60cd95b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.241874 Oct 28 20:06:05.340087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 40/81] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:05 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:05.351964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-72920ebb-05c2-4e03-bb74-da6fdcbb13c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:05.360185 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bf0bd5d5-cd65-4145-aa98-5bc2a14fe7ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:05.364007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bf0bd5d5-cd65-4145-aa98-5bc2a14fe7ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:05.369633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-72920ebb-05c2-4e03-bb74-da6fdcbb13c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.245572 Oct 28 20:06:05.374310 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 42/82] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:05 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:05.374441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf0bd5d5-cd65-4145-aa98-5bc2a14fe7ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:05.374441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf0bd5d5-cd65-4145-aa98-5bc2a14fe7ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:05.374441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf0bd5d5-cd65-4145-aa98-5bc2a14fe7ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:05.374441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf0bd5d5-cd65-4145-aa98-5bc2a14fe7ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:05.374888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf0bd5d5-cd65-4145-aa98-5bc2a14fe7ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:05.374888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf0bd5d5-cd65-4145-aa98-5bc2a14fe7ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:05.376093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a8fd7a64-7808-4005-b412-45564d3635ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:05.377388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a8fd7a64-7808-4005-b412-45564d3635ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:05.383704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8fd7a64-7808-4005-b412-45564d3635ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:05.384334 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8fd7a64-7808-4005-b412-45564d3635ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:05.384819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8fd7a64-7808-4005-b412-45564d3635ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:05.385605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8fd7a64-7808-4005-b412-45564d3635ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:05.386184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8fd7a64-7808-4005-b412-45564d3635ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:05.386620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8fd7a64-7808-4005-b412-45564d3635ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:05.474896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bf0bd5d5-cd65-4145-aa98-5bc2a14fe7ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:05.490512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bf0bd5d5-cd65-4145-aa98-5bc2a14fe7ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:05.490512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bf0bd5d5-cd65-4145-aa98-5bc2a14fe7ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:05.490512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bf0bd5d5-cd65-4145-aa98-5bc2a14fe7ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1340 microversion: 2.20 time: 0.147868 Oct 28 20:06:05.493644 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 41/83] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:05 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1340 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:05.500726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f4fbfc9f-1858-4280-b6af-276f5ba6d6a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:05.501638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f4fbfc9f-1858-4280-b6af-276f5ba6d6a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:05.518581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4fbfc9f-1858-4280-b6af-276f5ba6d6a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:05.519085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4fbfc9f-1858-4280-b6af-276f5ba6d6a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:05.519531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4fbfc9f-1858-4280-b6af-276f5ba6d6a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:05.520291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4fbfc9f-1858-4280-b6af-276f5ba6d6a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:05.520756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4fbfc9f-1858-4280-b6af-276f5ba6d6a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:05.521223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4fbfc9f-1858-4280-b6af-276f5ba6d6a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:05.820031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a8fd7a64-7808-4005-b412-45564d3635ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:05.830078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a8fd7a64-7808-4005-b412-45564d3635ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.458734 Oct 28 20:06:05.841403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f4fbfc9f-1858-4280-b6af-276f5ba6d6a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:05.847523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 43/84] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:05 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:05.847618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f4fbfc9f-1858-4280-b6af-276f5ba6d6a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.350925 Oct 28 20:06:05.847618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 42/85] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:05 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:06.372726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94ad2065-e561-47a0-b5d6-e3264ecdf4ea tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:06.374069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-94ad2065-e561-47a0-b5d6-e3264ecdf4ea tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:06.383377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94ad2065-e561-47a0-b5d6-e3264ecdf4ea tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:06.383933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94ad2065-e561-47a0-b5d6-e3264ecdf4ea tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:06.384423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94ad2065-e561-47a0-b5d6-e3264ecdf4ea tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:06.385171 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94ad2065-e561-47a0-b5d6-e3264ecdf4ea tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:06.385756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94ad2065-e561-47a0-b5d6-e3264ecdf4ea tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:06.386190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94ad2065-e561-47a0-b5d6-e3264ecdf4ea tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:06.395344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eb0e778d-5cc0-454d-9fb5-b2a139629498 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:06.395962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eb0e778d-5cc0-454d-9fb5-b2a139629498 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:06.402420 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0e778d-5cc0-454d-9fb5-b2a139629498 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:06.403226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0e778d-5cc0-454d-9fb5-b2a139629498 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:06.404203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0e778d-5cc0-454d-9fb5-b2a139629498 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:06.405370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0e778d-5cc0-454d-9fb5-b2a139629498 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:06.405813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0e778d-5cc0-454d-9fb5-b2a139629498 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:06.406346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0e778d-5cc0-454d-9fb5-b2a139629498 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:06.739510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-eb0e778d-5cc0-454d-9fb5-b2a139629498 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:06.750023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eb0e778d-5cc0-454d-9fb5-b2a139629498 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.358368 Oct 28 20:06:06.750937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 43/86] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:06 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:06.760096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-94ad2065-e561-47a0-b5d6-e3264ecdf4ea tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:06.767670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-22a80f99-5a1d-41c3-bf2a-37ccc3b422bc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:06.773573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22a80f99-5a1d-41c3-bf2a-37ccc3b422bc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:06.775882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-94ad2065-e561-47a0-b5d6-e3264ecdf4ea tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.407745 Oct 28 20:06:06.776548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 44/87] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:06 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:06.783884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22a80f99-5a1d-41c3-bf2a-37ccc3b422bc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:06.784648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22a80f99-5a1d-41c3-bf2a-37ccc3b422bc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:06.785948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22a80f99-5a1d-41c3-bf2a-37ccc3b422bc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:06.786148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22a80f99-5a1d-41c3-bf2a-37ccc3b422bc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:06.786809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22a80f99-5a1d-41c3-bf2a-37ccc3b422bc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:06.787323 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22a80f99-5a1d-41c3-bf2a-37ccc3b422bc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:06.863398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5e5a20c5-6e1c-41c3-9393-3078523e7b74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:06.864493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5e5a20c5-6e1c-41c3-9393-3078523e7b74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:06.888504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-22a80f99-5a1d-41c3-bf2a-37ccc3b422bc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:06.895130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e5a20c5-6e1c-41c3-9393-3078523e7b74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:06.897537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e5a20c5-6e1c-41c3-9393-3078523e7b74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:06.905121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-22a80f99-5a1d-41c3-bf2a-37ccc3b422bc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:06.906099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-22a80f99-5a1d-41c3-bf2a-37ccc3b422bc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:06.906719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e5a20c5-6e1c-41c3-9393-3078523e7b74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:06.907856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-22a80f99-5a1d-41c3-bf2a-37ccc3b422bc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1340 microversion: 2.20 time: 0.155161 Oct 28 20:06:06.908436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 44/88] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:06 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1340 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:06.911556 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e5a20c5-6e1c-41c3-9393-3078523e7b74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:06.913203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e5a20c5-6e1c-41c3-9393-3078523e7b74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:06.915173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e5a20c5-6e1c-41c3-9393-3078523e7b74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:06.918311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43d61305-727f-4a25-be0b-23116fb2febe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:06.919544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-43d61305-727f-4a25-be0b-23116fb2febe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:06.935238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d61305-727f-4a25-be0b-23116fb2febe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:06.935739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d61305-727f-4a25-be0b-23116fb2febe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:06.936182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d61305-727f-4a25-be0b-23116fb2febe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:06.936901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d61305-727f-4a25-be0b-23116fb2febe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:06.937383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d61305-727f-4a25-be0b-23116fb2febe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:06.940286 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d61305-727f-4a25-be0b-23116fb2febe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:07.688748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5e5a20c5-6e1c-41c3-9393-3078523e7b74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:07.699741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5e5a20c5-6e1c-41c3-9393-3078523e7b74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.846375 Oct 28 20:06:07.699741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 45/89] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:06 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:07.715490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-43d61305-727f-4a25-be0b-23116fb2febe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:07.727393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-43d61305-727f-4a25-be0b-23116fb2febe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.812732 Oct 28 20:06:07.728488 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 45/90] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:06 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:07.775985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4ac35784-6a08-426e-afd5-4512c63f4fbf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:07.776603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4ac35784-6a08-426e-afd5-4512c63f4fbf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:07.784844 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ac35784-6a08-426e-afd5-4512c63f4fbf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:07.785365 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ac35784-6a08-426e-afd5-4512c63f4fbf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:07.786468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ac35784-6a08-426e-afd5-4512c63f4fbf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:07.787174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ac35784-6a08-426e-afd5-4512c63f4fbf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:07.788126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ac35784-6a08-426e-afd5-4512c63f4fbf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:07.788616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ac35784-6a08-426e-afd5-4512c63f4fbf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:07.802865 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-de8f16da-ad4c-4312-ae75-20e71bf1cf77 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:07.803413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-de8f16da-ad4c-4312-ae75-20e71bf1cf77 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:07.812832 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de8f16da-ad4c-4312-ae75-20e71bf1cf77 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:07.816490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de8f16da-ad4c-4312-ae75-20e71bf1cf77 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:07.816490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de8f16da-ad4c-4312-ae75-20e71bf1cf77 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:07.816490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de8f16da-ad4c-4312-ae75-20e71bf1cf77 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:07.816490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de8f16da-ad4c-4312-ae75-20e71bf1cf77 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:07.816852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de8f16da-ad4c-4312-ae75-20e71bf1cf77 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:08.603911 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4ac35784-6a08-426e-afd5-4512c63f4fbf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:08.623388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4ac35784-6a08-426e-afd5-4512c63f4fbf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.849515 Oct 28 20:06:08.637448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-de8f16da-ad4c-4312-ae75-20e71bf1cf77 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:08.643299 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 46/91] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:07 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:08.646969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0eb88b5a-7889-4741-8417-9455c28220fa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:08.647821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0eb88b5a-7889-4741-8417-9455c28220fa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:08.649737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-de8f16da-ad4c-4312-ae75-20e71bf1cf77 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.850813 Oct 28 20:06:08.654559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eb88b5a-7889-4741-8417-9455c28220fa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:08.655931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eb88b5a-7889-4741-8417-9455c28220fa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:08.656588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eb88b5a-7889-4741-8417-9455c28220fa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:08.657594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eb88b5a-7889-4741-8417-9455c28220fa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:08.658255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eb88b5a-7889-4741-8417-9455c28220fa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:08.659047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eb88b5a-7889-4741-8417-9455c28220fa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:08.681446 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 46/92] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:07 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:08.724898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd6740ae-7293-4bbd-89f7-b6afffe00ac8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:08.726234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd6740ae-7293-4bbd-89f7-b6afffe00ac8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:08.732354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd6740ae-7293-4bbd-89f7-b6afffe00ac8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:08.733068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd6740ae-7293-4bbd-89f7-b6afffe00ac8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:08.733539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd6740ae-7293-4bbd-89f7-b6afffe00ac8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:08.734248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd6740ae-7293-4bbd-89f7-b6afffe00ac8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:08.734699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd6740ae-7293-4bbd-89f7-b6afffe00ac8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:08.735282 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd6740ae-7293-4bbd-89f7-b6afffe00ac8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:08.839561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0eb88b5a-7889-4741-8417-9455c28220fa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:08.856796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0eb88b5a-7889-4741-8417-9455c28220fa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:08.856796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0eb88b5a-7889-4741-8417-9455c28220fa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:08.856796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0eb88b5a-7889-4741-8417-9455c28220fa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1340 microversion: 2.20 time: 0.214619 Oct 28 20:06:08.857342 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 47/93] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:08 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1340 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:08.862445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8e31cae6-e3f7-43a1-9b64-a81790fc6ccc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:08.864207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8e31cae6-e3f7-43a1-9b64-a81790fc6ccc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:08.873005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e31cae6-e3f7-43a1-9b64-a81790fc6ccc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:08.874075 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e31cae6-e3f7-43a1-9b64-a81790fc6ccc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:08.874744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e31cae6-e3f7-43a1-9b64-a81790fc6ccc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:08.875626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e31cae6-e3f7-43a1-9b64-a81790fc6ccc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:08.876398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e31cae6-e3f7-43a1-9b64-a81790fc6ccc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:08.876834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e31cae6-e3f7-43a1-9b64-a81790fc6ccc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:08.882513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:09.249934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fd6740ae-7293-4bbd-89f7-b6afffe00ac8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:09.271648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd6740ae-7293-4bbd-89f7-b6afffe00ac8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.550517 Oct 28 20:06:09.276659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 47/94] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:08 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:09.326836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ae329a6f-4bd0-487d-bc3a-a774d463a129 req-cdf7acd4-f24e-4eee-9789-9343ed130ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83fb8150-cbd4-4139-bb47-a0fd318f8b86", "tag": "44d34977-72a3-481b-b7c3-7284888f0990"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:09.342581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ae329a6f-4bd0-487d-bc3a-a774d463a129 req-cdf7acd4-f24e-4eee-9789-9343ed130ada service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:09.343078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ae329a6f-4bd0-487d-bc3a-a774d463a129 req-cdf7acd4-f24e-4eee-9789-9343ed130ada service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:09.343509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ae329a6f-4bd0-487d-bc3a-a774d463a129 req-cdf7acd4-f24e-4eee-9789-9343ed130ada service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:09.373701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ae329a6f-4bd0-487d-bc3a-a774d463a129 req-cdf7acd4-f24e-4eee-9789-9343ed130ada service nova] Creating event network-changed:44d34977-72a3-481b-b7c3-7284888f0990 for instance 83fb8150-cbd4-4139-bb47-a0fd318f8b86 on hv-cinder-86236 Oct 28 20:06:09.383728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ae329a6f-4bd0-487d-bc3a-a774d463a129 req-cdf7acd4-f24e-4eee-9789-9343ed130ada service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062993 Oct 28 20:06:09.388150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 48/95] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:09.433452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8e31cae6-e3f7-43a1-9b64-a81790fc6ccc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:09.456614 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8e31cae6-e3f7-43a1-9b64-a81790fc6ccc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.597461 Oct 28 20:06:09.482525 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 48/96] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:08 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:09.640039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-4dcb232d-8cdd-4d1b-a8de-dc47db78f206 req-c7598cda-4552-489b-9e61-faf1e031cfcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91", "tag": "bdcc9207-f285-46ee-9af9-3f76e3f40aa4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:09.650628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a9b599e5-b55e-4391-a7b3-d787837be0d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:09.651849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a9b599e5-b55e-4391-a7b3-d787837be0d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:09.661541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4dcb232d-8cdd-4d1b-a8de-dc47db78f206 req-c7598cda-4552-489b-9e61-faf1e031cfcd service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:09.661541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4dcb232d-8cdd-4d1b-a8de-dc47db78f206 req-c7598cda-4552-489b-9e61-faf1e031cfcd service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:09.661541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4dcb232d-8cdd-4d1b-a8de-dc47db78f206 req-c7598cda-4552-489b-9e61-faf1e031cfcd service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:09.661813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9b599e5-b55e-4391-a7b3-d787837be0d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:09.661813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9b599e5-b55e-4391-a7b3-d787837be0d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:09.661813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9b599e5-b55e-4391-a7b3-d787837be0d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:09.661813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9b599e5-b55e-4391-a7b3-d787837be0d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:09.662062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9b599e5-b55e-4391-a7b3-d787837be0d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:09.664156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9b599e5-b55e-4391-a7b3-d787837be0d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:09.679070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-4dcb232d-8cdd-4d1b-a8de-dc47db78f206 req-c7598cda-4552-489b-9e61-faf1e031cfcd service nova] Creating event network-changed:bdcc9207-f285-46ee-9af9-3f76e3f40aa4 for instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 on hv-cinder-86236 Oct 28 20:06:09.712944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-4dcb232d-8cdd-4d1b-a8de-dc47db78f206 req-c7598cda-4552-489b-9e61-faf1e031cfcd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077815 Oct 28 20:06:09.713688 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 49/97] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:09.719502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c8777f61-6b46-4f4a-bbd6-1b87fb7d1eeb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:09.720206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c8777f61-6b46-4f4a-bbd6-1b87fb7d1eeb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:09.726595 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8777f61-6b46-4f4a-bbd6-1b87fb7d1eeb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:09.727291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8777f61-6b46-4f4a-bbd6-1b87fb7d1eeb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:09.727737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8777f61-6b46-4f4a-bbd6-1b87fb7d1eeb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:09.728442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8777f61-6b46-4f4a-bbd6-1b87fb7d1eeb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:09.728903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8777f61-6b46-4f4a-bbd6-1b87fb7d1eeb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:09.729356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8777f61-6b46-4f4a-bbd6-1b87fb7d1eeb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:09.846454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a9b599e5-b55e-4391-a7b3-d787837be0d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:09.860440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a9b599e5-b55e-4391-a7b3-d787837be0d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.213678 Oct 28 20:06:09.860440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 49/98] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:09 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:09.887248 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c64aaa3b-fdf0-43aa-956f-d0bba8ee1f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:09.887248 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c64aaa3b-fdf0-43aa-956f-d0bba8ee1f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:09.891778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64aaa3b-fdf0-43aa-956f-d0bba8ee1f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:09.892273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64aaa3b-fdf0-43aa-956f-d0bba8ee1f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:09.892715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64aaa3b-fdf0-43aa-956f-d0bba8ee1f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:09.893451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64aaa3b-fdf0-43aa-956f-d0bba8ee1f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:09.894084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64aaa3b-fdf0-43aa-956f-d0bba8ee1f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:09.894553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64aaa3b-fdf0-43aa-956f-d0bba8ee1f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:09.912935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c8777f61-6b46-4f4a-bbd6-1b87fb7d1eeb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:09.915244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:09.922204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c8777f61-6b46-4f4a-bbd6-1b87fb7d1eeb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.207241 Oct 28 20:06:09.922770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 50/99] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:09 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:10.049397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c64aaa3b-fdf0-43aa-956f-d0bba8ee1f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:10.057942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c64aaa3b-fdf0-43aa-956f-d0bba8ee1f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:10.060035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c64aaa3b-fdf0-43aa-956f-d0bba8ee1f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:10.061311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c64aaa3b-fdf0-43aa-956f-d0bba8ee1f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.183624 Oct 28 20:06:10.061913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 50/100] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:09 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:10.295287 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c7d97ad7-c890-479f-a2fd-6a1d4d8dcc2e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:10.295967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c7d97ad7-c890-479f-a2fd-6a1d4d8dcc2e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:10.302591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d97ad7-c890-479f-a2fd-6a1d4d8dcc2e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:10.303129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d97ad7-c890-479f-a2fd-6a1d4d8dcc2e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:10.303624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d97ad7-c890-479f-a2fd-6a1d4d8dcc2e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:10.304303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d97ad7-c890-479f-a2fd-6a1d4d8dcc2e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:10.304753 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d97ad7-c890-479f-a2fd-6a1d4d8dcc2e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:10.305176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d97ad7-c890-479f-a2fd-6a1d4d8dcc2e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:10.489104 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-63f9927f-7ff3-492b-b9f9-a1f353b377ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:10.489811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-63f9927f-7ff3-492b-b9f9-a1f353b377ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:10.516026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63f9927f-7ff3-492b-b9f9-a1f353b377ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:10.516604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63f9927f-7ff3-492b-b9f9-a1f353b377ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:10.516939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63f9927f-7ff3-492b-b9f9-a1f353b377ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:10.522601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63f9927f-7ff3-492b-b9f9-a1f353b377ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:10.531885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63f9927f-7ff3-492b-b9f9-a1f353b377ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:10.532472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63f9927f-7ff3-492b-b9f9-a1f353b377ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:10.676501 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c7d97ad7-c890-479f-a2fd-6a1d4d8dcc2e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:10.684167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c7d97ad7-c890-479f-a2fd-6a1d4d8dcc2e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.393164 Oct 28 20:06:10.684911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 51/101] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:10 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:10.869019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-63f9927f-7ff3-492b-b9f9-a1f353b377ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:10.885628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-63f9927f-7ff3-492b-b9f9-a1f353b377ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.400465 Oct 28 20:06:10.886577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 51/102] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:10 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:10.902846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e9efc3f8-78df-49a9-928d-37081f3c345f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:10.904197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e9efc3f8-78df-49a9-928d-37081f3c345f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:10.910261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9efc3f8-78df-49a9-928d-37081f3c345f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:10.910749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9efc3f8-78df-49a9-928d-37081f3c345f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:10.911191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9efc3f8-78df-49a9-928d-37081f3c345f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:10.911895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9efc3f8-78df-49a9-928d-37081f3c345f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:10.912354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9efc3f8-78df-49a9-928d-37081f3c345f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:10.912800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9efc3f8-78df-49a9-928d-37081f3c345f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:10.930705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:10.946574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-46cd196b-18e2-4934-8ede-da7f61da886c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:10.947193 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-46cd196b-18e2-4934-8ede-da7f61da886c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:10.953978 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46cd196b-18e2-4934-8ede-da7f61da886c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:10.954468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46cd196b-18e2-4934-8ede-da7f61da886c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:10.954907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46cd196b-18e2-4934-8ede-da7f61da886c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:10.955600 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46cd196b-18e2-4934-8ede-da7f61da886c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:10.956486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46cd196b-18e2-4934-8ede-da7f61da886c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:10.956917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46cd196b-18e2-4934-8ede-da7f61da886c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:11.219392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e9efc3f8-78df-49a9-928d-37081f3c345f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:11.227134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e9efc3f8-78df-49a9-928d-37081f3c345f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.344110 Oct 28 20:06:11.227912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 52/103] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:10 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:11.233728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0d9acef-22ac-431e-9b2e-376c601124f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:11.234728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0d9acef-22ac-431e-9b2e-376c601124f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:11.242650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0d9acef-22ac-431e-9b2e-376c601124f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:11.243358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0d9acef-22ac-431e-9b2e-376c601124f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:11.243801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-46cd196b-18e2-4934-8ede-da7f61da886c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:11.244266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0d9acef-22ac-431e-9b2e-376c601124f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:11.245134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0d9acef-22ac-431e-9b2e-376c601124f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:11.245634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0d9acef-22ac-431e-9b2e-376c601124f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:11.246210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0d9acef-22ac-431e-9b2e-376c601124f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:11.255536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-46cd196b-18e2-4934-8ede-da7f61da886c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.312745 Oct 28 20:06:11.265680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 52/104] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:10 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:11.452975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-430f7544-750d-4028-ae09-8532a6fca0d0 req-9e351753-3715-4bc2-8900-4675f2ba5934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e147ba2-cd15-490e-aac0-236beaf41e8d", "tag": "6cbf02ec-6953-458c-9564-3dba0bc9146a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:11.467914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-430f7544-750d-4028-ae09-8532a6fca0d0 req-9e351753-3715-4bc2-8900-4675f2ba5934 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:11.468784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-430f7544-750d-4028-ae09-8532a6fca0d0 req-9e351753-3715-4bc2-8900-4675f2ba5934 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:11.469486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-430f7544-750d-4028-ae09-8532a6fca0d0 req-9e351753-3715-4bc2-8900-4675f2ba5934 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:11.491107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-430f7544-750d-4028-ae09-8532a6fca0d0 req-9e351753-3715-4bc2-8900-4675f2ba5934 service nova] Creating event network-changed:6cbf02ec-6953-458c-9564-3dba0bc9146a for instance 0e147ba2-cd15-490e-aac0-236beaf41e8d on hv-cinder-86236 Oct 28 20:06:11.491632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-430f7544-750d-4028-ae09-8532a6fca0d0 req-9e351753-3715-4bc2-8900-4675f2ba5934 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 20:06:11.492021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-430f7544-750d-4028-ae09-8532a6fca0d0 req-9e351753-3715-4bc2-8900-4675f2ba5934 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 20:06:11.493233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9b4738-7dc2-41f5-98cf-b950dc90308a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:11.493746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9b4738-7dc2-41f5-98cf-b950dc90308a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:11.494809 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9b4738-7dc2-41f5-98cf-b950dc90308a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:11.495534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9b4738-7dc2-41f5-98cf-b950dc90308a None None] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:11.496016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9b4738-7dc2-41f5-98cf-b950dc90308a None None] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:11.496421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9b4738-7dc2-41f5-98cf-b950dc90308a None None] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:11.506260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.compute.rpcapi [None req-ca9b4738-7dc2-41f5-98cf-b950dc90308a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 28 20:06:11.507413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9b4738-7dc2-41f5-98cf-b950dc90308a None None] Releasing lock "compute-rpcapi-router" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 20:06:11.527291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ca9b4738-7dc2-41f5-98cf-b950dc90308a None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077850 Oct 28 20:06:11.527917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 53/105] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:06:11.709158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cec8cb0f-193c-42b7-a087-96ebe0d0298f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:11.744538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cec8cb0f-193c-42b7-a087-96ebe0d0298f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:11.744538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec8cb0f-193c-42b7-a087-96ebe0d0298f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:11.744538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec8cb0f-193c-42b7-a087-96ebe0d0298f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:11.744538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec8cb0f-193c-42b7-a087-96ebe0d0298f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:11.744798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec8cb0f-193c-42b7-a087-96ebe0d0298f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:11.744798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec8cb0f-193c-42b7-a087-96ebe0d0298f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:11.744798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec8cb0f-193c-42b7-a087-96ebe0d0298f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:11.999251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0d9acef-22ac-431e-9b2e-376c601124f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:12.008287 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0d9acef-22ac-431e-9b2e-376c601124f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:12.015588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0d9acef-22ac-431e-9b2e-376c601124f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:12.017247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0d9acef-22ac-431e-9b2e-376c601124f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.787317 Oct 28 20:06:12.018079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 53/106] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:11 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:12.041675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5171ed61-8921-4360-a8ce-2e694f1a14fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:12.042480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5171ed61-8921-4360-a8ce-2e694f1a14fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:12.049557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5171ed61-8921-4360-a8ce-2e694f1a14fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:12.050352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5171ed61-8921-4360-a8ce-2e694f1a14fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:12.050889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5171ed61-8921-4360-a8ce-2e694f1a14fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:12.051907 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5171ed61-8921-4360-a8ce-2e694f1a14fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:12.052438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5171ed61-8921-4360-a8ce-2e694f1a14fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:12.052939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5171ed61-8921-4360-a8ce-2e694f1a14fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:12.123511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cec8cb0f-193c-42b7-a087-96ebe0d0298f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:12.131328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cec8cb0f-193c-42b7-a087-96ebe0d0298f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.426843 Oct 28 20:06:12.131907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 54/107] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:11 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:12.261237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-604a22a3-f28b-4c39-9f23-f2bee90b0b20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:12.261237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-604a22a3-f28b-4c39-9f23-f2bee90b0b20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:12.261943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-604a22a3-f28b-4c39-9f23-f2bee90b0b20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:12.262170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-604a22a3-f28b-4c39-9f23-f2bee90b0b20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:12.263375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-604a22a3-f28b-4c39-9f23-f2bee90b0b20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:12.264340 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-604a22a3-f28b-4c39-9f23-f2bee90b0b20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:12.264957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-604a22a3-f28b-4c39-9f23-f2bee90b0b20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:12.265567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-604a22a3-f28b-4c39-9f23-f2bee90b0b20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:12.431167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5171ed61-8921-4360-a8ce-2e694f1a14fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:12.440385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5171ed61-8921-4360-a8ce-2e694f1a14fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.406455 Oct 28 20:06:12.441086 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 54/108] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:12 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:12.461184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2b354665-9a20-407a-a7a9-b591ba930260 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:12.461844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2b354665-9a20-407a-a7a9-b591ba930260 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:12.468537 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b354665-9a20-407a-a7a9-b591ba930260 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:12.469056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b354665-9a20-407a-a7a9-b591ba930260 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:12.475445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b354665-9a20-407a-a7a9-b591ba930260 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:12.475445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b354665-9a20-407a-a7a9-b591ba930260 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:12.475445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b354665-9a20-407a-a7a9-b591ba930260 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:12.475445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b354665-9a20-407a-a7a9-b591ba930260 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:12.571047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-604a22a3-f28b-4c39-9f23-f2bee90b0b20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:12.582952 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-604a22a3-f28b-4c39-9f23-f2bee90b0b20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.333924 Oct 28 20:06:12.583637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 55/109] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:12 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:12.702034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2b354665-9a20-407a-a7a9-b591ba930260 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:12.709951 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2b354665-9a20-407a-a7a9-b591ba930260 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.255577 Oct 28 20:06:12.710520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 55/110] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:12 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:12.789601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-790212a4-89a4-4b30-bb76-1fa809be4e39 req-d1ef7728-f002-4981-9a01-8f15acbdbd39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7582188f-bfab-4218-9104-9fb384141c57", "tag": "ade7b021-b99e-4c55-93bb-537d28c2a53d"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:12.800818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-790212a4-89a4-4b30-bb76-1fa809be4e39 req-d1ef7728-f002-4981-9a01-8f15acbdbd39 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:12.801484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-790212a4-89a4-4b30-bb76-1fa809be4e39 req-d1ef7728-f002-4981-9a01-8f15acbdbd39 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:12.809739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-790212a4-89a4-4b30-bb76-1fa809be4e39 req-d1ef7728-f002-4981-9a01-8f15acbdbd39 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:12.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-790212a4-89a4-4b30-bb76-1fa809be4e39 req-d1ef7728-f002-4981-9a01-8f15acbdbd39 service nova] Creating event network-changed:ade7b021-b99e-4c55-93bb-537d28c2a53d for instance 7582188f-bfab-4218-9104-9fb384141c57 on hv-cinder-86236 Oct 28 20:06:12.823004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-790212a4-89a4-4b30-bb76-1fa809be4e39 req-d1ef7728-f002-4981-9a01-8f15acbdbd39 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037096 Oct 28 20:06:12.823792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 56/111] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:13.049152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-80f514cc-9091-4d2a-a6a3-5f495785fafd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:13.049666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-80f514cc-9091-4d2a-a6a3-5f495785fafd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:13.055705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f514cc-9091-4d2a-a6a3-5f495785fafd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:13.056192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f514cc-9091-4d2a-a6a3-5f495785fafd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:13.056734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f514cc-9091-4d2a-a6a3-5f495785fafd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:13.057452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f514cc-9091-4d2a-a6a3-5f495785fafd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:13.057911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f514cc-9091-4d2a-a6a3-5f495785fafd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:13.058333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f514cc-9091-4d2a-a6a3-5f495785fafd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:13.156347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-09a2d6fc-47b8-419f-8183-3db9b5253e83 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:13.157056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-09a2d6fc-47b8-419f-8183-3db9b5253e83 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:13.165388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09a2d6fc-47b8-419f-8183-3db9b5253e83 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:13.166215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09a2d6fc-47b8-419f-8183-3db9b5253e83 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:13.166666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09a2d6fc-47b8-419f-8183-3db9b5253e83 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:13.167370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09a2d6fc-47b8-419f-8183-3db9b5253e83 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:13.167828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09a2d6fc-47b8-419f-8183-3db9b5253e83 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:13.168257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09a2d6fc-47b8-419f-8183-3db9b5253e83 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:13.272984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-80f514cc-9091-4d2a-a6a3-5f495785fafd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:13.282620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-80f514cc-9091-4d2a-a6a3-5f495785fafd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:13.289847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-80f514cc-9091-4d2a-a6a3-5f495785fafd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:13.291089 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-80f514cc-9091-4d2a-a6a3-5f495785fafd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.246399 Oct 28 20:06:13.291888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 56/112] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:13 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:13.352499 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-09a2d6fc-47b8-419f-8183-3db9b5253e83 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:13.360383 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-09a2d6fc-47b8-419f-8183-3db9b5253e83 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.209435 Oct 28 20:06:13.360970 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 57/113] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:13 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:13.467712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-469e0a59-a422-4971-8a75-81f6a50e677f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:13.468316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-469e0a59-a422-4971-8a75-81f6a50e677f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:13.474147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469e0a59-a422-4971-8a75-81f6a50e677f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:13.474622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469e0a59-a422-4971-8a75-81f6a50e677f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:13.475053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469e0a59-a422-4971-8a75-81f6a50e677f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:13.475729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469e0a59-a422-4971-8a75-81f6a50e677f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:13.476175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469e0a59-a422-4971-8a75-81f6a50e677f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:13.476604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469e0a59-a422-4971-8a75-81f6a50e677f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:13.609647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-06fff895-8e8d-4090-8ead-0520420a631f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:13.610258 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-06fff895-8e8d-4090-8ead-0520420a631f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:13.614462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-469e0a59-a422-4971-8a75-81f6a50e677f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:13.619480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06fff895-8e8d-4090-8ead-0520420a631f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:13.619480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06fff895-8e8d-4090-8ead-0520420a631f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:13.619480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06fff895-8e8d-4090-8ead-0520420a631f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:13.619480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06fff895-8e8d-4090-8ead-0520420a631f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:13.619786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06fff895-8e8d-4090-8ead-0520420a631f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:13.619786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06fff895-8e8d-4090-8ead-0520420a631f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:13.623236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-469e0a59-a422-4971-8a75-81f6a50e677f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.159498 Oct 28 20:06:13.623814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 57/114] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:13 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:13.733202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-285d417a-58c9-43e6-9ef0-0e72f578b44a tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:13.733769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-285d417a-58c9-43e6-9ef0-0e72f578b44a tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:13.740417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-285d417a-58c9-43e6-9ef0-0e72f578b44a tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:13.740891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-285d417a-58c9-43e6-9ef0-0e72f578b44a tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:13.741354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-285d417a-58c9-43e6-9ef0-0e72f578b44a tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:13.742136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-285d417a-58c9-43e6-9ef0-0e72f578b44a tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:13.742529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-285d417a-58c9-43e6-9ef0-0e72f578b44a tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:13.742956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-285d417a-58c9-43e6-9ef0-0e72f578b44a tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:13.761138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-06fff895-8e8d-4090-8ead-0520420a631f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:13.774388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-06fff895-8e8d-4090-8ead-0520420a631f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.166829 Oct 28 20:06:13.774388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 58/115] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:13 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:13.892083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-285d417a-58c9-43e6-9ef0-0e72f578b44a tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:13.899989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-285d417a-58c9-43e6-9ef0-0e72f578b44a tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.170830 Oct 28 20:06:13.900756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 58/116] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:13 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:14.316082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8aa2b214-cfce-40ef-b4e4-2fd9c049834e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:14.316947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8aa2b214-cfce-40ef-b4e4-2fd9c049834e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:14.323738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8aa2b214-cfce-40ef-b4e4-2fd9c049834e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:14.324233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8aa2b214-cfce-40ef-b4e4-2fd9c049834e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:14.324672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8aa2b214-cfce-40ef-b4e4-2fd9c049834e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:14.326242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8aa2b214-cfce-40ef-b4e4-2fd9c049834e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:14.326888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8aa2b214-cfce-40ef-b4e4-2fd9c049834e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:14.327467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8aa2b214-cfce-40ef-b4e4-2fd9c049834e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:14.384867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bd7a766e-8033-47b7-a3b6-5d1e98f1abba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:14.386413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bd7a766e-8033-47b7-a3b6-5d1e98f1abba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:14.399691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd7a766e-8033-47b7-a3b6-5d1e98f1abba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:14.399691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd7a766e-8033-47b7-a3b6-5d1e98f1abba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:14.399691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd7a766e-8033-47b7-a3b6-5d1e98f1abba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:14.399691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd7a766e-8033-47b7-a3b6-5d1e98f1abba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:14.400277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd7a766e-8033-47b7-a3b6-5d1e98f1abba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:14.400277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd7a766e-8033-47b7-a3b6-5d1e98f1abba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:14.542173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8aa2b214-cfce-40ef-b4e4-2fd9c049834e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:14.551251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8aa2b214-cfce-40ef-b4e4-2fd9c049834e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:14.553014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8aa2b214-cfce-40ef-b4e4-2fd9c049834e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:14.554222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8aa2b214-cfce-40ef-b4e4-2fd9c049834e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.242138 Oct 28 20:06:14.554769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 59/117] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:14 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:14.571524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bd7a766e-8033-47b7-a3b6-5d1e98f1abba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:14.580134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bd7a766e-8033-47b7-a3b6-5d1e98f1abba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.200387 Oct 28 20:06:14.580699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 59/118] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:14 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:14.647210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b06db158-1bda-4a09-bc14-59b0d071450b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:14.648570 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b06db158-1bda-4a09-bc14-59b0d071450b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:14.654734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b06db158-1bda-4a09-bc14-59b0d071450b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:14.655147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b06db158-1bda-4a09-bc14-59b0d071450b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:14.655620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b06db158-1bda-4a09-bc14-59b0d071450b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:14.656294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b06db158-1bda-4a09-bc14-59b0d071450b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:14.656743 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b06db158-1bda-4a09-bc14-59b0d071450b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:14.657238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b06db158-1bda-4a09-bc14-59b0d071450b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:14.790382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b06db158-1bda-4a09-bc14-59b0d071450b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:14.795812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84f89a02-8dc9-49d2-802b-c6654500ea00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:14.796461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-84f89a02-8dc9-49d2-802b-c6654500ea00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:14.802049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b06db158-1bda-4a09-bc14-59b0d071450b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.158576 Oct 28 20:06:14.802623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 60/119] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:14 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:14.803514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f89a02-8dc9-49d2-802b-c6654500ea00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:14.804276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f89a02-8dc9-49d2-802b-c6654500ea00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:14.804991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f89a02-8dc9-49d2-802b-c6654500ea00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:14.805713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f89a02-8dc9-49d2-802b-c6654500ea00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:14.806328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f89a02-8dc9-49d2-802b-c6654500ea00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:14.806755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f89a02-8dc9-49d2-802b-c6654500ea00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:14.925745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9a439959-5e1c-47f4-b528-297135120726 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:14.926443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9a439959-5e1c-47f4-b528-297135120726 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:14.932803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a439959-5e1c-47f4-b528-297135120726 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:14.933434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a439959-5e1c-47f4-b528-297135120726 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:14.933941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a439959-5e1c-47f4-b528-297135120726 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:14.935436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a439959-5e1c-47f4-b528-297135120726 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:14.936025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a439959-5e1c-47f4-b528-297135120726 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:14.936523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a439959-5e1c-47f4-b528-297135120726 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:14.958222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-84f89a02-8dc9-49d2-802b-c6654500ea00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:14.967453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-84f89a02-8dc9-49d2-802b-c6654500ea00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.175586 Oct 28 20:06:14.968271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 60/120] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:14 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:15.089609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9a439959-5e1c-47f4-b528-297135120726 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:15.101642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9a439959-5e1c-47f4-b528-297135120726 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.180504 Oct 28 20:06:15.102502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 61/121] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:14 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:15.580904 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c4a37bb2-5ef6-42c2-875f-95e7482ad065 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:15.581811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c4a37bb2-5ef6-42c2-875f-95e7482ad065 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:15.590122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4a37bb2-5ef6-42c2-875f-95e7482ad065 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:15.590646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4a37bb2-5ef6-42c2-875f-95e7482ad065 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:15.591170 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4a37bb2-5ef6-42c2-875f-95e7482ad065 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:15.591770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4a37bb2-5ef6-42c2-875f-95e7482ad065 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:15.592225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4a37bb2-5ef6-42c2-875f-95e7482ad065 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:15.592648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4a37bb2-5ef6-42c2-875f-95e7482ad065 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:15.604594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c6315fc7-1df2-430a-9313-600fb2e7fcd9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:15.605803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c6315fc7-1df2-430a-9313-600fb2e7fcd9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:15.615018 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6315fc7-1df2-430a-9313-600fb2e7fcd9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:15.615510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6315fc7-1df2-430a-9313-600fb2e7fcd9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:15.616123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6315fc7-1df2-430a-9313-600fb2e7fcd9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:15.617462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6315fc7-1df2-430a-9313-600fb2e7fcd9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:15.623090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6315fc7-1df2-430a-9313-600fb2e7fcd9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:15.624274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6315fc7-1df2-430a-9313-600fb2e7fcd9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:15.826102 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c4a37bb2-5ef6-42c2-875f-95e7482ad065 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:15.831869 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c6315fc7-1df2-430a-9313-600fb2e7fcd9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:15.836584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c4a37bb2-5ef6-42c2-875f-95e7482ad065 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:15.840021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c6315fc7-1df2-430a-9313-600fb2e7fcd9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.240174 Oct 28 20:06:15.853349 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c4a37bb2-5ef6-42c2-875f-95e7482ad065 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:15.853349 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c4a37bb2-5ef6-42c2-875f-95e7482ad065 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.266628 Oct 28 20:06:15.854115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 62/122] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:15 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:15.858399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 61/123] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:15 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:15.862319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-84105149-9a9c-4ce9-b2cd-274c5eaa2990 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:15.863318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-84105149-9a9c-4ce9-b2cd-274c5eaa2990 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:15.870287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84105149-9a9c-4ce9-b2cd-274c5eaa2990 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:15.870961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84105149-9a9c-4ce9-b2cd-274c5eaa2990 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:15.872728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84105149-9a9c-4ce9-b2cd-274c5eaa2990 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:15.873717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84105149-9a9c-4ce9-b2cd-274c5eaa2990 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:15.874316 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84105149-9a9c-4ce9-b2cd-274c5eaa2990 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:15.874881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84105149-9a9c-4ce9-b2cd-274c5eaa2990 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:15.991464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d5dd9551-f545-47ba-b8c2-ee8cfadfba09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:15.992076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d5dd9551-f545-47ba-b8c2-ee8cfadfba09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:15.999049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5dd9551-f545-47ba-b8c2-ee8cfadfba09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:15.999954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5dd9551-f545-47ba-b8c2-ee8cfadfba09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:16.000818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5dd9551-f545-47ba-b8c2-ee8cfadfba09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:16.001709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5dd9551-f545-47ba-b8c2-ee8cfadfba09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:16.002378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5dd9551-f545-47ba-b8c2-ee8cfadfba09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:16.002947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5dd9551-f545-47ba-b8c2-ee8cfadfba09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:16.106816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-84105149-9a9c-4ce9-b2cd-274c5eaa2990 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:16.118019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-84105149-9a9c-4ce9-b2cd-274c5eaa2990 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.262605 Oct 28 20:06:16.121900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 63/124] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:15 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:16.128042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-903d9ead-2098-44d5-a269-94ca5514a183 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:16.129501 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-903d9ead-2098-44d5-a269-94ca5514a183 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:16.138390 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-903d9ead-2098-44d5-a269-94ca5514a183 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:16.139249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-903d9ead-2098-44d5-a269-94ca5514a183 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:16.140515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-903d9ead-2098-44d5-a269-94ca5514a183 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:16.141504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-903d9ead-2098-44d5-a269-94ca5514a183 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:16.142136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-903d9ead-2098-44d5-a269-94ca5514a183 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:16.143343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-903d9ead-2098-44d5-a269-94ca5514a183 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:16.186305 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d5dd9551-f545-47ba-b8c2-ee8cfadfba09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:16.197148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d5dd9551-f545-47ba-b8c2-ee8cfadfba09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.207327 Oct 28 20:06:16.198128 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 62/125] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:15 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:16.315632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-903d9ead-2098-44d5-a269-94ca5514a183 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:16.324695 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-903d9ead-2098-44d5-a269-94ca5514a183 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.201596 Oct 28 20:06:16.326654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 64/126] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:16 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:16.866013 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-120a713c-7b53-4043-9b10-8c8270fb1d42 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:16.866839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-120a713c-7b53-4043-9b10-8c8270fb1d42 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:16.873922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-120a713c-7b53-4043-9b10-8c8270fb1d42 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:16.874739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-120a713c-7b53-4043-9b10-8c8270fb1d42 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:16.875408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-da2721bf-a9c7-417a-972f-4cd2e578c7b0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:16.876039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-da2721bf-a9c7-417a-972f-4cd2e578c7b0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:16.876293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-120a713c-7b53-4043-9b10-8c8270fb1d42 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:16.877272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-120a713c-7b53-4043-9b10-8c8270fb1d42 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:16.877993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-120a713c-7b53-4043-9b10-8c8270fb1d42 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:16.878637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-120a713c-7b53-4043-9b10-8c8270fb1d42 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:16.885538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da2721bf-a9c7-417a-972f-4cd2e578c7b0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:16.889052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da2721bf-a9c7-417a-972f-4cd2e578c7b0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:16.889052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da2721bf-a9c7-417a-972f-4cd2e578c7b0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:16.889052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da2721bf-a9c7-417a-972f-4cd2e578c7b0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:16.889501 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da2721bf-a9c7-417a-972f-4cd2e578c7b0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:16.890152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da2721bf-a9c7-417a-972f-4cd2e578c7b0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:17.098209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-da2721bf-a9c7-417a-972f-4cd2e578c7b0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:17.101936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:17.105673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-120a713c-7b53-4043-9b10-8c8270fb1d42 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:17.110746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-da2721bf-a9c7-417a-972f-4cd2e578c7b0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:17.112299 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-da2721bf-a9c7-417a-972f-4cd2e578c7b0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:17.116172 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-120a713c-7b53-4043-9b10-8c8270fb1d42 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.253906 Oct 28 20:06:17.117075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 63/127] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:16 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:17.126344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-da2721bf-a9c7-417a-972f-4cd2e578c7b0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.250953 Oct 28 20:06:17.126344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 65/128] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:16 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:06:17.150331 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6c8c00dc-cf83-40c2-bf64-e2b4bf140e1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:17.151103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6c8c00dc-cf83-40c2-bf64-e2b4bf140e1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:17.157248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c8c00dc-cf83-40c2-bf64-e2b4bf140e1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:17.157948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c8c00dc-cf83-40c2-bf64-e2b4bf140e1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:17.158557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c8c00dc-cf83-40c2-bf64-e2b4bf140e1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:17.159576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c8c00dc-cf83-40c2-bf64-e2b4bf140e1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:17.160178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c8c00dc-cf83-40c2-bf64-e2b4bf140e1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:17.160905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c8c00dc-cf83-40c2-bf64-e2b4bf140e1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:17.223150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dae66ec7-2f2b-4abd-b464-db48e768aed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:17.224212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dae66ec7-2f2b-4abd-b464-db48e768aed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:17.230877 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dae66ec7-2f2b-4abd-b464-db48e768aed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:17.232326 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dae66ec7-2f2b-4abd-b464-db48e768aed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:17.232759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dae66ec7-2f2b-4abd-b464-db48e768aed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:17.233552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dae66ec7-2f2b-4abd-b464-db48e768aed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:17.234216 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dae66ec7-2f2b-4abd-b464-db48e768aed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:17.234635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dae66ec7-2f2b-4abd-b464-db48e768aed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:17.378425 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6c8c00dc-cf83-40c2-bf64-e2b4bf140e1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:17.386954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6c8c00dc-cf83-40c2-bf64-e2b4bf140e1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.241619 Oct 28 20:06:17.387772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 64/129] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:17 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:17.392946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5005ed9c-d2fb-49a1-a8bc-3a6d550ccecb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:17.393737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5005ed9c-d2fb-49a1-a8bc-3a6d550ccecb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:17.400517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5005ed9c-d2fb-49a1-a8bc-3a6d550ccecb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:17.401005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5005ed9c-d2fb-49a1-a8bc-3a6d550ccecb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:17.401706 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5005ed9c-d2fb-49a1-a8bc-3a6d550ccecb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:17.402555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5005ed9c-d2fb-49a1-a8bc-3a6d550ccecb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:17.403851 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5005ed9c-d2fb-49a1-a8bc-3a6d550ccecb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:17.404688 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5005ed9c-d2fb-49a1-a8bc-3a6d550ccecb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:17.413042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dae66ec7-2f2b-4abd-b464-db48e768aed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:17.421095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dae66ec7-2f2b-4abd-b464-db48e768aed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.201590 Oct 28 20:06:17.421701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 66/130] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:17 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:17.766927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5005ed9c-d2fb-49a1-a8bc-3a6d550ccecb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:17.774952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5005ed9c-d2fb-49a1-a8bc-3a6d550ccecb tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.385588 Oct 28 20:06:17.775737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 65/131] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:17 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:18.151013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-65a74b39-ad82-4b3b-b649-be59e731bff7 req-bbc821be-df6a-4293-bb00-6885324667d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e31cf1aa-d94a-4bda-aa9c-1119bfb932bb", "name": "network-vif-plugged", "status": "completed", "tag": "94c8fbd6-55bd-42ab-9636-b03f381a547b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:18.155744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ce67a6a-a38e-41de-9c7e-b725c6da2082 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:18.156822 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5ce67a6a-a38e-41de-9c7e-b725c6da2082 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:18.164969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce67a6a-a38e-41de-9c7e-b725c6da2082 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:18.164969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce67a6a-a38e-41de-9c7e-b725c6da2082 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:18.164969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce67a6a-a38e-41de-9c7e-b725c6da2082 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:18.165229 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-65a74b39-ad82-4b3b-b649-be59e731bff7 req-bbc821be-df6a-4293-bb00-6885324667d9 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:18.165338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce67a6a-a38e-41de-9c7e-b725c6da2082 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:18.165488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-65a74b39-ad82-4b3b-b649-be59e731bff7 req-bbc821be-df6a-4293-bb00-6885324667d9 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:18.165621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce67a6a-a38e-41de-9c7e-b725c6da2082 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:18.166029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce67a6a-a38e-41de-9c7e-b725c6da2082 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:18.166485 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-65a74b39-ad82-4b3b-b649-be59e731bff7 req-bbc821be-df6a-4293-bb00-6885324667d9 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:18.181669 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-65a74b39-ad82-4b3b-b649-be59e731bff7 req-bbc821be-df6a-4293-bb00-6885324667d9 service nova] Creating event network-vif-plugged:94c8fbd6-55bd-42ab-9636-b03f381a547b for instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb on hv-cinder-86236 Oct 28 20:06:18.190656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-65a74b39-ad82-4b3b-b649-be59e731bff7 req-bbc821be-df6a-4293-bb00-6885324667d9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222223 Oct 28 20:06:18.199572 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 67/132] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:18.202660 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d2cc544e-37ac-4521-87f5-e969d2e51ce6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:18.204152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d2cc544e-37ac-4521-87f5-e969d2e51ce6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:18.214107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2cc544e-37ac-4521-87f5-e969d2e51ce6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:18.214907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2cc544e-37ac-4521-87f5-e969d2e51ce6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:18.215662 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2cc544e-37ac-4521-87f5-e969d2e51ce6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:18.216808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2cc544e-37ac-4521-87f5-e969d2e51ce6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:18.228770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2cc544e-37ac-4521-87f5-e969d2e51ce6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:18.232602 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2cc544e-37ac-4521-87f5-e969d2e51ce6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:18.591900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5ce67a6a-a38e-41de-9c7e-b725c6da2082 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:18.609069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5ce67a6a-a38e-41de-9c7e-b725c6da2082 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:18.611315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5ce67a6a-a38e-41de-9c7e-b725c6da2082 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:18.613719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d2cc544e-37ac-4521-87f5-e969d2e51ce6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:18.621545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5ce67a6a-a38e-41de-9c7e-b725c6da2082 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.465157 Oct 28 20:06:18.623187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d2cc544e-37ac-4521-87f5-e969d2e51ce6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.425630 Oct 28 20:06:18.623955 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 66/133] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:18 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:06:18.625375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 68/134] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:18 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:18.645065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d2d1fb77-ca71-45fd-902c-b5c5986dfc5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:18.647377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d2d1fb77-ca71-45fd-902c-b5c5986dfc5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:18.650917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a5d7b9a1-e0f3-4389-980d-12e451a1c0b9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:18.651490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a5d7b9a1-e0f3-4389-980d-12e451a1c0b9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:18.662743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2d1fb77-ca71-45fd-902c-b5c5986dfc5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:18.667269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2d1fb77-ca71-45fd-902c-b5c5986dfc5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:18.667269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2d1fb77-ca71-45fd-902c-b5c5986dfc5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:18.669358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5d7b9a1-e0f3-4389-980d-12e451a1c0b9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:18.670308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5d7b9a1-e0f3-4389-980d-12e451a1c0b9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:18.673054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5d7b9a1-e0f3-4389-980d-12e451a1c0b9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:18.674939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2d1fb77-ca71-45fd-902c-b5c5986dfc5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:18.675069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5d7b9a1-e0f3-4389-980d-12e451a1c0b9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:18.675546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5d7b9a1-e0f3-4389-980d-12e451a1c0b9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:18.675985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5d7b9a1-e0f3-4389-980d-12e451a1c0b9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:18.676168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2d1fb77-ca71-45fd-902c-b5c5986dfc5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:18.676787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2d1fb77-ca71-45fd-902c-b5c5986dfc5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:19.017593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d2d1fb77-ca71-45fd-902c-b5c5986dfc5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:19.020807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a5d7b9a1-e0f3-4389-980d-12e451a1c0b9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:19.025536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d2d1fb77-ca71-45fd-902c-b5c5986dfc5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.399930 Oct 28 20:06:19.037719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 67/135] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:18 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:19.037719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-19e6d8d0-93aa-44d5-91c5-7578b127d140 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:19.037719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-19e6d8d0-93aa-44d5-91c5-7578b127d140 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:19.038585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a5d7b9a1-e0f3-4389-980d-12e451a1c0b9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.392679 Oct 28 20:06:19.038585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 69/136] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:18 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:19.038761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19e6d8d0-93aa-44d5-91c5-7578b127d140 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:19.038761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19e6d8d0-93aa-44d5-91c5-7578b127d140 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:19.038761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19e6d8d0-93aa-44d5-91c5-7578b127d140 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:19.039417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19e6d8d0-93aa-44d5-91c5-7578b127d140 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:19.039931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19e6d8d0-93aa-44d5-91c5-7578b127d140 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:19.040358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19e6d8d0-93aa-44d5-91c5-7578b127d140 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:19.276944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-19e6d8d0-93aa-44d5-91c5-7578b127d140 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:19.285894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-19e6d8d0-93aa-44d5-91c5-7578b127d140 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.258773 Oct 28 20:06:19.286470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 68/137] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:19 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:19.649524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d56449ca-0270-4415-b0d7-137e429c6115 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:19.653834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d67a5d14-0ab0-4397-8e23-d91234512099 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:19.655260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d56449ca-0270-4415-b0d7-137e429c6115 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:19.657764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d67a5d14-0ab0-4397-8e23-d91234512099 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:19.667665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d67a5d14-0ab0-4397-8e23-d91234512099 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:19.673274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56449ca-0270-4415-b0d7-137e429c6115 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:19.673274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56449ca-0270-4415-b0d7-137e429c6115 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:19.673653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d67a5d14-0ab0-4397-8e23-d91234512099 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:19.673653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d67a5d14-0ab0-4397-8e23-d91234512099 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:19.673653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d67a5d14-0ab0-4397-8e23-d91234512099 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:19.673653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d67a5d14-0ab0-4397-8e23-d91234512099 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:19.673926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56449ca-0270-4415-b0d7-137e429c6115 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:19.674337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56449ca-0270-4415-b0d7-137e429c6115 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:19.674827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56449ca-0270-4415-b0d7-137e429c6115 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:19.675249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56449ca-0270-4415-b0d7-137e429c6115 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:19.679539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:19.680119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d67a5d14-0ab0-4397-8e23-d91234512099 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:19.905980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d67a5d14-0ab0-4397-8e23-d91234512099 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:19.917187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d67a5d14-0ab0-4397-8e23-d91234512099 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:19.920569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d67a5d14-0ab0-4397-8e23-d91234512099 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:19.921759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d67a5d14-0ab0-4397-8e23-d91234512099 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.277345 Oct 28 20:06:19.929467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 70/138] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:19 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:19.932659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d56449ca-0270-4415-b0d7-137e429c6115 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:19.947144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d56449ca-0270-4415-b0d7-137e429c6115 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.300225 Oct 28 20:06:19.947144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 69/139] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:19 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:20.052723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-63108ca6-bc78-4e8f-b78f-9cb4643061a4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:20.053353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-63108ca6-bc78-4e8f-b78f-9cb4643061a4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:20.061630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63108ca6-bc78-4e8f-b78f-9cb4643061a4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:20.061793 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7d489ac0-54b0-4304-a786-02842175508f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:20.062129 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63108ca6-bc78-4e8f-b78f-9cb4643061a4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:20.062460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7d489ac0-54b0-4304-a786-02842175508f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:20.062607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63108ca6-bc78-4e8f-b78f-9cb4643061a4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:20.063407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63108ca6-bc78-4e8f-b78f-9cb4643061a4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:20.063878 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63108ca6-bc78-4e8f-b78f-9cb4643061a4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:20.064307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63108ca6-bc78-4e8f-b78f-9cb4643061a4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:20.066046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:20.072301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d489ac0-54b0-4304-a786-02842175508f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:20.073003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d489ac0-54b0-4304-a786-02842175508f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:20.073468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d489ac0-54b0-4304-a786-02842175508f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:20.077623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d489ac0-54b0-4304-a786-02842175508f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:20.077623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d489ac0-54b0-4304-a786-02842175508f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:20.077623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d489ac0-54b0-4304-a786-02842175508f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:20.274312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-63108ca6-bc78-4e8f-b78f-9cb4643061a4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:20.281532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7d489ac0-54b0-4304-a786-02842175508f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:20.290247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-63108ca6-bc78-4e8f-b78f-9cb4643061a4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.241361 Oct 28 20:06:20.294189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 71/140] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:20 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:20.301780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-4f0c206e-4dd7-4907-889b-b0453aeccf9f req-145c7770-4db6-4b32-964c-8097a37863cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e927409-017d-4d1b-9028-4b1ad64d9744", "name": "network-vif-plugged", "status": "completed", "tag": "82ea1ef3-ed28-48ca-8041-9192ffe5d711"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:20.303925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7d489ac0-54b0-4304-a786-02842175508f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.246674 Oct 28 20:06:20.305201 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 70/141] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:20 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:20.311614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8a11154a-d9ea-4181-9cd4-85c205a873de tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:20.312755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8a11154a-d9ea-4181-9cd4-85c205a873de tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:20.317458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4f0c206e-4dd7-4907-889b-b0453aeccf9f req-145c7770-4db6-4b32-964c-8097a37863cc service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:20.318041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4f0c206e-4dd7-4907-889b-b0453aeccf9f req-145c7770-4db6-4b32-964c-8097a37863cc service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:20.318623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4f0c206e-4dd7-4907-889b-b0453aeccf9f req-145c7770-4db6-4b32-964c-8097a37863cc service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:20.329231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a11154a-d9ea-4181-9cd4-85c205a873de tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:20.329879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a11154a-d9ea-4181-9cd4-85c205a873de tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:20.330317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a11154a-d9ea-4181-9cd4-85c205a873de tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:20.331054 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a11154a-d9ea-4181-9cd4-85c205a873de tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:20.339192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a11154a-d9ea-4181-9cd4-85c205a873de tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:20.339436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-4f0c206e-4dd7-4907-889b-b0453aeccf9f req-145c7770-4db6-4b32-964c-8097a37863cc service nova] Creating event network-vif-plugged:82ea1ef3-ed28-48ca-8041-9192ffe5d711 for instance 1e927409-017d-4d1b-9028-4b1ad64d9744 on hv-cinder-86236 Oct 28 20:06:20.339528 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a11154a-d9ea-4181-9cd4-85c205a873de tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:20.339614 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-4f0c206e-4dd7-4907-889b-b0453aeccf9f req-145c7770-4db6-4b32-964c-8097a37863cc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041193 Oct 28 20:06:20.339614 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 72/142] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:20.473190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8a11154a-d9ea-4181-9cd4-85c205a873de tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:20.482031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8a11154a-d9ea-4181-9cd4-85c205a873de tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1314 microversion: 2.1 time: 0.174749 Oct 28 20:06:20.482807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 71/143] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:20 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:20.948921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8c931477-dd3a-4d5c-89a4-7f00d81f1e48 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:20.956806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8c931477-dd3a-4d5c-89a4-7f00d81f1e48 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:20.959079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c931477-dd3a-4d5c-89a4-7f00d81f1e48 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:20.959758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c931477-dd3a-4d5c-89a4-7f00d81f1e48 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:20.960606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c931477-dd3a-4d5c-89a4-7f00d81f1e48 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:20.962243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c931477-dd3a-4d5c-89a4-7f00d81f1e48 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:20.963039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c931477-dd3a-4d5c-89a4-7f00d81f1e48 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:20.963648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c931477-dd3a-4d5c-89a4-7f00d81f1e48 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:20.976471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0332d562-39af-40d2-a367-cf7fac5cb68e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:20.977648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0332d562-39af-40d2-a367-cf7fac5cb68e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:20.988502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0332d562-39af-40d2-a367-cf7fac5cb68e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:20.991428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0332d562-39af-40d2-a367-cf7fac5cb68e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:20.992118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0332d562-39af-40d2-a367-cf7fac5cb68e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:20.994301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0332d562-39af-40d2-a367-cf7fac5cb68e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:20.997150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0332d562-39af-40d2-a367-cf7fac5cb68e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:21.000955 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0332d562-39af-40d2-a367-cf7fac5cb68e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:21.505185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:21.549807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8c931477-dd3a-4d5c-89a4-7f00d81f1e48 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:21.556598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0332d562-39af-40d2-a367-cf7fac5cb68e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:21.558284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8c931477-dd3a-4d5c-89a4-7f00d81f1e48 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:21.561095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8c931477-dd3a-4d5c-89a4-7f00d81f1e48 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:21.562304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8c931477-dd3a-4d5c-89a4-7f00d81f1e48 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.617863 Oct 28 20:06:21.563096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 73/144] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:20 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:21.568500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-da5ec887-b9f8-4ba8-a468-e0e13abfa201 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:21.568836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0332d562-39af-40d2-a367-cf7fac5cb68e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.596035 Oct 28 20:06:21.569428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 72/145] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:20 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:21.585475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-da5ec887-b9f8-4ba8-a468-e0e13abfa201 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:21.589659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a025f549-199c-46c2-ab77-6b30819082bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:21.590394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a025f549-199c-46c2-ab77-6b30819082bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:21.592784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da5ec887-b9f8-4ba8-a468-e0e13abfa201 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:21.593278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da5ec887-b9f8-4ba8-a468-e0e13abfa201 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:21.593933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da5ec887-b9f8-4ba8-a468-e0e13abfa201 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:21.598087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da5ec887-b9f8-4ba8-a468-e0e13abfa201 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:21.598087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da5ec887-b9f8-4ba8-a468-e0e13abfa201 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:21.598087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da5ec887-b9f8-4ba8-a468-e0e13abfa201 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:21.598297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a025f549-199c-46c2-ab77-6b30819082bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:21.598297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a025f549-199c-46c2-ab77-6b30819082bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:21.598297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a025f549-199c-46c2-ab77-6b30819082bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:21.598297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a025f549-199c-46c2-ab77-6b30819082bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:21.598545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a025f549-199c-46c2-ab77-6b30819082bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:21.598975 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a025f549-199c-46c2-ab77-6b30819082bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:21.850732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-da5ec887-b9f8-4ba8-a468-e0e13abfa201 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:21.856653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a025f549-199c-46c2-ab77-6b30819082bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:21.860225 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-da5ec887-b9f8-4ba8-a468-e0e13abfa201 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.295910 Oct 28 20:06:21.861190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 74/146] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:21 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:21.873364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7d4d3157-80e2-4aa1-8aab-3c39875d734e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:21.873364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7d4d3157-80e2-4aa1-8aab-3c39875d734e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:21.873658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a025f549-199c-46c2-ab77-6b30819082bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.295843 Oct 28 20:06:21.873658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 73/147] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:21 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:21.873820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d4d3157-80e2-4aa1-8aab-3c39875d734e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:21.873820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d4d3157-80e2-4aa1-8aab-3c39875d734e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:21.873820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d4d3157-80e2-4aa1-8aab-3c39875d734e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:21.874287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d4d3157-80e2-4aa1-8aab-3c39875d734e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:21.874950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d4d3157-80e2-4aa1-8aab-3c39875d734e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:21.875616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d4d3157-80e2-4aa1-8aab-3c39875d734e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:22.038343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7d4d3157-80e2-4aa1-8aab-3c39875d734e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:22.046876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7d4d3157-80e2-4aa1-8aab-3c39875d734e tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1502 microversion: 2.1 time: 0.184555 Oct 28 20:06:22.047444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 75/148] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:21 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:22.587815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-61d322b1-2781-42c3-be5a-c1ba58202ed0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:22.588686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-61d322b1-2781-42c3-be5a-c1ba58202ed0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:22.600084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61d322b1-2781-42c3-be5a-c1ba58202ed0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:22.600084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61d322b1-2781-42c3-be5a-c1ba58202ed0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:22.600084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61d322b1-2781-42c3-be5a-c1ba58202ed0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:22.600084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61d322b1-2781-42c3-be5a-c1ba58202ed0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:22.600591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1e480d76-d20d-4415-9e80-785652c94dfb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:22.600686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61d322b1-2781-42c3-be5a-c1ba58202ed0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:22.600771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1e480d76-d20d-4415-9e80-785652c94dfb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:22.600863 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61d322b1-2781-42c3-be5a-c1ba58202ed0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:22.606458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e480d76-d20d-4415-9e80-785652c94dfb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:22.607592 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e480d76-d20d-4415-9e80-785652c94dfb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:22.608267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e480d76-d20d-4415-9e80-785652c94dfb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:22.609838 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e480d76-d20d-4415-9e80-785652c94dfb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:22.610369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e480d76-d20d-4415-9e80-785652c94dfb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:22.611329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e480d76-d20d-4415-9e80-785652c94dfb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:22.835285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-61d322b1-2781-42c3-be5a-c1ba58202ed0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:22.839919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1e480d76-d20d-4415-9e80-785652c94dfb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:22.846817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-61d322b1-2781-42c3-be5a-c1ba58202ed0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:22.848509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1e480d76-d20d-4415-9e80-785652c94dfb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.255716 Oct 28 20:06:22.848624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-61d322b1-2781-42c3-be5a-c1ba58202ed0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:22.849292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 76/149] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:22 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:22.850074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-61d322b1-2781-42c3-be5a-c1ba58202ed0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.265967 Oct 28 20:06:22.853871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 74/150] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:22 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:22.893020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7c82295d-fd83-478b-881c-533ba87effdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:22.894068 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7c82295d-fd83-478b-881c-533ba87effdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:22.896765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-61efade1-31e9-4ba0-aea2-4ff5785f42f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:22.897841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-61efade1-31e9-4ba0-aea2-4ff5785f42f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:22.902109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c82295d-fd83-478b-881c-533ba87effdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:22.903180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c82295d-fd83-478b-881c-533ba87effdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:22.904711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c82295d-fd83-478b-881c-533ba87effdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:22.905207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61efade1-31e9-4ba0-aea2-4ff5785f42f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:22.905733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61efade1-31e9-4ba0-aea2-4ff5785f42f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:22.906178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61efade1-31e9-4ba0-aea2-4ff5785f42f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:22.906743 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c82295d-fd83-478b-881c-533ba87effdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:22.906969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61efade1-31e9-4ba0-aea2-4ff5785f42f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:22.907432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61efade1-31e9-4ba0-aea2-4ff5785f42f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:22.907865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c82295d-fd83-478b-881c-533ba87effdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:22.907971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61efade1-31e9-4ba0-aea2-4ff5785f42f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:22.908955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c82295d-fd83-478b-881c-533ba87effdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:23.200048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7c82295d-fd83-478b-881c-533ba87effdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:23.201586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7c82295d-fd83-478b-881c-533ba87effdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.315585 Oct 28 20:06:23.205458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 77/151] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:22 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:23.214353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-6d40078a-aed9-4421-8828-3f80b1a3dbc0 req-45acbeb8-9974-4a7e-a31d-f7991cb0b1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83fb8150-cbd4-4139-bb47-a0fd318f8b86", "name": "network-vif-plugged", "status": "completed", "tag": "44d34977-72a3-481b-b7c3-7284888f0990"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:23.235443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6d40078a-aed9-4421-8828-3f80b1a3dbc0 req-45acbeb8-9974-4a7e-a31d-f7991cb0b1d6 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:23.236054 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-61efade1-31e9-4ba0-aea2-4ff5785f42f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:23.236318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6d40078a-aed9-4421-8828-3f80b1a3dbc0 req-45acbeb8-9974-4a7e-a31d-f7991cb0b1d6 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:23.236909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6d40078a-aed9-4421-8828-3f80b1a3dbc0 req-45acbeb8-9974-4a7e-a31d-f7991cb0b1d6 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:23.250379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-61efade1-31e9-4ba0-aea2-4ff5785f42f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.357840 Oct 28 20:06:23.250994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 75/152] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:22 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:23.257617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-6d40078a-aed9-4421-8828-3f80b1a3dbc0 req-45acbeb8-9974-4a7e-a31d-f7991cb0b1d6 service nova] Creating event network-vif-plugged:44d34977-72a3-481b-b7c3-7284888f0990 for instance 83fb8150-cbd4-4139-bb47-a0fd318f8b86 on hv-cinder-86236 Oct 28 20:06:23.260923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-6d40078a-aed9-4421-8828-3f80b1a3dbc0 req-45acbeb8-9974-4a7e-a31d-f7991cb0b1d6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053993 Oct 28 20:06:23.262344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 78/153] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:23.871928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-471e1e4a-adc5-4b1d-a856-7ecbcdc1d8ab tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:23.872838 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-471e1e4a-adc5-4b1d-a856-7ecbcdc1d8ab tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:23.879177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d059c0d3-2e91-45af-a035-c6cc1de9477f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:23.879177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d059c0d3-2e91-45af-a035-c6cc1de9477f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:23.880160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-471e1e4a-adc5-4b1d-a856-7ecbcdc1d8ab tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:23.881819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-471e1e4a-adc5-4b1d-a856-7ecbcdc1d8ab tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:23.882274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-471e1e4a-adc5-4b1d-a856-7ecbcdc1d8ab tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:23.882997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-471e1e4a-adc5-4b1d-a856-7ecbcdc1d8ab tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:23.883483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-471e1e4a-adc5-4b1d-a856-7ecbcdc1d8ab tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:23.883919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-471e1e4a-adc5-4b1d-a856-7ecbcdc1d8ab tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:23.884122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d059c0d3-2e91-45af-a035-c6cc1de9477f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:23.884611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d059c0d3-2e91-45af-a035-c6cc1de9477f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:23.885048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d059c0d3-2e91-45af-a035-c6cc1de9477f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:23.885822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d059c0d3-2e91-45af-a035-c6cc1de9477f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:23.886280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d059c0d3-2e91-45af-a035-c6cc1de9477f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:23.886868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d059c0d3-2e91-45af-a035-c6cc1de9477f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:24.142037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d059c0d3-2e91-45af-a035-c6cc1de9477f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:24.147709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-471e1e4a-adc5-4b1d-a856-7ecbcdc1d8ab tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:24.157717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-471e1e4a-adc5-4b1d-a856-7ecbcdc1d8ab tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.290333 Oct 28 20:06:24.158977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d059c0d3-2e91-45af-a035-c6cc1de9477f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:24.159141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 76/154] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:23 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:24.161112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d059c0d3-2e91-45af-a035-c6cc1de9477f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:24.162423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d059c0d3-2e91-45af-a035-c6cc1de9477f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.290187 Oct 28 20:06:24.163203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 79/155] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:23 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:06:24.174304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5db1c088-1e37-4e2d-b67e-26e6bae6abbd tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a47e1f83-b8e2-4494-9cce-31fd1b248816"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:24.178069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5db1c088-1e37-4e2d-b67e-26e6bae6abbd tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:24.188593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5db1c088-1e37-4e2d-b67e-26e6bae6abbd tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:24.188593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5db1c088-1e37-4e2d-b67e-26e6bae6abbd tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:24.188593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5db1c088-1e37-4e2d-b67e-26e6bae6abbd tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:24.188593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5db1c088-1e37-4e2d-b67e-26e6bae6abbd tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:24.188884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5db1c088-1e37-4e2d-b67e-26e6bae6abbd tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:24.189169 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5db1c088-1e37-4e2d-b67e-26e6bae6abbd tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:24.228257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-686dc60a-900a-45ec-9ae3-c59aea403fd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:24.235306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-686dc60a-900a-45ec-9ae3-c59aea403fd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:24.243440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686dc60a-900a-45ec-9ae3-c59aea403fd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:24.244347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686dc60a-900a-45ec-9ae3-c59aea403fd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:24.244951 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686dc60a-900a-45ec-9ae3-c59aea403fd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:24.246035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686dc60a-900a-45ec-9ae3-c59aea403fd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:24.247505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686dc60a-900a-45ec-9ae3-c59aea403fd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:24.248115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686dc60a-900a-45ec-9ae3-c59aea403fd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:24.489617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-686dc60a-900a-45ec-9ae3-c59aea403fd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:24.500460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-686dc60a-900a-45ec-9ae3-c59aea403fd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1366 microversion: 2.1 time: 0.275851 Oct 28 20:06:24.501415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 80/156] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:24 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:24.519073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aa7e37c1-73d6-4239-b50e-3abb6f18c12c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:24.519747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aa7e37c1-73d6-4239-b50e-3abb6f18c12c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:24.587007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:24.592002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa7e37c1-73d6-4239-b50e-3abb6f18c12c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:24.592679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa7e37c1-73d6-4239-b50e-3abb6f18c12c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:24.593296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa7e37c1-73d6-4239-b50e-3abb6f18c12c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:24.594427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa7e37c1-73d6-4239-b50e-3abb6f18c12c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:24.595085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa7e37c1-73d6-4239-b50e-3abb6f18c12c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:24.595914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa7e37c1-73d6-4239-b50e-3abb6f18c12c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:24.761315 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-aa7e37c1-73d6-4239-b50e-3abb6f18c12c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:24.770068 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aa7e37c1-73d6-4239-b50e-3abb6f18c12c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.267575 Oct 28 20:06:24.770637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 81/157] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:24 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:25.202045 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a74a02be-ba01-471d-a12d-182cb9ba35d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:25.202661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a74a02be-ba01-471d-a12d-182cb9ba35d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:25.209605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a74a02be-ba01-471d-a12d-182cb9ba35d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:25.210293 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a74a02be-ba01-471d-a12d-182cb9ba35d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:25.210649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a74a02be-ba01-471d-a12d-182cb9ba35d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:25.211425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a74a02be-ba01-471d-a12d-182cb9ba35d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:25.212094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a74a02be-ba01-471d-a12d-182cb9ba35d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:25.212513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a74a02be-ba01-471d-a12d-182cb9ba35d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:25.259729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5db1c088-1e37-4e2d-b67e-26e6bae6abbd tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "POST /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.098750 Oct 28 20:06:25.260288 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 77/158] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Oct 28 20:06:24 2022] POST /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb/os-volume_attachments => generated 194 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:25.271589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f5a33181-317c-471f-9f24-1eeda2c69432 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:25.272374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f5a33181-317c-471f-9f24-1eeda2c69432 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:25.289731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a33181-317c-471f-9f24-1eeda2c69432 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:25.291131 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a33181-317c-471f-9f24-1eeda2c69432 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:25.292157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a33181-317c-471f-9f24-1eeda2c69432 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:25.295853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a33181-317c-471f-9f24-1eeda2c69432 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:25.296337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a33181-317c-471f-9f24-1eeda2c69432 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:25.298953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a33181-317c-471f-9f24-1eeda2c69432 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:25.501138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a74a02be-ba01-471d-a12d-182cb9ba35d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:25.510048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a74a02be-ba01-471d-a12d-182cb9ba35d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.312426 Oct 28 20:06:25.510726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 82/159] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:25 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:25.515653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-3a7185f2-c778-4699-9238-4b983f24d9ae req-ecda23cd-e79c-4b79-8edb-bf96414efcdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91", "name": "network-vif-plugged", "status": "completed", "tag": "bdcc9207-f285-46ee-9af9-3f76e3f40aa4"}, {"server_uuid": "0e147ba2-cd15-490e-aac0-236beaf41e8d", "name": "network-vif-plugged", "status": "completed", "tag": "6cbf02ec-6953-458c-9564-3dba0bc9146a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:25.527302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3a7185f2-c778-4699-9238-4b983f24d9ae req-ecda23cd-e79c-4b79-8edb-bf96414efcdb service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:25.529157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3a7185f2-c778-4699-9238-4b983f24d9ae req-ecda23cd-e79c-4b79-8edb-bf96414efcdb service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:25.529694 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3a7185f2-c778-4699-9238-4b983f24d9ae req-ecda23cd-e79c-4b79-8edb-bf96414efcdb service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:25.544784 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f5a33181-317c-471f-9f24-1eeda2c69432 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:25.544990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-3a7185f2-c778-4699-9238-4b983f24d9ae req-ecda23cd-e79c-4b79-8edb-bf96414efcdb service nova] Creating event network-vif-plugged:bdcc9207-f285-46ee-9af9-3f76e3f40aa4 for instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 on hv-cinder-86236 Oct 28 20:06:25.545577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-3a7185f2-c778-4699-9238-4b983f24d9ae req-ecda23cd-e79c-4b79-8edb-bf96414efcdb service nova] Creating event network-vif-plugged:6cbf02ec-6953-458c-9564-3dba0bc9146a for instance 0e147ba2-cd15-490e-aac0-236beaf41e8d on hv-cinder-86236 Oct 28 20:06:25.553023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-3a7185f2-c778-4699-9238-4b983f24d9ae req-ecda23cd-e79c-4b79-8edb-bf96414efcdb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040967 Oct 28 20:06:25.554100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 83/160] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:25.569501 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c2cb7c55-a440-45bb-8206-63283bd83705 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:25.570451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c2cb7c55-a440-45bb-8206-63283bd83705 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:25.571642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f5a33181-317c-471f-9f24-1eeda2c69432 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:25.573219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f5a33181-317c-471f-9f24-1eeda2c69432 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:25.581923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f5a33181-317c-471f-9f24-1eeda2c69432 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.316659 Oct 28 20:06:25.585715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 78/161] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:25 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:25.586781 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2cb7c55-a440-45bb-8206-63283bd83705 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:25.587491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2cb7c55-a440-45bb-8206-63283bd83705 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:25.588976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2cb7c55-a440-45bb-8206-63283bd83705 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:25.590046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2cb7c55-a440-45bb-8206-63283bd83705 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:25.593229 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2cb7c55-a440-45bb-8206-63283bd83705 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:25.593862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2cb7c55-a440-45bb-8206-63283bd83705 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:25.786885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c2cb7c55-a440-45bb-8206-63283bd83705 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:25.793862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31f10a68-0929-4bc0-9c21-846c1d0198fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:25.795093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31f10a68-0929-4bc0-9c21-846c1d0198fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:25.803067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31f10a68-0929-4bc0-9c21-846c1d0198fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:25.803620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31f10a68-0929-4bc0-9c21-846c1d0198fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:25.804272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31f10a68-0929-4bc0-9c21-846c1d0198fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:25.805528 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31f10a68-0929-4bc0-9c21-846c1d0198fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:25.806181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31f10a68-0929-4bc0-9c21-846c1d0198fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:25.806796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31f10a68-0929-4bc0-9c21-846c1d0198fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:25.822592 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c2cb7c55-a440-45bb-8206-63283bd83705 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1557 microversion: 2.1 time: 0.256494 Oct 28 20:06:25.822592 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 84/162] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:25 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1557 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:25.845074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0c837cb3-1ba2-4d53-8e08-2dfc24c07bc7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:25.845602 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0c837cb3-1ba2-4d53-8e08-2dfc24c07bc7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:25.860181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c837cb3-1ba2-4d53-8e08-2dfc24c07bc7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:25.860712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c837cb3-1ba2-4d53-8e08-2dfc24c07bc7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:25.861176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c837cb3-1ba2-4d53-8e08-2dfc24c07bc7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:25.865730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c837cb3-1ba2-4d53-8e08-2dfc24c07bc7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:25.866413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c837cb3-1ba2-4d53-8e08-2dfc24c07bc7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:25.869179 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c837cb3-1ba2-4d53-8e08-2dfc24c07bc7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:25.926069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:26.442856 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0c837cb3-1ba2-4d53-8e08-2dfc24c07bc7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.601628 Oct 28 20:06:26.443660 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 85/163] 10.222.0.66 () {58 vars in 1275 bytes} [Fri Oct 28 20:06:25 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-interface => generated 285 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:06:26.491516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-31f10a68-0929-4bc0-9c21-846c1d0198fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:26.500284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-31f10a68-0929-4bc0-9c21-846c1d0198fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.711171 Oct 28 20:06:26.517234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 79/164] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:25 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:26.535038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b04ef4d2-fa92-4834-bb98-935885c29caa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:26.535646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b04ef4d2-fa92-4834-bb98-935885c29caa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:26.545755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b04ef4d2-fa92-4834-bb98-935885c29caa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:26.546240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b04ef4d2-fa92-4834-bb98-935885c29caa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:26.548864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b04ef4d2-fa92-4834-bb98-935885c29caa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:26.548864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b04ef4d2-fa92-4834-bb98-935885c29caa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:26.548864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b04ef4d2-fa92-4834-bb98-935885c29caa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:26.548864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b04ef4d2-fa92-4834-bb98-935885c29caa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:26.616866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-23438a62-4fc9-4a40-993c-b1db17633d14 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:26.617569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-23438a62-4fc9-4a40-993c-b1db17633d14 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:26.625211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23438a62-4fc9-4a40-993c-b1db17633d14 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:26.625893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23438a62-4fc9-4a40-993c-b1db17633d14 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:26.626329 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23438a62-4fc9-4a40-993c-b1db17633d14 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:26.627026 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23438a62-4fc9-4a40-993c-b1db17633d14 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:26.627476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23438a62-4fc9-4a40-993c-b1db17633d14 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:26.627921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23438a62-4fc9-4a40-993c-b1db17633d14 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:26.786458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b04ef4d2-fa92-4834-bb98-935885c29caa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:26.809877 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b04ef4d2-fa92-4834-bb98-935885c29caa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.272593 Oct 28 20:06:26.809877 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 86/165] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:26 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:26.837155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-23438a62-4fc9-4a40-993c-b1db17633d14 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:26.845992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-23438a62-4fc9-4a40-993c-b1db17633d14 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:26.848364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-23438a62-4fc9-4a40-993c-b1db17633d14 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:26.849550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-23438a62-4fc9-4a40-993c-b1db17633d14 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.241257 Oct 28 20:06:26.850119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 80/166] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:26 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:06:27.523846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3b8f8471-d4a3-4c68-a435-17ca4e5a3b0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:27.524706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3b8f8471-d4a3-4c68-a435-17ca4e5a3b0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:27.530790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b8f8471-d4a3-4c68-a435-17ca4e5a3b0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:27.531213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b8f8471-d4a3-4c68-a435-17ca4e5a3b0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:27.531661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b8f8471-d4a3-4c68-a435-17ca4e5a3b0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:27.532357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b8f8471-d4a3-4c68-a435-17ca4e5a3b0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:27.532812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b8f8471-d4a3-4c68-a435-17ca4e5a3b0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:27.533238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b8f8471-d4a3-4c68-a435-17ca4e5a3b0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:27.609867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-270ba8c2-6ffa-4694-8015-9aa747af79ed req-75eeb60f-0e8e-4f56-8c99-455447dc5460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7582188f-bfab-4218-9104-9fb384141c57", "name": "network-vif-plugged", "status": "completed", "tag": "ade7b021-b99e-4c55-93bb-537d28c2a53d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:27.620483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-270ba8c2-6ffa-4694-8015-9aa747af79ed req-75eeb60f-0e8e-4f56-8c99-455447dc5460 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:27.621333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-270ba8c2-6ffa-4694-8015-9aa747af79ed req-75eeb60f-0e8e-4f56-8c99-455447dc5460 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:27.623089 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-270ba8c2-6ffa-4694-8015-9aa747af79ed req-75eeb60f-0e8e-4f56-8c99-455447dc5460 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:27.636659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-270ba8c2-6ffa-4694-8015-9aa747af79ed req-75eeb60f-0e8e-4f56-8c99-455447dc5460 service nova] Creating event network-vif-plugged:ade7b021-b99e-4c55-93bb-537d28c2a53d for instance 7582188f-bfab-4218-9104-9fb384141c57 on hv-cinder-86236 Oct 28 20:06:27.642485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-270ba8c2-6ffa-4694-8015-9aa747af79ed req-75eeb60f-0e8e-4f56-8c99-455447dc5460 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038200 Oct 28 20:06:27.643889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 81/167] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:06:27.684426 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3b8f8471-d4a3-4c68-a435-17ca4e5a3b0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:27.692886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3b8f8471-d4a3-4c68-a435-17ca4e5a3b0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1362 microversion: 2.1 time: 0.172971 Oct 28 20:06:27.703969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 87/168] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:27 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:27.833529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81f06d7c-d3c7-4cee-9b37-302c30f5f171 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:27.834505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-81f06d7c-d3c7-4cee-9b37-302c30f5f171 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:27.841639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81f06d7c-d3c7-4cee-9b37-302c30f5f171 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:27.842354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81f06d7c-d3c7-4cee-9b37-302c30f5f171 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:27.842794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81f06d7c-d3c7-4cee-9b37-302c30f5f171 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:27.843671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81f06d7c-d3c7-4cee-9b37-302c30f5f171 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:27.844161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81f06d7c-d3c7-4cee-9b37-302c30f5f171 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:27.844584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81f06d7c-d3c7-4cee-9b37-302c30f5f171 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:27.874843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-95818b24-5f46-48d1-b473-5a1edc9043a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:27.876492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-95818b24-5f46-48d1-b473-5a1edc9043a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:27.889498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95818b24-5f46-48d1-b473-5a1edc9043a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:27.889498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95818b24-5f46-48d1-b473-5a1edc9043a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:27.889498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95818b24-5f46-48d1-b473-5a1edc9043a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:27.897042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95818b24-5f46-48d1-b473-5a1edc9043a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:27.900432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95818b24-5f46-48d1-b473-5a1edc9043a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:27.900899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95818b24-5f46-48d1-b473-5a1edc9043a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:28.237941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-81f06d7c-d3c7-4cee-9b37-302c30f5f171 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:28.259047 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-81f06d7c-d3c7-4cee-9b37-302c30f5f171 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1322 microversion: 2.1 time: 0.429443 Oct 28 20:06:28.262688 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 82/169] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:27 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:28.270933 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-843a34e0-770c-44a3-bb3d-bf72a2d14e89 req-185412ae-3307-46c3-9d0b-43907628ce1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83fb8150-cbd4-4139-bb47-a0fd318f8b86", "tag": "44d34977-72a3-481b-b7c3-7284888f0990"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:28.287492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-843a34e0-770c-44a3-bb3d-bf72a2d14e89 req-185412ae-3307-46c3-9d0b-43907628ce1a service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:28.289518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-843a34e0-770c-44a3-bb3d-bf72a2d14e89 req-185412ae-3307-46c3-9d0b-43907628ce1a service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:28.290445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-843a34e0-770c-44a3-bb3d-bf72a2d14e89 req-185412ae-3307-46c3-9d0b-43907628ce1a service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:28.307119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-843a34e0-770c-44a3-bb3d-bf72a2d14e89 req-185412ae-3307-46c3-9d0b-43907628ce1a service nova] Creating event network-changed:44d34977-72a3-481b-b7c3-7284888f0990 for instance 83fb8150-cbd4-4139-bb47-a0fd318f8b86 on hv-cinder-86236 Oct 28 20:06:28.313612 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-95818b24-5f46-48d1-b473-5a1edc9043a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:28.314367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-843a34e0-770c-44a3-bb3d-bf72a2d14e89 req-185412ae-3307-46c3-9d0b-43907628ce1a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049652 Oct 28 20:06:28.315211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 83/170] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:28.324278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-95818b24-5f46-48d1-b473-5a1edc9043a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:28.327834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-95818b24-5f46-48d1-b473-5a1edc9043a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:28.345025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-95818b24-5f46-48d1-b473-5a1edc9043a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.458179 Oct 28 20:06:28.345025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 88/171] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:27 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:28.725927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5fe37dfe-7f7d-4305-98ea-1564235babbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:28.728126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5fe37dfe-7f7d-4305-98ea-1564235babbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:28.736806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe37dfe-7f7d-4305-98ea-1564235babbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:28.737936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe37dfe-7f7d-4305-98ea-1564235babbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:28.739096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe37dfe-7f7d-4305-98ea-1564235babbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:28.739953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe37dfe-7f7d-4305-98ea-1564235babbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:28.740553 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe37dfe-7f7d-4305-98ea-1564235babbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:28.741759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe37dfe-7f7d-4305-98ea-1564235babbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:28.907501 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5fe37dfe-7f7d-4305-98ea-1564235babbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:28.917092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5fe37dfe-7f7d-4305-98ea-1564235babbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1549 microversion: 2.1 time: 0.196703 Oct 28 20:06:28.917709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 84/172] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:28 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1549 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:28.947846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ae25263c-c2b7-44af-80ed-7e88a2ec60e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:28.948486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ae25263c-c2b7-44af-80ed-7e88a2ec60e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:28.955305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae25263c-c2b7-44af-80ed-7e88a2ec60e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:28.956026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae25263c-c2b7-44af-80ed-7e88a2ec60e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:28.957048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae25263c-c2b7-44af-80ed-7e88a2ec60e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:28.959325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae25263c-c2b7-44af-80ed-7e88a2ec60e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:28.959987 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae25263c-c2b7-44af-80ed-7e88a2ec60e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:28.960505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae25263c-c2b7-44af-80ed-7e88a2ec60e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:29.052930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ae25263c-c2b7-44af-80ed-7e88a2ec60e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108787 Oct 28 20:06:29.062282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 89/173] 10.222.0.66 () {58 vars in 1275 bytes} [Fri Oct 28 20:06:28 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:29.295480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e0fbd68f-eaa6-4143-bc8d-0d66e9beef89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:29.296334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e0fbd68f-eaa6-4143-bc8d-0d66e9beef89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:29.302651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0fbd68f-eaa6-4143-bc8d-0d66e9beef89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:29.303224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0fbd68f-eaa6-4143-bc8d-0d66e9beef89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:29.303728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0fbd68f-eaa6-4143-bc8d-0d66e9beef89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:29.307879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0fbd68f-eaa6-4143-bc8d-0d66e9beef89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:29.307879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0fbd68f-eaa6-4143-bc8d-0d66e9beef89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:29.307879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0fbd68f-eaa6-4143-bc8d-0d66e9beef89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:29.365871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-180f7d1a-d099-4119-8d20-e19c6734f540 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:29.366486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-180f7d1a-d099-4119-8d20-e19c6734f540 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:29.377362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-180f7d1a-d099-4119-8d20-e19c6734f540 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:29.378083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-180f7d1a-d099-4119-8d20-e19c6734f540 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:29.378591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-180f7d1a-d099-4119-8d20-e19c6734f540 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:29.379708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-180f7d1a-d099-4119-8d20-e19c6734f540 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:29.380245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-180f7d1a-d099-4119-8d20-e19c6734f540 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:29.380912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-180f7d1a-d099-4119-8d20-e19c6734f540 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:29.710184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e0fbd68f-eaa6-4143-bc8d-0d66e9beef89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:29.713740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:29.721004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e0fbd68f-eaa6-4143-bc8d-0d66e9beef89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1516 microversion: 2.1 time: 0.436704 Oct 28 20:06:29.721705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 85/174] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:29 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1516 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:29.745457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e17f0fb8-5164-410c-87c1-7860d0f0ff3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:29.748786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e17f0fb8-5164-410c-87c1-7860d0f0ff3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:29.755874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e17f0fb8-5164-410c-87c1-7860d0f0ff3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:29.756365 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e17f0fb8-5164-410c-87c1-7860d0f0ff3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:29.756920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e17f0fb8-5164-410c-87c1-7860d0f0ff3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:29.757664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e17f0fb8-5164-410c-87c1-7860d0f0ff3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:29.758128 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e17f0fb8-5164-410c-87c1-7860d0f0ff3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:29.758554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e17f0fb8-5164-410c-87c1-7860d0f0ff3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:29.796488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-180f7d1a-d099-4119-8d20-e19c6734f540 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:29.827411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-180f7d1a-d099-4119-8d20-e19c6734f540 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:29.835214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-180f7d1a-d099-4119-8d20-e19c6734f540 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:29.841653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-180f7d1a-d099-4119-8d20-e19c6734f540 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.476658 Oct 28 20:06:29.841653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 90/175] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:29 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:29.845453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-e17f0fb8-5164-410c-87c1-7860d0f0ff3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lazy-loading 'flavor' on Instance uuid 0e147ba2-cd15-490e-aac0-236beaf41e8d {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:06:30.334953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e17f0fb8-5164-410c-87c1-7860d0f0ff3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "POST /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d/action" status: 200 len: 32 microversion: 2.1 time: 0.593692 Oct 28 20:06:30.335654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 86/176] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Oct 28 20:06:29 2022] POST /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d/action => generated 32 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 20:06:30.345311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9f823088-d5e9-463b-83fe-97be6d047f17 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:30.346832 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9f823088-d5e9-463b-83fe-97be6d047f17 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:30.358909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f823088-d5e9-463b-83fe-97be6d047f17 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:30.360937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f823088-d5e9-463b-83fe-97be6d047f17 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:30.365029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f823088-d5e9-463b-83fe-97be6d047f17 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:30.366125 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f823088-d5e9-463b-83fe-97be6d047f17 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:30.367107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f823088-d5e9-463b-83fe-97be6d047f17 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:30.367734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f823088-d5e9-463b-83fe-97be6d047f17 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:30.871336 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2249a5af-cf1c-454f-af03-00f1556e9a4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:30.873127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2249a5af-cf1c-454f-af03-00f1556e9a4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:30.902020 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2249a5af-cf1c-454f-af03-00f1556e9a4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:30.904553 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2249a5af-cf1c-454f-af03-00f1556e9a4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:30.907182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2249a5af-cf1c-454f-af03-00f1556e9a4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:30.908229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2249a5af-cf1c-454f-af03-00f1556e9a4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:30.909987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2249a5af-cf1c-454f-af03-00f1556e9a4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:30.910720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2249a5af-cf1c-454f-af03-00f1556e9a4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:31.175123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9f823088-d5e9-463b-83fe-97be6d047f17 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:31.182883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9f823088-d5e9-463b-83fe-97be6d047f17 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.841272 Oct 28 20:06:31.183471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 91/177] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:30 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:31.394128 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2249a5af-cf1c-454f-af03-00f1556e9a4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:31.402741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2249a5af-cf1c-454f-af03-00f1556e9a4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:31.404441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2249a5af-cf1c-454f-af03-00f1556e9a4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:31.405647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2249a5af-cf1c-454f-af03-00f1556e9a4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.539851 Oct 28 20:06:31.406213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 87/178] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:30 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:06:31.790665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5cd1499a-6be0-4c59-ae54-200cb876d5c3 req-57e62ef4-17c6-45ba-a462-63babbe30f5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91", "tag": "bdcc9207-f285-46ee-9af9-3f76e3f40aa4"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:31.804017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5cd1499a-6be0-4c59-ae54-200cb876d5c3 req-57e62ef4-17c6-45ba-a462-63babbe30f5b service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:31.805201 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5cd1499a-6be0-4c59-ae54-200cb876d5c3 req-57e62ef4-17c6-45ba-a462-63babbe30f5b service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:31.805939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5cd1499a-6be0-4c59-ae54-200cb876d5c3 req-57e62ef4-17c6-45ba-a462-63babbe30f5b service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:31.822053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5cd1499a-6be0-4c59-ae54-200cb876d5c3 req-57e62ef4-17c6-45ba-a462-63babbe30f5b service nova] Creating event network-changed:bdcc9207-f285-46ee-9af9-3f76e3f40aa4 for instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 on hv-cinder-86236 Oct 28 20:06:31.828957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5cd1499a-6be0-4c59-ae54-200cb876d5c3 req-57e62ef4-17c6-45ba-a462-63babbe30f5b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043853 Oct 28 20:06:31.830214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 92/179] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:32.185135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-30f8638b-0782-4561-a898-4a4c655c6c8f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:32.185959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-30f8638b-0782-4561-a898-4a4c655c6c8f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:32.198320 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30f8638b-0782-4561-a898-4a4c655c6c8f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:32.198818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30f8638b-0782-4561-a898-4a4c655c6c8f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:32.199317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30f8638b-0782-4561-a898-4a4c655c6c8f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:32.206095 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30f8638b-0782-4561-a898-4a4c655c6c8f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:32.214920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b5a2dcb-6cb9-48fe-b37a-348df3e2c071 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:32.214920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0b5a2dcb-6cb9-48fe-b37a-348df3e2c071 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:32.218106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b5a2dcb-6cb9-48fe-b37a-348df3e2c071 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:32.218106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b5a2dcb-6cb9-48fe-b37a-348df3e2c071 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:32.218341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b5a2dcb-6cb9-48fe-b37a-348df3e2c071 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:32.219788 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b5a2dcb-6cb9-48fe-b37a-348df3e2c071 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:32.220256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b5a2dcb-6cb9-48fe-b37a-348df3e2c071 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:32.220685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30f8638b-0782-4561-a898-4a4c655c6c8f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:32.220786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b5a2dcb-6cb9-48fe-b37a-348df3e2c071 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:32.223138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30f8638b-0782-4561-a898-4a4c655c6c8f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:32.262168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-30f8638b-0782-4561-a898-4a4c655c6c8f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:06:32.428462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0b5a2dcb-6cb9-48fe-b37a-348df3e2c071 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:32.441889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0b5a2dcb-6cb9-48fe-b37a-348df3e2c071 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.237451 Oct 28 20:06:32.442543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 93/180] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:32 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:32.460146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e9fcd62b-fa9d-4ab0-9aa8-37a7226f0528 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:32.461080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e9fcd62b-fa9d-4ab0-9aa8-37a7226f0528 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:32.485283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9fcd62b-fa9d-4ab0-9aa8-37a7226f0528 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:32.485800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9fcd62b-fa9d-4ab0-9aa8-37a7226f0528 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:32.486240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9fcd62b-fa9d-4ab0-9aa8-37a7226f0528 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:32.486955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9fcd62b-fa9d-4ab0-9aa8-37a7226f0528 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:32.487413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9fcd62b-fa9d-4ab0-9aa8-37a7226f0528 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:32.487997 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9fcd62b-fa9d-4ab0-9aa8-37a7226f0528 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:32.702648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e9fcd62b-fa9d-4ab0-9aa8-37a7226f0528 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:32.717541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e9fcd62b-fa9d-4ab0-9aa8-37a7226f0528 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:32.719053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e9fcd62b-fa9d-4ab0-9aa8-37a7226f0528 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:32.721442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e9fcd62b-fa9d-4ab0-9aa8-37a7226f0528 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1408 microversion: 2.20 time: 0.277869 Oct 28 20:06:32.722134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 94/181] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:32 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:32.774329 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-30f8638b-0782-4561-a898-4a4c655c6c8f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 204 len: 0 microversion: 2.1 time: 0.596579 Oct 28 20:06:32.774844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 88/182] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:06:32 2022] DELETE /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 0 bytes in 599 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:06:32.783228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f92658b2-cadb-4638-a8f9-373f39429bc7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:32.783842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f92658b2-cadb-4638-a8f9-373f39429bc7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:32.790010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f92658b2-cadb-4638-a8f9-373f39429bc7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:32.790498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f92658b2-cadb-4638-a8f9-373f39429bc7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:32.790930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f92658b2-cadb-4638-a8f9-373f39429bc7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:32.791622 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f92658b2-cadb-4638-a8f9-373f39429bc7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:32.792069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f92658b2-cadb-4638-a8f9-373f39429bc7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:32.792489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f92658b2-cadb-4638-a8f9-373f39429bc7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:32.935415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f92658b2-cadb-4638-a8f9-373f39429bc7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:32.944245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f92658b2-cadb-4638-a8f9-373f39429bc7 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1554 microversion: 2.1 time: 0.164938 Oct 28 20:06:32.945054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 95/183] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:32 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:33.475753 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-99c53823-085d-4e4c-ad9d-eef66db07100 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:33.478559 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-99c53823-085d-4e4c-ad9d-eef66db07100 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:33.494980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99c53823-085d-4e4c-ad9d-eef66db07100 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:33.495475 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99c53823-085d-4e4c-ad9d-eef66db07100 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:33.495908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99c53823-085d-4e4c-ad9d-eef66db07100 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:33.496926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99c53823-085d-4e4c-ad9d-eef66db07100 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:33.497561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99c53823-085d-4e4c-ad9d-eef66db07100 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:33.498144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99c53823-085d-4e4c-ad9d-eef66db07100 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:33.643539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-99c53823-085d-4e4c-ad9d-eef66db07100 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:33.652258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-99c53823-085d-4e4c-ad9d-eef66db07100 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.186905 Oct 28 20:06:33.652930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 89/184] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:33 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:33.748305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aa0a4cbb-e558-42a7-9734-1b59da09fbcc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:33.748914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aa0a4cbb-e558-42a7-9734-1b59da09fbcc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:33.754922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0a4cbb-e558-42a7-9734-1b59da09fbcc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:33.755482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0a4cbb-e558-42a7-9734-1b59da09fbcc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:33.755921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0a4cbb-e558-42a7-9734-1b59da09fbcc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:33.756610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0a4cbb-e558-42a7-9734-1b59da09fbcc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:33.757059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0a4cbb-e558-42a7-9734-1b59da09fbcc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:33.757510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0a4cbb-e558-42a7-9734-1b59da09fbcc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:33.897916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-aa0a4cbb-e558-42a7-9734-1b59da09fbcc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:33.907394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-aa0a4cbb-e558-42a7-9734-1b59da09fbcc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:33.908847 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-aa0a4cbb-e558-42a7-9734-1b59da09fbcc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:33.910222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aa0a4cbb-e558-42a7-9734-1b59da09fbcc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1600 microversion: 2.20 time: 0.166406 Oct 28 20:06:33.914074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 96/185] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:06:33 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:06:33.936417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-945fe0a6-691b-45a7-b4c1-18f0ce5e5845 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:33.936916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-945fe0a6-691b-45a7-b4c1-18f0ce5e5845 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:33.943171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-945fe0a6-691b-45a7-b4c1-18f0ce5e5845 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:33.943686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-945fe0a6-691b-45a7-b4c1-18f0ce5e5845 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:33.944126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-945fe0a6-691b-45a7-b4c1-18f0ce5e5845 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:33.944812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-945fe0a6-691b-45a7-b4c1-18f0ce5e5845 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:33.945272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-945fe0a6-691b-45a7-b4c1-18f0ce5e5845 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:33.945724 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-945fe0a6-691b-45a7-b4c1-18f0ce5e5845 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:33.973518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e0ae6715-594f-42d6-8741-2b3ef6dda15f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:33.974148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e0ae6715-594f-42d6-8741-2b3ef6dda15f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:33.983870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0ae6715-594f-42d6-8741-2b3ef6dda15f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:33.988865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0ae6715-594f-42d6-8741-2b3ef6dda15f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:33.988865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0ae6715-594f-42d6-8741-2b3ef6dda15f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:33.988865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0ae6715-594f-42d6-8741-2b3ef6dda15f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:33.988865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0ae6715-594f-42d6-8741-2b3ef6dda15f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:33.989384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0ae6715-594f-42d6-8741-2b3ef6dda15f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:34.068036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-945fe0a6-691b-45a7-b4c1-18f0ce5e5845 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.135682 Oct 28 20:06:34.068754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 90/186] 10.222.0.66 () {60 vars in 1316 bytes} [Fri Oct 28 20:06:33 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:06:34.144942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e0ae6715-594f-42d6-8741-2b3ef6dda15f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:34.153777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e0ae6715-594f-42d6-8741-2b3ef6dda15f tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1554 microversion: 2.1 time: 0.184145 Oct 28 20:06:34.154818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 97/187] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:33 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:34.677399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b531142c-b6ec-48d6-a361-3d6f877bde1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:34.678594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b531142c-b6ec-48d6-a361-3d6f877bde1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:34.686833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b531142c-b6ec-48d6-a361-3d6f877bde1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:34.687514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b531142c-b6ec-48d6-a361-3d6f877bde1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:34.688120 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b531142c-b6ec-48d6-a361-3d6f877bde1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:34.688980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b531142c-b6ec-48d6-a361-3d6f877bde1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:34.689777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b531142c-b6ec-48d6-a361-3d6f877bde1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:34.690202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b531142c-b6ec-48d6-a361-3d6f877bde1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:34.832549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b531142c-b6ec-48d6-a361-3d6f877bde1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:34.841036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b531142c-b6ec-48d6-a361-3d6f877bde1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.168400 Oct 28 20:06:34.841638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 91/188] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:34 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:35.178128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-00205350-20fa-4036-a6e4-8b619f99d0cf tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:35.178760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-00205350-20fa-4036-a6e4-8b619f99d0cf tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:35.185559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00205350-20fa-4036-a6e4-8b619f99d0cf tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:35.186043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00205350-20fa-4036-a6e4-8b619f99d0cf tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:35.186475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00205350-20fa-4036-a6e4-8b619f99d0cf tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:35.187162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00205350-20fa-4036-a6e4-8b619f99d0cf tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:35.187616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00205350-20fa-4036-a6e4-8b619f99d0cf tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:35.188038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00205350-20fa-4036-a6e4-8b619f99d0cf tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:35.350923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-00205350-20fa-4036-a6e4-8b619f99d0cf tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:35.377864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-00205350-20fa-4036-a6e4-8b619f99d0cf tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1554 microversion: 2.1 time: 0.203131 Oct 28 20:06:35.378750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 98/189] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:35 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1554 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:35.399055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-f61567c6-ddbf-4c55-88e0-fba0fc910ea2 req-c5f63a2f-2f40-462f-919d-738cd894c38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7582188f-bfab-4218-9104-9fb384141c57", "tag": "ade7b021-b99e-4c55-93bb-537d28c2a53d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:35.411168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f61567c6-ddbf-4c55-88e0-fba0fc910ea2 req-c5f63a2f-2f40-462f-919d-738cd894c38b service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:35.411731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f61567c6-ddbf-4c55-88e0-fba0fc910ea2 req-c5f63a2f-2f40-462f-919d-738cd894c38b service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:35.412243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f61567c6-ddbf-4c55-88e0-fba0fc910ea2 req-c5f63a2f-2f40-462f-919d-738cd894c38b service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:35.426912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-f61567c6-ddbf-4c55-88e0-fba0fc910ea2 req-c5f63a2f-2f40-462f-919d-738cd894c38b service nova] Creating event network-changed:ade7b021-b99e-4c55-93bb-537d28c2a53d for instance 7582188f-bfab-4218-9104-9fb384141c57 on hv-cinder-86236 Oct 28 20:06:35.440913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-f61567c6-ddbf-4c55-88e0-fba0fc910ea2 req-c5f63a2f-2f40-462f-919d-738cd894c38b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046939 Oct 28 20:06:35.447181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 92/190] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:35.863863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3b10b76b-e733-4961-98e4-3d02428f6b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:35.864656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3b10b76b-e733-4961-98e4-3d02428f6b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:35.874030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b10b76b-e733-4961-98e4-3d02428f6b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:35.879633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b10b76b-e733-4961-98e4-3d02428f6b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:35.883980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b10b76b-e733-4961-98e4-3d02428f6b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:35.887469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b10b76b-e733-4961-98e4-3d02428f6b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:35.888691 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b10b76b-e733-4961-98e4-3d02428f6b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:35.890693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b10b76b-e733-4961-98e4-3d02428f6b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:36.132182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3b10b76b-e733-4961-98e4-3d02428f6b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:36.141023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3b10b76b-e733-4961-98e4-3d02428f6b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.281098 Oct 28 20:06:36.141631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 99/191] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:35 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:36.403824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-56881432-c25e-4765-afd1-52c07a3e3560 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:36.405124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-56881432-c25e-4765-afd1-52c07a3e3560 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:36.418697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56881432-c25e-4765-afd1-52c07a3e3560 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:36.420046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56881432-c25e-4765-afd1-52c07a3e3560 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:36.421302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56881432-c25e-4765-afd1-52c07a3e3560 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:36.422706 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56881432-c25e-4765-afd1-52c07a3e3560 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:36.423192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56881432-c25e-4765-afd1-52c07a3e3560 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:36.424638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56881432-c25e-4765-afd1-52c07a3e3560 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:36.581534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-56881432-c25e-4765-afd1-52c07a3e3560 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:36.591598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-56881432-c25e-4765-afd1-52c07a3e3560 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1554 microversion: 2.1 time: 0.191789 Oct 28 20:06:36.592850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 93/192] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:36 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:37.166454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cab7a2ac-78e9-4f17-ac58-b1daebec6c2a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:37.167229 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cab7a2ac-78e9-4f17-ac58-b1daebec6c2a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:37.175899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab7a2ac-78e9-4f17-ac58-b1daebec6c2a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:37.176501 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab7a2ac-78e9-4f17-ac58-b1daebec6c2a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:37.177095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab7a2ac-78e9-4f17-ac58-b1daebec6c2a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:37.178486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab7a2ac-78e9-4f17-ac58-b1daebec6c2a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:37.179197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab7a2ac-78e9-4f17-ac58-b1daebec6c2a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:37.179834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab7a2ac-78e9-4f17-ac58-b1daebec6c2a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:37.435652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cab7a2ac-78e9-4f17-ac58-b1daebec6c2a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:37.456411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cab7a2ac-78e9-4f17-ac58-b1daebec6c2a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.295095 Oct 28 20:06:37.465920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 100/193] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:37 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:37.478941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d607e286-413a-46fe-b06a-a9408c4d0a4e req-7ccfdce2-cdd9-4bb3-b790-b14d4b105a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e31cf1aa-d94a-4bda-aa9c-1119bfb932bb", "name": "network-vif-deleted", "tag": "94c8fbd6-55bd-42ab-9636-b03f381a547b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:37.489835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d607e286-413a-46fe-b06a-a9408c4d0a4e req-7ccfdce2-cdd9-4bb3-b790-b14d4b105a55 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:37.490310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d607e286-413a-46fe-b06a-a9408c4d0a4e req-7ccfdce2-cdd9-4bb3-b790-b14d4b105a55 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:37.493175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d607e286-413a-46fe-b06a-a9408c4d0a4e req-7ccfdce2-cdd9-4bb3-b790-b14d4b105a55 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:37.509396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d607e286-413a-46fe-b06a-a9408c4d0a4e req-7ccfdce2-cdd9-4bb3-b790-b14d4b105a55 service nova] Creating event network-vif-deleted:94c8fbd6-55bd-42ab-9636-b03f381a547b for instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb on hv-cinder-86236 Oct 28 20:06:37.522826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d607e286-413a-46fe-b06a-a9408c4d0a4e req-7ccfdce2-cdd9-4bb3-b790-b14d4b105a55 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047298 Oct 28 20:06:37.523433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 94/194] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:37.615766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d7c14583-0abc-42c4-83fb-830dafd9bf94 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:37.616263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d7c14583-0abc-42c4-83fb-830dafd9bf94 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:37.622913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7c14583-0abc-42c4-83fb-830dafd9bf94 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:37.623733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7c14583-0abc-42c4-83fb-830dafd9bf94 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:37.624240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7c14583-0abc-42c4-83fb-830dafd9bf94 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:37.624843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7c14583-0abc-42c4-83fb-830dafd9bf94 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:37.625475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7c14583-0abc-42c4-83fb-830dafd9bf94 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:37.625896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7c14583-0abc-42c4-83fb-830dafd9bf94 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:37.691451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d7c14583-0abc-42c4-83fb-830dafd9bf94 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:37.701378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d7c14583-0abc-42c4-83fb-830dafd9bf94 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1512 microversion: 2.1 time: 0.089384 Oct 28 20:06:37.703445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 101/195] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:37 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1512 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:38.481611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4830f953-da3e-4984-baa9-c852018011e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:38.482383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4830f953-da3e-4984-baa9-c852018011e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:38.488274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4830f953-da3e-4984-baa9-c852018011e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:38.488761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4830f953-da3e-4984-baa9-c852018011e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:38.489202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4830f953-da3e-4984-baa9-c852018011e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:38.489922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4830f953-da3e-4984-baa9-c852018011e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:38.490377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4830f953-da3e-4984-baa9-c852018011e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:38.490800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4830f953-da3e-4984-baa9-c852018011e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:38.628014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4830f953-da3e-4984-baa9-c852018011e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:38.635909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4830f953-da3e-4984-baa9-c852018011e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.158478 Oct 28 20:06:38.636478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 95/196] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:38 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:38.726865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee4a59a8-acd6-4fb8-9598-20a1b5730b5b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:38.727414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee4a59a8-acd6-4fb8-9598-20a1b5730b5b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:38.734218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee4a59a8-acd6-4fb8-9598-20a1b5730b5b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:38.734694 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee4a59a8-acd6-4fb8-9598-20a1b5730b5b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:38.735127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee4a59a8-acd6-4fb8-9598-20a1b5730b5b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:38.735810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee4a59a8-acd6-4fb8-9598-20a1b5730b5b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:38.736263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee4a59a8-acd6-4fb8-9598-20a1b5730b5b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:38.736717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee4a59a8-acd6-4fb8-9598-20a1b5730b5b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:38.797768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee4a59a8-acd6-4fb8-9598-20a1b5730b5b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:38.805843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee4a59a8-acd6-4fb8-9598-20a1b5730b5b tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1512 microversion: 2.1 time: 0.083065 Oct 28 20:06:38.810179 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 102/197] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:38 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1512 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:39.659730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-933c0753-ea87-4c7e-b72f-58b556933a18 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:39.662928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-933c0753-ea87-4c7e-b72f-58b556933a18 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:39.667146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-933c0753-ea87-4c7e-b72f-58b556933a18 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:39.667628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-933c0753-ea87-4c7e-b72f-58b556933a18 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:39.668213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-933c0753-ea87-4c7e-b72f-58b556933a18 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:39.671331 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-933c0753-ea87-4c7e-b72f-58b556933a18 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:39.671799 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-933c0753-ea87-4c7e-b72f-58b556933a18 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:39.672221 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-933c0753-ea87-4c7e-b72f-58b556933a18 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:39.830387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-da7f2f62-d395-4898-93b1-99438b12d26d tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:39.831054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-da7f2f62-d395-4898-93b1-99438b12d26d tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:39.832303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-933c0753-ea87-4c7e-b72f-58b556933a18 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:39.837742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da7f2f62-d395-4898-93b1-99438b12d26d tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:39.838274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da7f2f62-d395-4898-93b1-99438b12d26d tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:39.839062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da7f2f62-d395-4898-93b1-99438b12d26d tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:39.840049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da7f2f62-d395-4898-93b1-99438b12d26d tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:39.841247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da7f2f62-d395-4898-93b1-99438b12d26d tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:39.841852 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da7f2f62-d395-4898-93b1-99438b12d26d tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:39.846820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:39.851112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-933c0753-ea87-4c7e-b72f-58b556933a18 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.194716 Oct 28 20:06:39.851112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 96/198] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:39 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:39.918513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-da7f2f62-d395-4898-93b1-99438b12d26d tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:39.928062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-da7f2f62-d395-4898-93b1-99438b12d26d tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1345 microversion: 2.1 time: 0.101446 Oct 28 20:06:39.928637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 103/199] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:39 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:40.885587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e276ece8-3803-46c2-a15a-611c761b2e47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:40.891052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e276ece8-3803-46c2-a15a-611c761b2e47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:40.892755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e276ece8-3803-46c2-a15a-611c761b2e47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:40.893233 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e276ece8-3803-46c2-a15a-611c761b2e47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:40.893697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e276ece8-3803-46c2-a15a-611c761b2e47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:40.894376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e276ece8-3803-46c2-a15a-611c761b2e47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:40.894828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e276ece8-3803-46c2-a15a-611c761b2e47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:40.895295 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e276ece8-3803-46c2-a15a-611c761b2e47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:40.951595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05b8b09a-db96-48d6-b880-d38fc6543fb4 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:40.952266 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-05b8b09a-db96-48d6-b880-d38fc6543fb4 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:40.958422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05b8b09a-db96-48d6-b880-d38fc6543fb4 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:40.958903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05b8b09a-db96-48d6-b880-d38fc6543fb4 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:40.959329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05b8b09a-db96-48d6-b880-d38fc6543fb4 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:40.960007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05b8b09a-db96-48d6-b880-d38fc6543fb4 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:40.960451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05b8b09a-db96-48d6-b880-d38fc6543fb4 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:40.961090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05b8b09a-db96-48d6-b880-d38fc6543fb4 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:40.993116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05b8b09a-db96-48d6-b880-d38fc6543fb4 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:40.993626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05b8b09a-db96-48d6-b880-d38fc6543fb4 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:40.994054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05b8b09a-db96-48d6-b880-d38fc6543fb4 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:40.994596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-05b8b09a-db96-48d6-b880-d38fc6543fb4 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lazy-loading 'fault' on Instance uuid e31cf1aa-d94a-4bda-aa9c-1119bfb932bb {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:06:41.054169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-05b8b09a-db96-48d6-b880-d38fc6543fb4 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3396bc67ae4f6c9c8808653fef4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fa4f575da04bc39b8df1e74fb77035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:41.058974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e276ece8-3803-46c2-a15a-611c761b2e47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:41.064747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05b8b09a-db96-48d6-b880-d38fc6543fb4 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 200 len: 1350 microversion: 2.1 time: 0.117235 Oct 28 20:06:41.065679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 104/200] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:40 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 1350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:41.068051 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e276ece8-3803-46c2-a15a-611c761b2e47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.186153 Oct 28 20:06:41.069338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 97/201] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:40 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:42.088443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ec802061-2926-4033-b082-31af4abd0194 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:42.089060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ec802061-2926-4033-b082-31af4abd0194 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:42.091541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dc1665f2-7f6f-4891-a040-a44f9406e578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:42.092351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dc1665f2-7f6f-4891-a040-a44f9406e578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:42.095552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec802061-2926-4033-b082-31af4abd0194 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:42.096052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec802061-2926-4033-b082-31af4abd0194 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:42.096491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec802061-2926-4033-b082-31af4abd0194 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:42.097196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec802061-2926-4033-b082-31af4abd0194 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:42.097734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec802061-2926-4033-b082-31af4abd0194 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:42.102704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec802061-2926-4033-b082-31af4abd0194 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:42.102808 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc1665f2-7f6f-4891-a040-a44f9406e578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:42.102808 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc1665f2-7f6f-4891-a040-a44f9406e578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:42.102808 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc1665f2-7f6f-4891-a040-a44f9406e578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:42.102808 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc1665f2-7f6f-4891-a040-a44f9406e578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:42.103088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc1665f2-7f6f-4891-a040-a44f9406e578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:42.103088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc1665f2-7f6f-4891-a040-a44f9406e578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:42.112306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-ec802061-2926-4033-b082-31af4abd0194 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] HTTP exception thrown: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ec802061-2926-4033-b082-31af4abd0194 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Request method failure captured: Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb HTTP/1.1 Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYXn0-KZf95hEGhyyhfLygwMSe1uOk-hZ89Mi6OE1mEUirFSYsCw40Kl7cigk4vXcHSoO8a_y5PBjIccPPTOFu0eAMvmgtz-7iGcRJb4Oiu57FP-4jHijnU5D-0VmiXtaDiO-ELsF5oDS7R9nPvEPyRCyxM87PY49WoPYM6tuBcwyo Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 40fa4f575da04bc39b8df1e74fb77035 Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersTestJSON-406600942 Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:06:42.117203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:06:42.118711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/40fa4f575da04bc39b8df1e74fb77035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/40fa4f575da04bc39b8df1e74fb77035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/40fa4f575da04bc39b8df1e74fb77035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_40fa4f575da04bc39b8df1e74fb77035", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:06:42.118711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersTestJSON-406600942 Oct 28 20:06:42.118711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 40fa4f575da04bc39b8df1e74fb77035 Oct 28 20:06:42.118711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersTestJSON-406600942 Oct 28 20:06:42.118711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-DeleteServersTestJSON-406600942-project Oct 28 20:06:42.118711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:06:42.118711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:06:42.118711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: 1b3396bc67ae4f6c9c8808653fef4676 Oct 28 20:06:42.118711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersTestJSON-406600942-project Oct 28 20:06:42.118711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:06:42.118711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:42.118711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': 'e31cf1aa-d94a-4bda-aa9c-1119bfb932bb'} Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:06:42.119429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:42.120564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:42.121634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ec802061-2926-4033-b082-31af4abd0194 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Returning 404 to user: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:06:42.121634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ec802061-2926-4033-b082-31af4abd0194 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 404 len: 111 microversion: 2.1 time: 0.034239 Oct 28 20:06:42.121634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 105/202] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:42 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:06:42.244026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4fea8005-f69e-4d48-b264-8e64c979c35c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:42.244626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-dc1665f2-7f6f-4891-a040-a44f9406e578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:42.246591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4fea8005-f69e-4d48-b264-8e64c979c35c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:42.253486 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dc1665f2-7f6f-4891-a040-a44f9406e578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.165976 Oct 28 20:06:42.253809 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fea8005-f69e-4d48-b264-8e64c979c35c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:42.254263 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 98/203] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:42 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:42.256829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fea8005-f69e-4d48-b264-8e64c979c35c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:42.256829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fea8005-f69e-4d48-b264-8e64c979c35c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:42.256829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fea8005-f69e-4d48-b264-8e64c979c35c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:42.256829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fea8005-f69e-4d48-b264-8e64c979c35c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:42.257272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fea8005-f69e-4d48-b264-8e64c979c35c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:42.270544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-4fea8005-f69e-4d48-b264-8e64c979c35c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] HTTP exception thrown: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4fea8005-f69e-4d48-b264-8e64c979c35c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Request method failure captured: Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb/os-volume_attachments HTTP/1.1 Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYXn0-KZf95hEGhyyhfLygwMSe1uOk-hZ89Mi6OE1mEUirFSYsCw40Kl7cigk4vXcHSoO8a_y5PBjIccPPTOFu0eAMvmgtz-7iGcRJb4Oiu57FP-4jHijnU5D-0VmiXtaDiO-ELsF5oDS7R9nPvEPyRCyxM87PY49WoPYM6tuBcwyo Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 40fa4f575da04bc39b8df1e74fb77035 Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersTestJSON-406600942 Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:06:42.272325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:06:42.273728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/40fa4f575da04bc39b8df1e74fb77035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/40fa4f575da04bc39b8df1e74fb77035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/40fa4f575da04bc39b8df1e74fb77035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_40fa4f575da04bc39b8df1e74fb77035", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:06:42.273728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersTestJSON-406600942 Oct 28 20:06:42.273728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 40fa4f575da04bc39b8df1e74fb77035 Oct 28 20:06:42.273728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersTestJSON-406600942 Oct 28 20:06:42.273728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-DeleteServersTestJSON-406600942-project Oct 28 20:06:42.273728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:06:42.273728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:06:42.273728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: 1b3396bc67ae4f6c9c8808653fef4676 Oct 28 20:06:42.273728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersTestJSON-406600942-project Oct 28 20:06:42.273728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:06:42.273728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:42.273728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'server_id': 'e31cf1aa-d94a-4bda-aa9c-1119bfb932bb'} Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:06:42.274633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:42.275979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:42.277299 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4fea8005-f69e-4d48-b264-8e64c979c35c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Returning 404 to user: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:06:42.277299 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4fea8005-f69e-4d48-b264-8e64c979c35c tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033680 Oct 28 20:06:42.277299 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 106/204] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:06:42 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 20:06:43.276142 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3b93ddd6-a236-4bb4-a858-80da02758206 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:43.276833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3b93ddd6-a236-4bb4-a858-80da02758206 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:43.284633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b93ddd6-a236-4bb4-a858-80da02758206 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:43.285071 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b93ddd6-a236-4bb4-a858-80da02758206 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:43.285556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b93ddd6-a236-4bb4-a858-80da02758206 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:43.286286 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b93ddd6-a236-4bb4-a858-80da02758206 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:43.286750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b93ddd6-a236-4bb4-a858-80da02758206 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:43.287392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b93ddd6-a236-4bb4-a858-80da02758206 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:43.431803 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3b93ddd6-a236-4bb4-a858-80da02758206 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:43.440695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3b93ddd6-a236-4bb4-a858-80da02758206 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.168377 Oct 28 20:06:43.441340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 99/205] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:43 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:43.601902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f04f0b6b-eaf2-450e-b1f7-825e185ec392 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:43.608823 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f04f0b6b-eaf2-450e-b1f7-825e185ec392 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:43.608823 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04f0b6b-eaf2-450e-b1f7-825e185ec392 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:43.609134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04f0b6b-eaf2-450e-b1f7-825e185ec392 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:43.609479 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04f0b6b-eaf2-450e-b1f7-825e185ec392 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:43.610173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04f0b6b-eaf2-450e-b1f7-825e185ec392 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:43.610628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04f0b6b-eaf2-450e-b1f7-825e185ec392 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:43.611053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04f0b6b-eaf2-450e-b1f7-825e185ec392 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:43.626268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-f04f0b6b-eaf2-450e-b1f7-825e185ec392 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] HTTP exception thrown: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f04f0b6b-eaf2-450e-b1f7-825e185ec392 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Request method failure captured: Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb HTTP/1.1 Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYXn0-KZf95hEGhyyhfLygwMSe1uOk-hZ89Mi6OE1mEUirFSYsCw40Kl7cigk4vXcHSoO8a_y5PBjIccPPTOFu0eAMvmgtz-7iGcRJb4Oiu57FP-4jHijnU5D-0VmiXtaDiO-ELsF5oDS7R9nPvEPyRCyxM87PY49WoPYM6tuBcwyo Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 40fa4f575da04bc39b8df1e74fb77035 Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersTestJSON-406600942 Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:06:43.627843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:06:43.628980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/40fa4f575da04bc39b8df1e74fb77035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/40fa4f575da04bc39b8df1e74fb77035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/40fa4f575da04bc39b8df1e74fb77035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_40fa4f575da04bc39b8df1e74fb77035", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:06:43.628980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersTestJSON-406600942 Oct 28 20:06:43.628980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 40fa4f575da04bc39b8df1e74fb77035 Oct 28 20:06:43.628980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersTestJSON-406600942 Oct 28 20:06:43.628980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-DeleteServersTestJSON-406600942-project Oct 28 20:06:43.628980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:06:43.628980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:06:43.628980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: 1b3396bc67ae4f6c9c8808653fef4676 Oct 28 20:06:43.628980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersTestJSON-406600942-project Oct 28 20:06:43.628980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:06:43.628980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:43.628980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': 'e31cf1aa-d94a-4bda-aa9c-1119bfb932bb'} Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:06:43.634598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:43.635630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:43.636886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f04f0b6b-eaf2-450e-b1f7-825e185ec392 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Returning 404 to user: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:06:43.636886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f04f0b6b-eaf2-450e-b1f7-825e185ec392 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 404 len: 111 microversion: 2.1 time: 0.031239 Oct 28 20:06:43.636886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 107/206] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:06:43 2022] DELETE /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:06:43.643239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef5a5319-19a8-491a-83e1-16b6e78cc8b3 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:43.643889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef5a5319-19a8-491a-83e1-16b6e78cc8b3 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] [instance: e31cf1aa-d94a-4bda-aa9c-1119bfb932bb] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:43.649961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef5a5319-19a8-491a-83e1-16b6e78cc8b3 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:43.650448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef5a5319-19a8-491a-83e1-16b6e78cc8b3 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:43.651058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef5a5319-19a8-491a-83e1-16b6e78cc8b3 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:43.651799 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef5a5319-19a8-491a-83e1-16b6e78cc8b3 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:43.652258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef5a5319-19a8-491a-83e1-16b6e78cc8b3 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:43.652686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef5a5319-19a8-491a-83e1-16b6e78cc8b3 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:43.667613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-ef5a5319-19a8-491a-83e1-16b6e78cc8b3 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] HTTP exception thrown: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef5a5319-19a8-491a-83e1-16b6e78cc8b3 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Request method failure captured: Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb HTTP/1.1 Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDYXn0-KZf95hEGhyyhfLygwMSe1uOk-hZ89Mi6OE1mEUirFSYsCw40Kl7cigk4vXcHSoO8a_y5PBjIccPPTOFu0eAMvmgtz-7iGcRJb4Oiu57FP-4jHijnU5D-0VmiXtaDiO-ELsF5oDS7R9nPvEPyRCyxM87PY49WoPYM6tuBcwyo Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 40fa4f575da04bc39b8df1e74fb77035 Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-DeleteServersTestJSON-406600942 Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:06:43.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:06:43.675744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/40fa4f575da04bc39b8df1e74fb77035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/40fa4f575da04bc39b8df1e74fb77035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/40fa4f575da04bc39b8df1e74fb77035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_40fa4f575da04bc39b8df1e74fb77035", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:06:43.675744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-DeleteServersTestJSON-406600942 Oct 28 20:06:43.675744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 40fa4f575da04bc39b8df1e74fb77035 Oct 28 20:06:43.675744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-DeleteServersTestJSON-406600942 Oct 28 20:06:43.675744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-DeleteServersTestJSON-406600942-project Oct 28 20:06:43.675744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:06:43.675744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:06:43.675744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: 1b3396bc67ae4f6c9c8808653fef4676 Oct 28 20:06:43.675744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-DeleteServersTestJSON-406600942-project Oct 28 20:06:43.675744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:06:43.675744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:43.675744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': 'e31cf1aa-d94a-4bda-aa9c-1119bfb932bb'} Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:06:43.676597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. Oct 28 20:06:43.677963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:43.679296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef5a5319-19a8-491a-83e1-16b6e78cc8b3 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] Returning 404 to user: Instance e31cf1aa-d94a-4bda-aa9c-1119bfb932bb could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:06:43.679296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ef5a5319-19a8-491a-83e1-16b6e78cc8b3 tempest-DeleteServersTestJSON-406600942 tempest-DeleteServersTestJSON-406600942-project] 10.222.0.66 "GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb" status: 404 len: 111 microversion: 2.1 time: 0.036453 Oct 28 20:06:43.679296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 100/207] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:43 2022] GET /compute/v2.1/servers/e31cf1aa-d94a-4bda-aa9c-1119bfb932bb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:06:44.464841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1c76d0b4-fcea-4ee0-af5a-f64732a1081c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:44.465641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1c76d0b4-fcea-4ee0-af5a-f64732a1081c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:44.472188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c76d0b4-fcea-4ee0-af5a-f64732a1081c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:44.472847 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c76d0b4-fcea-4ee0-af5a-f64732a1081c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:44.473399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c76d0b4-fcea-4ee0-af5a-f64732a1081c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:44.474271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c76d0b4-fcea-4ee0-af5a-f64732a1081c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:44.474963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c76d0b4-fcea-4ee0-af5a-f64732a1081c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:44.475513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c76d0b4-fcea-4ee0-af5a-f64732a1081c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:44.626474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1c76d0b4-fcea-4ee0-af5a-f64732a1081c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:44.635746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1c76d0b4-fcea-4ee0-af5a-f64732a1081c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.175364 Oct 28 20:06:44.636579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 108/208] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:44 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:45.659497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-56c60ac5-09e3-4faf-a7ec-a00a39e1bdc4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:45.660840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-56c60ac5-09e3-4faf-a7ec-a00a39e1bdc4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:45.673584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c60ac5-09e3-4faf-a7ec-a00a39e1bdc4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:45.674101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c60ac5-09e3-4faf-a7ec-a00a39e1bdc4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:45.674549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c60ac5-09e3-4faf-a7ec-a00a39e1bdc4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:45.675401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c60ac5-09e3-4faf-a7ec-a00a39e1bdc4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:45.675911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c60ac5-09e3-4faf-a7ec-a00a39e1bdc4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:45.676340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c60ac5-09e3-4faf-a7ec-a00a39e1bdc4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:45.692582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:46.317639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-56c60ac5-09e3-4faf-a7ec-a00a39e1bdc4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:46.328219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-56c60ac5-09e3-4faf-a7ec-a00a39e1bdc4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.672652 Oct 28 20:06:46.333863 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 101/209] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:45 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:47.354281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d0f4de73-967b-40ee-b13a-255ee47108ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:47.356363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d0f4de73-967b-40ee-b13a-255ee47108ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:47.363900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0f4de73-967b-40ee-b13a-255ee47108ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:47.364397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0f4de73-967b-40ee-b13a-255ee47108ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:47.364834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0f4de73-967b-40ee-b13a-255ee47108ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:47.365598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0f4de73-967b-40ee-b13a-255ee47108ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:47.366247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0f4de73-967b-40ee-b13a-255ee47108ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:47.371166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0f4de73-967b-40ee-b13a-255ee47108ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:47.568291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0f4de73-967b-40ee-b13a-255ee47108ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:47.577603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d0f4de73-967b-40ee-b13a-255ee47108ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.227111 Oct 28 20:06:47.590165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 109/210] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:47 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:48.602573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a9cc6a51-c58f-4cfc-8287-34d295aa40d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:48.603187 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a9cc6a51-c58f-4cfc-8287-34d295aa40d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:48.610413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9cc6a51-c58f-4cfc-8287-34d295aa40d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:48.610895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9cc6a51-c58f-4cfc-8287-34d295aa40d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:48.611388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9cc6a51-c58f-4cfc-8287-34d295aa40d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:48.612076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9cc6a51-c58f-4cfc-8287-34d295aa40d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:48.612533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9cc6a51-c58f-4cfc-8287-34d295aa40d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:48.612955 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9cc6a51-c58f-4cfc-8287-34d295aa40d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:48.768726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a9cc6a51-c58f-4cfc-8287-34d295aa40d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:48.776843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a9cc6a51-c58f-4cfc-8287-34d295aa40d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.178075 Oct 28 20:06:48.792952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 102/211] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:48 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:49.800992 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49ff2fcf-1a12-43ae-8ae6-c9466fa6313c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:49.804453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-49ff2fcf-1a12-43ae-8ae6-c9466fa6313c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:49.815139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ff2fcf-1a12-43ae-8ae6-c9466fa6313c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:49.815646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ff2fcf-1a12-43ae-8ae6-c9466fa6313c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:49.818811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ff2fcf-1a12-43ae-8ae6-c9466fa6313c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:49.821150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ff2fcf-1a12-43ae-8ae6-c9466fa6313c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:49.821671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ff2fcf-1a12-43ae-8ae6-c9466fa6313c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:49.822107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ff2fcf-1a12-43ae-8ae6-c9466fa6313c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:50.044960 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-49ff2fcf-1a12-43ae-8ae6-c9466fa6313c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:50.052922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-49ff2fcf-1a12-43ae-8ae6-c9466fa6313c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.256108 Oct 28 20:06:50.053549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 110/212] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:49 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:51.076587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-287cddb5-b344-42f5-a539-cda32f72c9d4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:51.077350 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-287cddb5-b344-42f5-a539-cda32f72c9d4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:51.079873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:51.084694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-287cddb5-b344-42f5-a539-cda32f72c9d4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:51.085183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-287cddb5-b344-42f5-a539-cda32f72c9d4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:51.085898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-287cddb5-b344-42f5-a539-cda32f72c9d4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:51.086744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-287cddb5-b344-42f5-a539-cda32f72c9d4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:51.087214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-287cddb5-b344-42f5-a539-cda32f72c9d4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:51.087802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-287cddb5-b344-42f5-a539-cda32f72c9d4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:51.243928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-287cddb5-b344-42f5-a539-cda32f72c9d4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:51.265450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-287cddb5-b344-42f5-a539-cda32f72c9d4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.180118 Oct 28 20:06:51.265450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 103/213] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:51 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:51.493449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6749976f-1a02-462f-8502-7538d311bf96 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Action: 'create', calling method: .version_select at 0x7f1f4d0cdf70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-765236500", "metadata": {"Type": "work"}}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6749976f-1a02-462f-8502-7538d311bf96 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Request method failure captured: Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 121 Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDZbkASmrikBTyOrgUWRLzc0ZAaK4xScurb7e1mWEB4JGv227EmN5grD5hOjZBo-KNcK6P4V4f8fG2HtHyxq6w35pJ88ZE8h1QqagtZvRIuhBfxQykWg6-vBGmcPKsvMYS8D9jTTA8vJVc9JBLEDsQP39FVyYdFEA7kM5B1FgU4UM5g Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 801236b29780486981d6f3105f61ea56 Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:06:51.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:06:51.506599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/801236b29780486981d6f3105f61ea56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/801236b29780486981d6f3105f61ea56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/801236b29780486981d6f3105f61ea56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_801236b29780486981d6f3105f61ea56", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:06:51.506599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.506599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 801236b29780486981d6f3105f61ea56 Oct 28 20:06:51.506599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.506599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-VolumesNegativeTest-238427404-project Oct 28 20:06:51.506599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:06:51.506599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:06:51.506599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: aa8812ac328e45a8aae8f57d2a69efa3 Oct 28 20:06:51.506599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-VolumesNegativeTest-238427404-project Oct 28 20:06:51.506599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Oct 28 20:06:51.506599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-765236500", "metadata": {"Type": "work"}}} Oct 28 20:06:51.506599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: Oct 28 20:06:51.506599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-765236500', 'metadata': {'Type': 'work'}}}} Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi '#$%' Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:06:51.507491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 20:06:51.509030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 20:06:51.510374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 20:06:51.510374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.511270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6749976f-1a02-462f-8502-7538d311bf96 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:06:51.512335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6749976f-1a02-462f-8502-7538d311bf96 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.152803 Oct 28 20:06:51.513145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 111/214] 10.222.0.66 () {60 vars in 1156 bytes} [Fri Oct 28 20:06:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 20:06:51.525893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-70540ce1-f5fb-4d29-8952-6547828c746d tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Action: 'create', calling method: .version_select at 0x7f1f4d27f550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2139401852", "metadata": {"Type": "work"}}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-70540ce1-f5fb-4d29-8952-6547828c746d tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Request method failure captured: Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 120 Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDZbkASmrikBTyOrgUWRLzc0ZAaK4xScurb7e1mWEB4JGv227EmN5grD5hOjZBo-KNcK6P4V4f8fG2HtHyxq6w35pJ88ZE8h1QqagtZvRIuhBfxQykWg6-vBGmcPKsvMYS8D9jTTA8vJVc9JBLEDsQP39FVyYdFEA7kM5B1FgU4UM5g Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 801236b29780486981d6f3105f61ea56 Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:06:51.531242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:06:51.537964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/801236b29780486981d6f3105f61ea56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/801236b29780486981d6f3105f61ea56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/801236b29780486981d6f3105f61ea56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_801236b29780486981d6f3105f61ea56", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:06:51.537964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.537964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 801236b29780486981d6f3105f61ea56 Oct 28 20:06:51.537964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.537964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-VolumesNegativeTest-238427404-project Oct 28 20:06:51.537964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:06:51.537964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:06:51.537964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: aa8812ac328e45a8aae8f57d2a69efa3 Oct 28 20:06:51.537964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-VolumesNegativeTest-238427404-project Oct 28 20:06:51.537964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Oct 28 20:06:51.537964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2139401852", "metadata": {"Type": "work"}}} Oct 28 20:06:51.537964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: Oct 28 20:06:51.537964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2139401852', 'metadata': {'Type': 'work'}}}} Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi '0' Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:06:51.538660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 20:06:51.539856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 20:06:51.543309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 20:06:51.543309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.543309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-70540ce1-f5fb-4d29-8952-6547828c746d tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:06:51.543309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-70540ce1-f5fb-4d29-8952-6547828c746d tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011428 Oct 28 20:06:51.543309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 104/215] 10.222.0.66 () {60 vars in 1156 bytes} [Fri Oct 28 20:06:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe2be4ab-928e-43f5-a2d7-3ab91894a454 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Action: 'create', calling method: .version_select at 0x7f1f4d0bb700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-433495121", "metadata": {"Type": "work"}}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe2be4ab-928e-43f5-a2d7-3ab91894a454 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Request method failure captured: Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 118 Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDZbkASmrikBTyOrgUWRLzc0ZAaK4xScurb7e1mWEB4JGv227EmN5grD5hOjZBo-KNcK6P4V4f8fG2HtHyxq6w35pJ88ZE8h1QqagtZvRIuhBfxQykWg6-vBGmcPKsvMYS8D9jTTA8vJVc9JBLEDsQP39FVyYdFEA7kM5B1FgU4UM5g Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 801236b29780486981d6f3105f61ea56 Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:06:51.554275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:06:51.555647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/801236b29780486981d6f3105f61ea56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/801236b29780486981d6f3105f61ea56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/801236b29780486981d6f3105f61ea56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_801236b29780486981d6f3105f61ea56", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:06:51.555647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.555647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 801236b29780486981d6f3105f61ea56 Oct 28 20:06:51.555647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.555647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-VolumesNegativeTest-238427404-project Oct 28 20:06:51.555647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:06:51.555647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:06:51.555647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: aa8812ac328e45a8aae8f57d2a69efa3 Oct 28 20:06:51.555647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-VolumesNegativeTest-238427404-project Oct 28 20:06:51.555647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Oct 28 20:06:51.555647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-433495121", "metadata": {"Type": "work"}}} Oct 28 20:06:51.555647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: Oct 28 20:06:51.555647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-433495121', 'metadata': {'Type': 'work'}}}} Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi '' Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:06:51.556352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 20:06:51.558378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 20:06:51.561872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 20:06:51.561872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.561872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe2be4ab-928e-43f5-a2d7-3ab91894a454 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:06:51.561872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fe2be4ab-928e-43f5-a2d7-3ab91894a454 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010539 Oct 28 20:06:51.566726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-73bb349a-141a-4266-9b77-f98125a6fc89 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Calling method '.version_select at 0x7f1f4d052040>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:51.568309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 112/216] 10.222.0.66 () {60 vars in 1156 bytes} [Fri Oct 28 20:06:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 20:06:51.629189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-73bb349a-141a-4266-9b77-f98125a6fc89 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] HTTP exception thrown: Volume tempest-invalid-1029694225 could not be found. Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-73bb349a-141a-4266-9b77-f98125a6fc89 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Request method failure captured: Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1029694225 HTTP/1.1 Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDZbkASmrikBTyOrgUWRLzc0ZAaK4xScurb7e1mWEB4JGv227EmN5grD5hOjZBo-KNcK6P4V4f8fG2HtHyxq6w35pJ88ZE8h1QqagtZvRIuhBfxQykWg6-vBGmcPKsvMYS8D9jTTA8vJVc9JBLEDsQP39FVyYdFEA7kM5B1FgU4UM5g Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 801236b29780486981d6f3105f61ea56 Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:06:51.631998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:06:51.634611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/801236b29780486981d6f3105f61ea56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/801236b29780486981d6f3105f61ea56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/801236b29780486981d6f3105f61ea56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_801236b29780486981d6f3105f61ea56", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:06:51.634611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.634611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 801236b29780486981d6f3105f61ea56 Oct 28 20:06:51.634611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.634611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-VolumesNegativeTest-238427404-project Oct 28 20:06:51.634611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:06:51.634611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:06:51.634611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: aa8812ac328e45a8aae8f57d2a69efa3 Oct 28 20:06:51.634611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-VolumesNegativeTest-238427404-project Oct 28 20:06:51.634611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: Oct 28 20:06:51.634611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Volume tempest-invalid-1029694225 could not be found. Oct 28 20:06:51.634611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': 'tempest-invalid-1029694225'} Oct 28 20:06:51.634611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1029694225 could not be found. (HTTP 404) (Request-ID: req-fbf0ee21-3410-4780-8f11-9512fb369d10) Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:51.635294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 20:06:51.636339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1029694225 could not be found. Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:06:51.637304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1029694225 could not be found. Oct 28 20:06:51.639056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.639056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:51.639056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.639056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.639056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:51.639056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:51.639056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:06:51.639056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:06:51.639056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1029694225 could not be found. Oct 28 20:06:51.639056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.639056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-73bb349a-141a-4266-9b77-f98125a6fc89 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Returning 404 to user: Volume tempest-invalid-1029694225 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:06:51.639056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-73bb349a-141a-4266-9b77-f98125a6fc89 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1029694225" status: 404 len: 99 microversion: 2.1 time: 0.071002 Oct 28 20:06:51.639056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 105/217] 10.222.0.66 () {58 vars in 1218 bytes} [Fri Oct 28 20:06:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1029694225 => generated 99 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 20:06:51.646941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14f4fcc5-4855-4d41-b39b-82a381e5756d tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003909 Oct 28 20:06:51.647439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 113/218] 10.222.0.66 () {58 vars in 1140 bytes} [Fri Oct 28 20:06:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 20:06:51.658003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0d6c06ba-1291-4587-8295-fb7e9e16dc31 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005578 Oct 28 20:06:51.658509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 106/219] 10.222.0.66 () {58 vars in 1137 bytes} [Fri Oct 28 20:06:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 20:06:51.667091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1d1d8de9-5c02-4a0a-80df-73c58077d857 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Calling method '.version_select at 0x7f1f4d2f6310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:51.697380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-1d1d8de9-5c02-4a0a-80df-73c58077d857 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] HTTP exception thrown: Volume 0c0e1607-1755-41be-a03c-f59a6ffc5513 could not be found. Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1d1d8de9-5c02-4a0a-80df-73c58077d857 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Request method failure captured: Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: DELETE /compute/v2.1/os-volumes/0c0e1607-1755-41be-a03c-f59a6ffc5513 HTTP/1.1 Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDZbkASmrikBTyOrgUWRLzc0ZAaK4xScurb7e1mWEB4JGv227EmN5grD5hOjZBo-KNcK6P4V4f8fG2HtHyxq6w35pJ88ZE8h1QqagtZvRIuhBfxQykWg6-vBGmcPKsvMYS8D9jTTA8vJVc9JBLEDsQP39FVyYdFEA7kM5B1FgU4UM5g Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 801236b29780486981d6f3105f61ea56 Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:06:51.699312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:06:51.700727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/801236b29780486981d6f3105f61ea56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/801236b29780486981d6f3105f61ea56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/801236b29780486981d6f3105f61ea56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_801236b29780486981d6f3105f61ea56", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:06:51.700727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.700727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 801236b29780486981d6f3105f61ea56 Oct 28 20:06:51.700727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.700727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-VolumesNegativeTest-238427404-project Oct 28 20:06:51.700727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:06:51.700727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:06:51.700727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: aa8812ac328e45a8aae8f57d2a69efa3 Oct 28 20:06:51.700727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-VolumesNegativeTest-238427404-project Oct 28 20:06:51.700727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: Oct 28 20:06:51.700727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Volume 0c0e1607-1755-41be-a03c-f59a6ffc5513 could not be found. Oct 28 20:06:51.700727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': '0c0e1607-1755-41be-a03c-f59a6ffc5513'} Oct 28 20:06:51.700727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0c0e1607-1755-41be-a03c-f59a6ffc5513 could not be found. (HTTP 404) (Request-ID: req-b7ef0fb3-76b3-42d5-a715-c6eaf92c524f) Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:51.701693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 20:06:51.703089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0c0e1607-1755-41be-a03c-f59a6ffc5513 could not be found. Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 20:06:51.706389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:06:51.709252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0c0e1607-1755-41be-a03c-f59a6ffc5513 could not be found. Oct 28 20:06:51.709252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.709252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:51.709252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.709252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.709252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:51.709252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:51.709252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:06:51.709252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:06:51.709252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0c0e1607-1755-41be-a03c-f59a6ffc5513 could not be found. Oct 28 20:06:51.709252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.709252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1d1d8de9-5c02-4a0a-80df-73c58077d857 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Returning 404 to user: Volume 0c0e1607-1755-41be-a03c-f59a6ffc5513 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:06:51.709252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1d1d8de9-5c02-4a0a-80df-73c58077d857 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/0c0e1607-1755-41be-a03c-f59a6ffc5513" status: 404 len: 109 microversion: 2.1 time: 0.037738 Oct 28 20:06:51.709252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 114/220] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Oct 28 20:06:51 2022] DELETE /compute/v2.1/os-volumes/0c0e1607-1755-41be-a03c-f59a6ffc5513 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:06:51.714814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ed3b379c-c4c3-454a-9522-8d04dc469082 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Calling method '.version_select at 0x7f1f4d27f670>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:51.744673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-ed3b379c-c4c3-454a-9522-8d04dc469082 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] HTTP exception thrown: Volume 89a20102-6c5c-4d28-abf8-fa3b81564d0e could not be found. Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ed3b379c-c4c3-454a-9522-8d04dc469082 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Request method failure captured: Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: GET /compute/v2.1/os-volumes/89a20102-6c5c-4d28-abf8-fa3b81564d0e HTTP/1.1 Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDZbkASmrikBTyOrgUWRLzc0ZAaK4xScurb7e1mWEB4JGv227EmN5grD5hOjZBo-KNcK6P4V4f8fG2HtHyxq6w35pJ88ZE8h1QqagtZvRIuhBfxQykWg6-vBGmcPKsvMYS8D9jTTA8vJVc9JBLEDsQP39FVyYdFEA7kM5B1FgU4UM5g Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 801236b29780486981d6f3105f61ea56 Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:06:51.746760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:06:51.748005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/801236b29780486981d6f3105f61ea56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/801236b29780486981d6f3105f61ea56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/801236b29780486981d6f3105f61ea56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_801236b29780486981d6f3105f61ea56", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:06:51.748005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.748005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 801236b29780486981d6f3105f61ea56 Oct 28 20:06:51.748005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesNegativeTest-238427404 Oct 28 20:06:51.748005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-VolumesNegativeTest-238427404-project Oct 28 20:06:51.748005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:06:51.748005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:06:51.748005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: aa8812ac328e45a8aae8f57d2a69efa3 Oct 28 20:06:51.748005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-VolumesNegativeTest-238427404-project Oct 28 20:06:51.748005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: Oct 28 20:06:51.748005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Volume 89a20102-6c5c-4d28-abf8-fa3b81564d0e could not be found. Oct 28 20:06:51.748005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': '89a20102-6c5c-4d28-abf8-fa3b81564d0e'} Oct 28 20:06:51.748005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 89a20102-6c5c-4d28-abf8-fa3b81564d0e could not be found. (HTTP 404) (Request-ID: req-ed24c417-3524-40a9-b3df-c37a54387535) Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:51.748674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 20:06:51.753923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 89a20102-6c5c-4d28-abf8-fa3b81564d0e could not be found. Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 20:06:51.755100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:06:51.756117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 89a20102-6c5c-4d28-abf8-fa3b81564d0e could not be found. Oct 28 20:06:51.756117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.756117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:51.756117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.756117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:51.756117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:51.756117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:51.756117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:06:51.756117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:06:51.756117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 89a20102-6c5c-4d28-abf8-fa3b81564d0e could not be found. Oct 28 20:06:51.756117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:06:51.756117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ed3b379c-c4c3-454a-9522-8d04dc469082 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] Returning 404 to user: Volume 89a20102-6c5c-4d28-abf8-fa3b81564d0e could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:06:51.756117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ed3b379c-c4c3-454a-9522-8d04dc469082 tempest-VolumesNegativeTest-238427404 tempest-VolumesNegativeTest-238427404-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/89a20102-6c5c-4d28-abf8-fa3b81564d0e" status: 404 len: 109 microversion: 2.1 time: 0.039280 Oct 28 20:06:51.756117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 107/221] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Oct 28 20:06:51 2022] GET /compute/v2.1/os-volumes/89a20102-6c5c-4d28-abf8-fa3b81564d0e => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:06:52.276802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e3fd658b-72eb-4765-a772-aac149598b1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:52.277516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e3fd658b-72eb-4765-a772-aac149598b1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:52.284426 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3fd658b-72eb-4765-a772-aac149598b1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:52.285373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3fd658b-72eb-4765-a772-aac149598b1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:52.286392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3fd658b-72eb-4765-a772-aac149598b1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:52.287186 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3fd658b-72eb-4765-a772-aac149598b1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:52.287696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3fd658b-72eb-4765-a772-aac149598b1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:52.288332 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3fd658b-72eb-4765-a772-aac149598b1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:52.443594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e3fd658b-72eb-4765-a772-aac149598b1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:52.452532 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e3fd658b-72eb-4765-a772-aac149598b1c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.180453 Oct 28 20:06:52.453116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 115/222] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:52 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:52.810081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1291520788", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452", "networks": [{"uuid": "4aa73c8c-7fa2-44b6-a0dd-79957dc820ff"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:52.871285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] validate_networks() for [('4aa73c8c-7fa2-44b6-a0dd-79957dc820ff', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:06:53.329458 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:06:53.330177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:06:53.331212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:06:53.331777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:06:53.332763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:06:53.346644 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:53.347732 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:53.348393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:53.350292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:53.350934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:53.351612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:53.372797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Getting quotas for project 62f0f20404ba41d3aa380a9d10eeab81. Resources: {'instances', 'ram', 'cores'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:06:53.377380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Getting quotas for user 14729da7649a4ab785ff87981968d342 and project 62f0f20404ba41d3aa380a9d10eeab81. Resources: {'instances', 'ram', 'cores'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:06:53.402891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:06:53.406395 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:06:53.477944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-681e237c-74d1-427c-97f6-5e303ad6c982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:53.479155 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-681e237c-74d1-427c-97f6-5e303ad6c982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:53.485861 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-681e237c-74d1-427c-97f6-5e303ad6c982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:53.486558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-681e237c-74d1-427c-97f6-5e303ad6c982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:53.487448 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-681e237c-74d1-427c-97f6-5e303ad6c982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:53.488165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-681e237c-74d1-427c-97f6-5e303ad6c982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:53.488507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-681e237c-74d1-427c-97f6-5e303ad6c982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:53.489143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-681e237c-74d1-427c-97f6-5e303ad6c982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:53.554672 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dcd25372-d472-4907-bbd1-93513748814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749678 Oct 28 20:06:53.555314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 108/223] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:06:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:06:53.567523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-860940e8-3373-42e2-92a3-5e4de6ab79c6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:53.568144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-860940e8-3373-42e2-92a3-5e4de6ab79c6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:53.646024 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-860940e8-3373-42e2-92a3-5e4de6ab79c6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:53.682459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-681e237c-74d1-427c-97f6-5e303ad6c982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:53.690956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-860940e8-3373-42e2-92a3-5e4de6ab79c6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1219 microversion: 2.1 time: 0.113295 Oct 28 20:06:53.692998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 109/224] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:53 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:53.709532 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-681e237c-74d1-427c-97f6-5e303ad6c982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.236224 Oct 28 20:06:53.710339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 116/225] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:53 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:54.716849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f1a199af-fc4c-47db-813c-b2154104d00d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:54.717530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f1a199af-fc4c-47db-813c-b2154104d00d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:54.724060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1a199af-fc4c-47db-813c-b2154104d00d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:54.724538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1a199af-fc4c-47db-813c-b2154104d00d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:54.724964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1a199af-fc4c-47db-813c-b2154104d00d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:54.725683 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1a199af-fc4c-47db-813c-b2154104d00d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:54.728026 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1a199af-fc4c-47db-813c-b2154104d00d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:54.728026 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1a199af-fc4c-47db-813c-b2154104d00d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:54.742768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-33e67e70-1d03-49d4-b9ee-19f04b2b3a6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:54.744014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-33e67e70-1d03-49d4-b9ee-19f04b2b3a6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:54.754731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33e67e70-1d03-49d4-b9ee-19f04b2b3a6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:54.755266 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33e67e70-1d03-49d4-b9ee-19f04b2b3a6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:54.777307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33e67e70-1d03-49d4-b9ee-19f04b2b3a6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:54.779135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33e67e70-1d03-49d4-b9ee-19f04b2b3a6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:54.780583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33e67e70-1d03-49d4-b9ee-19f04b2b3a6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:54.781224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33e67e70-1d03-49d4-b9ee-19f04b2b3a6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:54.804496 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f1a199af-fc4c-47db-813c-b2154104d00d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:54.814909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f1a199af-fc4c-47db-813c-b2154104d00d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1223 microversion: 2.1 time: 0.101235 Oct 28 20:06:54.815652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 110/226] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:54 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:54.943140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-33e67e70-1d03-49d4-b9ee-19f04b2b3a6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:54.951951 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-33e67e70-1d03-49d4-b9ee-19f04b2b3a6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.213580 Oct 28 20:06:54.952723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 117/227] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:54 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:55.844976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d2263947-e610-4ed4-8de0-b3a1537cb575 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:55.845973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d2263947-e610-4ed4-8de0-b3a1537cb575 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:55.852607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2263947-e610-4ed4-8de0-b3a1537cb575 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:55.853158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2263947-e610-4ed4-8de0-b3a1537cb575 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:55.853648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2263947-e610-4ed4-8de0-b3a1537cb575 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:55.854377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2263947-e610-4ed4-8de0-b3a1537cb575 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:55.854969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2263947-e610-4ed4-8de0-b3a1537cb575 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:55.855393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2263947-e610-4ed4-8de0-b3a1537cb575 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:55.921635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d2263947-e610-4ed4-8de0-b3a1537cb575 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:55.929476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d2263947-e610-4ed4-8de0-b3a1537cb575 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1271 microversion: 2.1 time: 0.089297 Oct 28 20:06:55.930043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 111/228] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:55 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:55.975729 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5c30bd09-6e47-4e26-b148-6f2d1dfd0478 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:55.976354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5c30bd09-6e47-4e26-b148-6f2d1dfd0478 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:55.983438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=67 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:55.984855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c30bd09-6e47-4e26-b148-6f2d1dfd0478 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:55.985427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c30bd09-6e47-4e26-b148-6f2d1dfd0478 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:55.985899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c30bd09-6e47-4e26-b148-6f2d1dfd0478 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:55.986564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c30bd09-6e47-4e26-b148-6f2d1dfd0478 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:55.987056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c30bd09-6e47-4e26-b148-6f2d1dfd0478 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:55.987496 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c30bd09-6e47-4e26-b148-6f2d1dfd0478 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:56.175206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5c30bd09-6e47-4e26-b148-6f2d1dfd0478 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:56.183208 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5c30bd09-6e47-4e26-b148-6f2d1dfd0478 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.211904 Oct 28 20:06:56.183779 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 118/229] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:55 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:56.953424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-949ebc07-7a59-4a6a-98a0-d46896274731 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:56.954044 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-949ebc07-7a59-4a6a-98a0-d46896274731 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:56.960981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-949ebc07-7a59-4a6a-98a0-d46896274731 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:56.964336 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-949ebc07-7a59-4a6a-98a0-d46896274731 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:56.964336 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-949ebc07-7a59-4a6a-98a0-d46896274731 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:56.964336 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-949ebc07-7a59-4a6a-98a0-d46896274731 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:56.964336 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-949ebc07-7a59-4a6a-98a0-d46896274731 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:56.964630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-949ebc07-7a59-4a6a-98a0-d46896274731 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:57.036504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-949ebc07-7a59-4a6a-98a0-d46896274731 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:57.045310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-949ebc07-7a59-4a6a-98a0-d46896274731 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1277 microversion: 2.1 time: 0.095939 Oct 28 20:06:57.050151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 112/230] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:56 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:57.208187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c9b901ed-22bc-4ab7-bb7c-a6a4c42c8644 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:57.208806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c9b901ed-22bc-4ab7-bb7c-a6a4c42c8644 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:57.219643 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b901ed-22bc-4ab7-bb7c-a6a4c42c8644 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:57.220145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b901ed-22bc-4ab7-bb7c-a6a4c42c8644 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:57.220586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b901ed-22bc-4ab7-bb7c-a6a4c42c8644 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:57.225551 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b901ed-22bc-4ab7-bb7c-a6a4c42c8644 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:57.226321 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b901ed-22bc-4ab7-bb7c-a6a4c42c8644 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:57.229289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b901ed-22bc-4ab7-bb7c-a6a4c42c8644 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:57.415020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c9b901ed-22bc-4ab7-bb7c-a6a4c42c8644 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:57.425995 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c9b901ed-22bc-4ab7-bb7c-a6a4c42c8644 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.222102 Oct 28 20:06:57.440035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 119/231] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:57 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:58.078540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-94e03257-8cba-4870-af81-5203cd3f699a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:58.079184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-94e03257-8cba-4870-af81-5203cd3f699a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:58.086465 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94e03257-8cba-4870-af81-5203cd3f699a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:58.086948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94e03257-8cba-4870-af81-5203cd3f699a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:58.087574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94e03257-8cba-4870-af81-5203cd3f699a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:58.088584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94e03257-8cba-4870-af81-5203cd3f699a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:58.089038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94e03257-8cba-4870-af81-5203cd3f699a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:58.089955 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94e03257-8cba-4870-af81-5203cd3f699a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:58.237575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-94e03257-8cba-4870-af81-5203cd3f699a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:58.245906 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-94e03257-8cba-4870-af81-5203cd3f699a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1319 microversion: 2.1 time: 0.172799 Oct 28 20:06:58.246502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 113/232] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:58 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:58.450124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ca3ba833-e5db-44b1-bc81-d93ce6daab43 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:58.451229 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ca3ba833-e5db-44b1-bc81-d93ce6daab43 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:58.457037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca3ba833-e5db-44b1-bc81-d93ce6daab43 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:58.460909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca3ba833-e5db-44b1-bc81-d93ce6daab43 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:58.460909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca3ba833-e5db-44b1-bc81-d93ce6daab43 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:58.460909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca3ba833-e5db-44b1-bc81-d93ce6daab43 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:58.460909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca3ba833-e5db-44b1-bc81-d93ce6daab43 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:58.461266 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca3ba833-e5db-44b1-bc81-d93ce6daab43 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:58.529540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-5be14fe9-ba56-446a-a5e2-8780e783bb3b req-a12892e9-efa3-4b7a-9531-87234d49fe19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a", "tag": "16352761-cd2a-451f-bb6b-e0cbbe3cba15"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:58.542820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5be14fe9-ba56-446a-a5e2-8780e783bb3b req-a12892e9-efa3-4b7a-9531-87234d49fe19 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:58.544930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5be14fe9-ba56-446a-a5e2-8780e783bb3b req-a12892e9-efa3-4b7a-9531-87234d49fe19 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:58.547062 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5be14fe9-ba56-446a-a5e2-8780e783bb3b req-a12892e9-efa3-4b7a-9531-87234d49fe19 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:58.575003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-5be14fe9-ba56-446a-a5e2-8780e783bb3b req-a12892e9-efa3-4b7a-9531-87234d49fe19 service nova] Creating event network-changed:16352761-cd2a-451f-bb6b-e0cbbe3cba15 for instance 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a on hv-cinder-86236 Oct 28 20:06:58.599468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-5be14fe9-ba56-446a-a5e2-8780e783bb3b req-a12892e9-efa3-4b7a-9531-87234d49fe19 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074212 Oct 28 20:06:58.600560 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 114/233] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:06:58.620746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ca3ba833-e5db-44b1-bc81-d93ce6daab43 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:58.633443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ca3ba833-e5db-44b1-bc81-d93ce6daab43 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.187176 Oct 28 20:06:58.634152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 120/234] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:58 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:59.270824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e9c123bf-87e5-4c60-a567-c9a0f157babd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:59.271437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e9c123bf-87e5-4c60-a567-c9a0f157babd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:59.277666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c123bf-87e5-4c60-a567-c9a0f157babd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:59.279199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c123bf-87e5-4c60-a567-c9a0f157babd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:59.279637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c123bf-87e5-4c60-a567-c9a0f157babd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:59.280507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c123bf-87e5-4c60-a567-c9a0f157babd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:59.281121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c123bf-87e5-4c60-a567-c9a0f157babd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:59.281647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c123bf-87e5-4c60-a567-c9a0f157babd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:59.443197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e9c123bf-87e5-4c60-a567-c9a0f157babd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:59.452390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e9c123bf-87e5-4c60-a567-c9a0f157babd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1319 microversion: 2.1 time: 0.186764 Oct 28 20:06:59.453512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 115/235] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:59 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:59.655993 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee8393bd-0ac6-4fd1-aa96-79674add7975 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:59.656610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee8393bd-0ac6-4fd1-aa96-79674add7975 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:59.662722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee8393bd-0ac6-4fd1-aa96-79674add7975 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:59.663289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee8393bd-0ac6-4fd1-aa96-79674add7975 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:59.663727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee8393bd-0ac6-4fd1-aa96-79674add7975 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:59.664417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee8393bd-0ac6-4fd1-aa96-79674add7975 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:59.664876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee8393bd-0ac6-4fd1-aa96-79674add7975 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:59.665297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee8393bd-0ac6-4fd1-aa96-79674add7975 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:59.799666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee8393bd-0ac6-4fd1-aa96-79674add7975 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:59.807638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee8393bd-0ac6-4fd1-aa96-79674add7975 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.155538 Oct 28 20:06:59.808197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 121/236] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:59 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:00.475810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-42dbcf66-b704-4844-9d8c-3046a99727db tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:00.476432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42dbcf66-b704-4844-9d8c-3046a99727db tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:00.483114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42dbcf66-b704-4844-9d8c-3046a99727db tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:00.483606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42dbcf66-b704-4844-9d8c-3046a99727db tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:00.484048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42dbcf66-b704-4844-9d8c-3046a99727db tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:00.484739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42dbcf66-b704-4844-9d8c-3046a99727db tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:00.485205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42dbcf66-b704-4844-9d8c-3046a99727db tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:00.485678 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42dbcf66-b704-4844-9d8c-3046a99727db tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:00.613199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-42dbcf66-b704-4844-9d8c-3046a99727db tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:00.620852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-42dbcf66-b704-4844-9d8c-3046a99727db tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1319 microversion: 2.1 time: 0.149132 Oct 28 20:07:00.621435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 116/237] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:00 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:00.831188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d5e748e1-2f83-4ae2-8700-a604e6ccaa6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:00.831777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d5e748e1-2f83-4ae2-8700-a604e6ccaa6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:00.837994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5e748e1-2f83-4ae2-8700-a604e6ccaa6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:00.838477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5e748e1-2f83-4ae2-8700-a604e6ccaa6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:00.838913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5e748e1-2f83-4ae2-8700-a604e6ccaa6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:00.839593 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5e748e1-2f83-4ae2-8700-a604e6ccaa6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:00.840043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5e748e1-2f83-4ae2-8700-a604e6ccaa6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:00.840467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5e748e1-2f83-4ae2-8700-a604e6ccaa6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:00.973812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d5e748e1-2f83-4ae2-8700-a604e6ccaa6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:00.981990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d5e748e1-2f83-4ae2-8700-a604e6ccaa6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.154268 Oct 28 20:07:00.982708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 122/238] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:00 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:01.643768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9e349d79-f6a6-40dd-9539-f17b201d7a92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:01.644384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9e349d79-f6a6-40dd-9539-f17b201d7a92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:01.651340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e349d79-f6a6-40dd-9539-f17b201d7a92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:01.651827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e349d79-f6a6-40dd-9539-f17b201d7a92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:01.652269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e349d79-f6a6-40dd-9539-f17b201d7a92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:01.652957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e349d79-f6a6-40dd-9539-f17b201d7a92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:01.653695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e349d79-f6a6-40dd-9539-f17b201d7a92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:01.654363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e349d79-f6a6-40dd-9539-f17b201d7a92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:01.780758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9e349d79-f6a6-40dd-9539-f17b201d7a92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:01.788701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9e349d79-f6a6-40dd-9539-f17b201d7a92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1319 microversion: 2.1 time: 0.148989 Oct 28 20:07:01.789257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 117/239] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:01 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:02.004188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bd7c161d-1eaa-4b18-bc48-9609c9b3579f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:02.004798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bd7c161d-1eaa-4b18-bc48-9609c9b3579f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:02.010639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd7c161d-1eaa-4b18-bc48-9609c9b3579f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:02.011114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd7c161d-1eaa-4b18-bc48-9609c9b3579f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:02.011542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd7c161d-1eaa-4b18-bc48-9609c9b3579f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:02.012222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd7c161d-1eaa-4b18-bc48-9609c9b3579f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:02.012749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd7c161d-1eaa-4b18-bc48-9609c9b3579f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:02.013218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd7c161d-1eaa-4b18-bc48-9609c9b3579f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:02.143154 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bd7c161d-1eaa-4b18-bc48-9609c9b3579f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:02.150815 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bd7c161d-1eaa-4b18-bc48-9609c9b3579f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.150447 Oct 28 20:07:02.151373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 123/240] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:01 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:02.812628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a4d4d8b4-1711-48ca-a138-0315cbe7345b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:02.813406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a4d4d8b4-1711-48ca-a138-0315cbe7345b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:02.819795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4d4d8b4-1711-48ca-a138-0315cbe7345b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:02.820328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4d4d8b4-1711-48ca-a138-0315cbe7345b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:02.820715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4d4d8b4-1711-48ca-a138-0315cbe7345b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:02.821424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4d4d8b4-1711-48ca-a138-0315cbe7345b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:02.821886 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4d4d8b4-1711-48ca-a138-0315cbe7345b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:02.822308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4d4d8b4-1711-48ca-a138-0315cbe7345b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:02.949921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a4d4d8b4-1711-48ca-a138-0315cbe7345b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:02.958036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a4d4d8b4-1711-48ca-a138-0315cbe7345b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1319 microversion: 2.1 time: 0.149611 Oct 28 20:07:02.958634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 118/241] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:02 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:03.413807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3fd00e11-348e-4a08-a5b3-85970e8ff0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:03.413807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3fd00e11-348e-4a08-a5b3-85970e8ff0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:03.413807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fd00e11-348e-4a08-a5b3-85970e8ff0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:03.413807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fd00e11-348e-4a08-a5b3-85970e8ff0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:03.414842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fd00e11-348e-4a08-a5b3-85970e8ff0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:03.414842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fd00e11-348e-4a08-a5b3-85970e8ff0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:03.414842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fd00e11-348e-4a08-a5b3-85970e8ff0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:03.414842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fd00e11-348e-4a08-a5b3-85970e8ff0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:03.415184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3fd00e11-348e-4a08-a5b3-85970e8ff0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:03.415184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3fd00e11-348e-4a08-a5b3-85970e8ff0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.157082 Oct 28 20:07:03.415184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 124/242] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:03 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:03.981398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7d8853e9-184d-465f-bf97-79add5c93821 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:03.987650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7d8853e9-184d-465f-bf97-79add5c93821 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:03.987650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:03.987650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:03.989924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d8853e9-184d-465f-bf97-79add5c93821 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:03.990396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d8853e9-184d-465f-bf97-79add5c93821 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:03.990849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d8853e9-184d-465f-bf97-79add5c93821 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:03.991543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d8853e9-184d-465f-bf97-79add5c93821 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:03.991998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d8853e9-184d-465f-bf97-79add5c93821 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:03.992420 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d8853e9-184d-465f-bf97-79add5c93821 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:04.168223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7d8853e9-184d-465f-bf97-79add5c93821 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:04.177577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7d8853e9-184d-465f-bf97-79add5c93821 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1319 microversion: 2.1 time: 0.200024 Oct 28 20:07:04.178388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 119/243] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:03 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:04.391704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72ef736a-346a-41cb-8ca3-c3a24a5b752b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:04.392739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-72ef736a-346a-41cb-8ca3-c3a24a5b752b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:04.400850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72ef736a-346a-41cb-8ca3-c3a24a5b752b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:04.401770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72ef736a-346a-41cb-8ca3-c3a24a5b752b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:04.402469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72ef736a-346a-41cb-8ca3-c3a24a5b752b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:04.403390 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72ef736a-346a-41cb-8ca3-c3a24a5b752b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:04.404111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72ef736a-346a-41cb-8ca3-c3a24a5b752b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:04.405673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72ef736a-346a-41cb-8ca3-c3a24a5b752b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:04.430713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:04.567417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-72ef736a-346a-41cb-8ca3-c3a24a5b752b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:04.576122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-72ef736a-346a-41cb-8ca3-c3a24a5b752b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.188834 Oct 28 20:07:04.591064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 125/244] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:04 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:05.209348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-477320c2-f399-4b49-885d-b56845da53fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:05.210241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-477320c2-f399-4b49-885d-b56845da53fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:05.218012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-477320c2-f399-4b49-885d-b56845da53fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:05.218517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-477320c2-f399-4b49-885d-b56845da53fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:05.218965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-477320c2-f399-4b49-885d-b56845da53fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:05.219681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-477320c2-f399-4b49-885d-b56845da53fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:05.220279 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-477320c2-f399-4b49-885d-b56845da53fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:05.220707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-477320c2-f399-4b49-885d-b56845da53fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:05.367996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-477320c2-f399-4b49-885d-b56845da53fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:05.375901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-477320c2-f399-4b49-885d-b56845da53fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1319 microversion: 2.1 time: 0.179682 Oct 28 20:07:05.376481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 120/245] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:05 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:05.602762 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4ca2e7d4-8519-4db3-a2ea-11542dd5ffff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:05.603402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4ca2e7d4-8519-4db3-a2ea-11542dd5ffff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:05.610060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ca2e7d4-8519-4db3-a2ea-11542dd5ffff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:05.610549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ca2e7d4-8519-4db3-a2ea-11542dd5ffff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:05.610990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ca2e7d4-8519-4db3-a2ea-11542dd5ffff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:05.611687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ca2e7d4-8519-4db3-a2ea-11542dd5ffff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:05.612181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ca2e7d4-8519-4db3-a2ea-11542dd5ffff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:05.612619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ca2e7d4-8519-4db3-a2ea-11542dd5ffff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:05.770579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4ca2e7d4-8519-4db3-a2ea-11542dd5ffff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:05.778654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4ca2e7d4-8519-4db3-a2ea-11542dd5ffff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.180191 Oct 28 20:07:05.779302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 126/246] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:05 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:06.398075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e4525d81-a8cc-4639-860b-b4ebb11c9558 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:06.398684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e4525d81-a8cc-4639-860b-b4ebb11c9558 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:06.405881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4525d81-a8cc-4639-860b-b4ebb11c9558 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:06.406365 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4525d81-a8cc-4639-860b-b4ebb11c9558 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:06.406798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4525d81-a8cc-4639-860b-b4ebb11c9558 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:06.407483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4525d81-a8cc-4639-860b-b4ebb11c9558 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:06.407982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4525d81-a8cc-4639-860b-b4ebb11c9558 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:06.408400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4525d81-a8cc-4639-860b-b4ebb11c9558 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:06.545801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e4525d81-a8cc-4639-860b-b4ebb11c9558 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:06.553415 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e4525d81-a8cc-4639-860b-b4ebb11c9558 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1319 microversion: 2.1 time: 0.159251 Oct 28 20:07:06.553988 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 121/247] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:06 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:06.801430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ae1175b-ee8f-443c-905d-8c404f639f15 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:06.802167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ae1175b-ee8f-443c-905d-8c404f639f15 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:06.812648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ae1175b-ee8f-443c-905d-8c404f639f15 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:06.813147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ae1175b-ee8f-443c-905d-8c404f639f15 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:06.813614 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ae1175b-ee8f-443c-905d-8c404f639f15 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:06.814520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ae1175b-ee8f-443c-905d-8c404f639f15 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:06.814916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ae1175b-ee8f-443c-905d-8c404f639f15 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:06.815347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ae1175b-ee8f-443c-905d-8c404f639f15 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:06.953106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ae1175b-ee8f-443c-905d-8c404f639f15 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:06.961156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ae1175b-ee8f-443c-905d-8c404f639f15 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.163635 Oct 28 20:07:06.961772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 127/248] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:06 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:07.577769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dd3261a2-21ad-421d-817d-55b21a0537e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:07.578490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dd3261a2-21ad-421d-817d-55b21a0537e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:07.589798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd3261a2-21ad-421d-817d-55b21a0537e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:07.589798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd3261a2-21ad-421d-817d-55b21a0537e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:07.589798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd3261a2-21ad-421d-817d-55b21a0537e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:07.589798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd3261a2-21ad-421d-817d-55b21a0537e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:07.590162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd3261a2-21ad-421d-817d-55b21a0537e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:07.590162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd3261a2-21ad-421d-817d-55b21a0537e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:07.743370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-dd3261a2-21ad-421d-817d-55b21a0537e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:07.743370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dd3261a2-21ad-421d-817d-55b21a0537e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1319 microversion: 2.1 time: 0.165798 Oct 28 20:07:07.743370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 122/249] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:07 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:07.983370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-512e40b0-e732-436a-b6fc-637185c39413 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:07.985116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-512e40b0-e732-436a-b6fc-637185c39413 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:07.989923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-512e40b0-e732-436a-b6fc-637185c39413 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:07.990612 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-512e40b0-e732-436a-b6fc-637185c39413 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:07.991024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-512e40b0-e732-436a-b6fc-637185c39413 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:07.991707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-512e40b0-e732-436a-b6fc-637185c39413 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:07.992199 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-512e40b0-e732-436a-b6fc-637185c39413 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:07.992580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-512e40b0-e732-436a-b6fc-637185c39413 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:08.140895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-512e40b0-e732-436a-b6fc-637185c39413 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:08.149176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-512e40b0-e732-436a-b6fc-637185c39413 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.170013 Oct 28 20:07:08.149865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 128/250] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:07 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:08.298412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-a4b13625-b918-4918-a35a-7fd885e97c48 req-bbac801e-35f1-4599-82a8-734e13096f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a", "name": "network-vif-plugged", "status": "completed", "tag": "16352761-cd2a-451f-bb6b-e0cbbe3cba15"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:07:08.309097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a4b13625-b918-4918-a35a-7fd885e97c48 req-bbac801e-35f1-4599-82a8-734e13096f0c service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:08.309832 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a4b13625-b918-4918-a35a-7fd885e97c48 req-bbac801e-35f1-4599-82a8-734e13096f0c service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:08.310265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a4b13625-b918-4918-a35a-7fd885e97c48 req-bbac801e-35f1-4599-82a8-734e13096f0c service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:08.323698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-a4b13625-b918-4918-a35a-7fd885e97c48 req-bbac801e-35f1-4599-82a8-734e13096f0c service nova] Creating event network-vif-plugged:16352761-cd2a-451f-bb6b-e0cbbe3cba15 for instance 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a on hv-cinder-86236 Oct 28 20:07:08.330171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-a4b13625-b918-4918-a35a-7fd885e97c48 req-bbac801e-35f1-4599-82a8-734e13096f0c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035957 Oct 28 20:07:08.330969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 123/251] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:07:08.760743 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-db2e8f6e-5f73-49f4-b932-49b8814c9d7a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:08.761371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-db2e8f6e-5f73-49f4-b932-49b8814c9d7a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:08.768121 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db2e8f6e-5f73-49f4-b932-49b8814c9d7a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:08.768599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db2e8f6e-5f73-49f4-b932-49b8814c9d7a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:08.770999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db2e8f6e-5f73-49f4-b932-49b8814c9d7a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:08.770999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db2e8f6e-5f73-49f4-b932-49b8814c9d7a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:08.770999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db2e8f6e-5f73-49f4-b932-49b8814c9d7a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:08.770999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db2e8f6e-5f73-49f4-b932-49b8814c9d7a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:08.909541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-db2e8f6e-5f73-49f4-b932-49b8814c9d7a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:08.917683 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-db2e8f6e-5f73-49f4-b932-49b8814c9d7a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1319 microversion: 2.1 time: 0.160819 Oct 28 20:07:08.918261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 129/252] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:08 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:09.173110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ea8c7454-9a40-4d9c-ab59-2057a0b7b3cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:09.174052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ea8c7454-9a40-4d9c-ab59-2057a0b7b3cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:09.180118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea8c7454-9a40-4d9c-ab59-2057a0b7b3cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:09.180605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea8c7454-9a40-4d9c-ab59-2057a0b7b3cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:09.181045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea8c7454-9a40-4d9c-ab59-2057a0b7b3cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:09.181758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea8c7454-9a40-4d9c-ab59-2057a0b7b3cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:09.182215 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea8c7454-9a40-4d9c-ab59-2057a0b7b3cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:09.182638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea8c7454-9a40-4d9c-ab59-2057a0b7b3cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:09.323847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ea8c7454-9a40-4d9c-ab59-2057a0b7b3cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:09.327655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:09.332470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ea8c7454-9a40-4d9c-ab59-2057a0b7b3cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.164134 Oct 28 20:07:09.333345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 124/253] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:09 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:09.939739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4c87939c-f43e-426c-825f-3eacc2dbbe45 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:09.940260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4c87939c-f43e-426c-825f-3eacc2dbbe45 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:09.946096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c87939c-f43e-426c-825f-3eacc2dbbe45 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:09.946588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c87939c-f43e-426c-825f-3eacc2dbbe45 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:09.947025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c87939c-f43e-426c-825f-3eacc2dbbe45 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:09.947710 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c87939c-f43e-426c-825f-3eacc2dbbe45 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:09.948164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c87939c-f43e-426c-825f-3eacc2dbbe45 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:09.948585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c87939c-f43e-426c-825f-3eacc2dbbe45 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:10.227842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4c87939c-f43e-426c-825f-3eacc2dbbe45 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:10.236225 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4c87939c-f43e-426c-825f-3eacc2dbbe45 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1319 microversion: 2.1 time: 0.300734 Oct 28 20:07:10.236789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 130/254] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:09 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:10.356667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0e5c40d4-670c-4a60-a32a-74eb444418f5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:10.357447 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0e5c40d4-670c-4a60-a32a-74eb444418f5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:10.364130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e5c40d4-670c-4a60-a32a-74eb444418f5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:10.364604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e5c40d4-670c-4a60-a32a-74eb444418f5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:10.365097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e5c40d4-670c-4a60-a32a-74eb444418f5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:10.365928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e5c40d4-670c-4a60-a32a-74eb444418f5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:10.366383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e5c40d4-670c-4a60-a32a-74eb444418f5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:10.366801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e5c40d4-670c-4a60-a32a-74eb444418f5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:10.501493 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0e5c40d4-670c-4a60-a32a-74eb444418f5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:10.509155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0e5c40d4-670c-4a60-a32a-74eb444418f5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.157151 Oct 28 20:07:10.509752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 125/255] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:10 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:11.260635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c8d79a39-1a94-46e6-a3bc-61c850d18ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:11.261251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c8d79a39-1a94-46e6-a3bc-61c850d18ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:11.267822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d79a39-1a94-46e6-a3bc-61c850d18ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:11.268303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d79a39-1a94-46e6-a3bc-61c850d18ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:11.268748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d79a39-1a94-46e6-a3bc-61c850d18ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:11.269473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d79a39-1a94-46e6-a3bc-61c850d18ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:11.269913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d79a39-1a94-46e6-a3bc-61c850d18ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:11.270337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d79a39-1a94-46e6-a3bc-61c850d18ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:11.404974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c8d79a39-1a94-46e6-a3bc-61c850d18ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:11.412482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c8d79a39-1a94-46e6-a3bc-61c850d18ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1319 microversion: 2.1 time: 0.155738 Oct 28 20:07:11.413038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 131/256] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:11 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:11.542782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-19cc2be9-af05-4b3b-85bd-9406a12200cd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:11.543418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-19cc2be9-af05-4b3b-85bd-9406a12200cd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:11.550684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19cc2be9-af05-4b3b-85bd-9406a12200cd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:11.551173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19cc2be9-af05-4b3b-85bd-9406a12200cd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:11.551626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19cc2be9-af05-4b3b-85bd-9406a12200cd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:11.552303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19cc2be9-af05-4b3b-85bd-9406a12200cd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:11.552754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19cc2be9-af05-4b3b-85bd-9406a12200cd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:11.553177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19cc2be9-af05-4b3b-85bd-9406a12200cd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:11.697276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-19cc2be9-af05-4b3b-85bd-9406a12200cd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:11.705886 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-19cc2be9-af05-4b3b-85bd-9406a12200cd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.171289 Oct 28 20:07:11.706549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 126/257] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:11 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:12.436407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-741349af-407a-408a-a9f9-b0bd0f42b389 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:12.436955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-741349af-407a-408a-a9f9-b0bd0f42b389 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:12.442835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-741349af-407a-408a-a9f9-b0bd0f42b389 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:12.443311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-741349af-407a-408a-a9f9-b0bd0f42b389 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:12.443803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-741349af-407a-408a-a9f9-b0bd0f42b389 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:12.444488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-741349af-407a-408a-a9f9-b0bd0f42b389 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:12.444945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-741349af-407a-408a-a9f9-b0bd0f42b389 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:12.445392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-741349af-407a-408a-a9f9-b0bd0f42b389 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:12.573591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-741349af-407a-408a-a9f9-b0bd0f42b389 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:12.581353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-741349af-407a-408a-a9f9-b0bd0f42b389 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1319 microversion: 2.1 time: 0.149508 Oct 28 20:07:12.582000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 132/258] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:12 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:12.729827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d3e250f5-2146-4891-8934-46f5639da5d6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:12.730446 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d3e250f5-2146-4891-8934-46f5639da5d6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:12.737522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3e250f5-2146-4891-8934-46f5639da5d6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:12.738040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3e250f5-2146-4891-8934-46f5639da5d6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:12.738479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3e250f5-2146-4891-8934-46f5639da5d6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:12.739171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3e250f5-2146-4891-8934-46f5639da5d6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:12.739629 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3e250f5-2146-4891-8934-46f5639da5d6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:12.740056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3e250f5-2146-4891-8934-46f5639da5d6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:12.870796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d3e250f5-2146-4891-8934-46f5639da5d6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:12.879825 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d3e250f5-2146-4891-8934-46f5639da5d6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.153812 Oct 28 20:07:12.880396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 127/259] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:12 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:13.604311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2bb78119-0496-433b-b305-66438987443a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:13.604760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2bb78119-0496-433b-b305-66438987443a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:13.610863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bb78119-0496-433b-b305-66438987443a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:13.611349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bb78119-0496-433b-b305-66438987443a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:13.611785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bb78119-0496-433b-b305-66438987443a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:13.612504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bb78119-0496-433b-b305-66438987443a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:13.612959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bb78119-0496-433b-b305-66438987443a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:13.613402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bb78119-0496-433b-b305-66438987443a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:13.745156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2bb78119-0496-433b-b305-66438987443a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:13.753453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2bb78119-0496-433b-b305-66438987443a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1319 microversion: 2.1 time: 0.153186 Oct 28 20:07:13.754017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 133/260] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:13 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:13.903258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e0efcc95-18f1-4e4a-ad80-e21b4d0ae981 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:13.903786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e0efcc95-18f1-4e4a-ad80-e21b4d0ae981 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:13.910648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0efcc95-18f1-4e4a-ad80-e21b4d0ae981 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:13.911135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0efcc95-18f1-4e4a-ad80-e21b4d0ae981 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:13.911579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0efcc95-18f1-4e4a-ad80-e21b4d0ae981 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:13.912289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0efcc95-18f1-4e4a-ad80-e21b4d0ae981 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:13.912746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0efcc95-18f1-4e4a-ad80-e21b4d0ae981 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:13.913173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0efcc95-18f1-4e4a-ad80-e21b4d0ae981 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:14.043099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e0efcc95-18f1-4e4a-ad80-e21b4d0ae981 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:14.051665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e0efcc95-18f1-4e4a-ad80-e21b4d0ae981 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1522 microversion: 2.1 time: 0.152383 Oct 28 20:07:14.052279 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 128/261] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:13 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:14.777730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58a2880f-2e74-4aec-9eb5-368b9d6b7873 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:14.778317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-58a2880f-2e74-4aec-9eb5-368b9d6b7873 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:14.784363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a2880f-2e74-4aec-9eb5-368b9d6b7873 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:14.784853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a2880f-2e74-4aec-9eb5-368b9d6b7873 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:14.785294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a2880f-2e74-4aec-9eb5-368b9d6b7873 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:14.786074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a2880f-2e74-4aec-9eb5-368b9d6b7873 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:14.786534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a2880f-2e74-4aec-9eb5-368b9d6b7873 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:14.786960 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a2880f-2e74-4aec-9eb5-368b9d6b7873 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:15.073950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9839bf11-5fe0-47ed-89cf-c24a6206c46e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:15.074566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9839bf11-5fe0-47ed-89cf-c24a6206c46e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:15.081985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9839bf11-5fe0-47ed-89cf-c24a6206c46e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:15.082480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9839bf11-5fe0-47ed-89cf-c24a6206c46e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:15.082920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9839bf11-5fe0-47ed-89cf-c24a6206c46e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:15.083892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9839bf11-5fe0-47ed-89cf-c24a6206c46e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:15.084350 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9839bf11-5fe0-47ed-89cf-c24a6206c46e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:15.084801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9839bf11-5fe0-47ed-89cf-c24a6206c46e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:15.203800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-58a2880f-2e74-4aec-9eb5-368b9d6b7873 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:15.212656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-58a2880f-2e74-4aec-9eb5-368b9d6b7873 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1319 microversion: 2.1 time: 0.438667 Oct 28 20:07:15.213224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 134/262] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:14 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:07:15.258983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9839bf11-5fe0-47ed-89cf-c24a6206c46e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:15.269803 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9839bf11-5fe0-47ed-89cf-c24a6206c46e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1502 microversion: 2.1 time: 0.199730 Oct 28 20:07:15.280953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 129/263] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:15 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1502 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:07:15.295254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-62a67160-66f1-469c-bd23-78dd0ec7e05a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:15.295254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-62a67160-66f1-469c-bd23-78dd0ec7e05a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:15.299672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62a67160-66f1-469c-bd23-78dd0ec7e05a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:15.300204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62a67160-66f1-469c-bd23-78dd0ec7e05a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:15.300643 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62a67160-66f1-469c-bd23-78dd0ec7e05a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:15.301355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62a67160-66f1-469c-bd23-78dd0ec7e05a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:15.301986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62a67160-66f1-469c-bd23-78dd0ec7e05a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:15.302432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62a67160-66f1-469c-bd23-78dd0ec7e05a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:15.447548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-62a67160-66f1-469c-bd23-78dd0ec7e05a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:15.454851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-62a67160-66f1-469c-bd23-78dd0ec7e05a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1515 microversion: 2.1 time: 0.166551 Oct 28 20:07:15.455566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 135/264] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:15 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:16.237201 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ee3f3ce2-a19b-4400-9af3-e8e99750f8d7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:16.238474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ee3f3ce2-a19b-4400-9af3-e8e99750f8d7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:16.245248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee3f3ce2-a19b-4400-9af3-e8e99750f8d7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:16.245838 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee3f3ce2-a19b-4400-9af3-e8e99750f8d7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:16.246358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee3f3ce2-a19b-4400-9af3-e8e99750f8d7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:16.247117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee3f3ce2-a19b-4400-9af3-e8e99750f8d7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:16.247703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee3f3ce2-a19b-4400-9af3-e8e99750f8d7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:16.248597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee3f3ce2-a19b-4400-9af3-e8e99750f8d7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:16.385098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ee3f3ce2-a19b-4400-9af3-e8e99750f8d7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:16.393506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ee3f3ce2-a19b-4400-9af3-e8e99750f8d7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1507 microversion: 2.1 time: 0.161338 Oct 28 20:07:16.394267 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 130/265] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:16 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:19.291863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ad5090ce-bb00-45c0-a436-b96e60ebbcda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:07:19.296072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ad5090ce-bb00-45c0-a436-b96e60ebbcda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:19.303993 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad5090ce-bb00-45c0-a436-b96e60ebbcda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:19.304755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad5090ce-bb00-45c0-a436-b96e60ebbcda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:19.305385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad5090ce-bb00-45c0-a436-b96e60ebbcda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:19.306241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad5090ce-bb00-45c0-a436-b96e60ebbcda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:19.306846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad5090ce-bb00-45c0-a436-b96e60ebbcda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:19.307421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad5090ce-bb00-45c0-a436-b96e60ebbcda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:19.337176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-ad5090ce-bb00-45c0-a436-b96e60ebbcda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lazy-loading 'flavor' on Instance uuid 1e927409-017d-4d1b-9028-4b1ad64d9744 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:07:19.739912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ad5090ce-bb00-45c0-a436-b96e60ebbcda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "POST /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744/action" status: 200 len: 32 microversion: 2.1 time: 0.454562 Oct 28 20:07:19.743841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 136/266] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Oct 28 20:07:19 2022] POST /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744/action => generated 32 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 20:07:19.757243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-713b7d29-8335-4e7a-bf70-b4d22c1e2704 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:19.757908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-713b7d29-8335-4e7a-bf70-b4d22c1e2704 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:19.772911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-713b7d29-8335-4e7a-bf70-b4d22c1e2704 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:19.772911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-713b7d29-8335-4e7a-bf70-b4d22c1e2704 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:19.772911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-713b7d29-8335-4e7a-bf70-b4d22c1e2704 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:19.772911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-713b7d29-8335-4e7a-bf70-b4d22c1e2704 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:19.773362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-713b7d29-8335-4e7a-bf70-b4d22c1e2704 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:19.773362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-713b7d29-8335-4e7a-bf70-b4d22c1e2704 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:19.919150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-713b7d29-8335-4e7a-bf70-b4d22c1e2704 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:19.927114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-713b7d29-8335-4e7a-bf70-b4d22c1e2704 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.180578 Oct 28 20:07:19.927628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 131/267] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:19 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:20.950523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0c7f1471-c5c9-4c0c-b0a3-f534a4f1e954 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:20.951968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0c7f1471-c5c9-4c0c-b0a3-f534a4f1e954 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:20.958080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c7f1471-c5c9-4c0c-b0a3-f534a4f1e954 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:20.958826 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c7f1471-c5c9-4c0c-b0a3-f534a4f1e954 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:20.959260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c7f1471-c5c9-4c0c-b0a3-f534a4f1e954 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:20.959950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c7f1471-c5c9-4c0c-b0a3-f534a4f1e954 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:20.960446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c7f1471-c5c9-4c0c-b0a3-f534a4f1e954 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:20.960873 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c7f1471-c5c9-4c0c-b0a3-f534a4f1e954 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:21.134314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0c7f1471-c5c9-4c0c-b0a3-f534a4f1e954 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:21.143191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0c7f1471-c5c9-4c0c-b0a3-f534a4f1e954 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.196970 Oct 28 20:07:21.143865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 137/268] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:20 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:22.167704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0da062e8-7325-4470-a91d-d189de1b762e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:22.168290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0da062e8-7325-4470-a91d-d189de1b762e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:22.180919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0da062e8-7325-4470-a91d-d189de1b762e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:22.180919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0da062e8-7325-4470-a91d-d189de1b762e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:22.180919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0da062e8-7325-4470-a91d-d189de1b762e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:22.180919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0da062e8-7325-4470-a91d-d189de1b762e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:22.181480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0da062e8-7325-4470-a91d-d189de1b762e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:22.181480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0da062e8-7325-4470-a91d-d189de1b762e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:22.341600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0da062e8-7325-4470-a91d-d189de1b762e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:22.349559 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0da062e8-7325-4470-a91d-d189de1b762e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.185967 Oct 28 20:07:22.350182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 132/269] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:22 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:23.379852 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1435396c-fdb5-438a-9144-992828f70a24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:23.381367 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1435396c-fdb5-438a-9144-992828f70a24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:23.388013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1435396c-fdb5-438a-9144-992828f70a24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:23.389555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1435396c-fdb5-438a-9144-992828f70a24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:23.390173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1435396c-fdb5-438a-9144-992828f70a24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:23.390972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1435396c-fdb5-438a-9144-992828f70a24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:23.391441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1435396c-fdb5-438a-9144-992828f70a24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:23.392219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1435396c-fdb5-438a-9144-992828f70a24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:23.637870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1435396c-fdb5-438a-9144-992828f70a24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:23.646034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1435396c-fdb5-438a-9144-992828f70a24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.277108 Oct 28 20:07:23.646610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 138/270] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:23 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:24.670820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-874db959-abe9-4072-b7f8-23c7fa3a80ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:24.674147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-874db959-abe9-4072-b7f8-23c7fa3a80ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:24.680876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:24.689567 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-874db959-abe9-4072-b7f8-23c7fa3a80ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:24.690072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-874db959-abe9-4072-b7f8-23c7fa3a80ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:24.690519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-874db959-abe9-4072-b7f8-23c7fa3a80ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:24.691234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-874db959-abe9-4072-b7f8-23c7fa3a80ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:24.691696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-874db959-abe9-4072-b7f8-23c7fa3a80ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:24.692126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-874db959-abe9-4072-b7f8-23c7fa3a80ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:24.899078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-874db959-abe9-4072-b7f8-23c7fa3a80ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:24.912994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-874db959-abe9-4072-b7f8-23c7fa3a80ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.245314 Oct 28 20:07:24.914849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 133/271] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:24 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:25.938330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d28f3e9f-624c-4ca8-847c-e49d7acc4596 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:25.939165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d28f3e9f-624c-4ca8-847c-e49d7acc4596 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:25.946009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d28f3e9f-624c-4ca8-847c-e49d7acc4596 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:25.946893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d28f3e9f-624c-4ca8-847c-e49d7acc4596 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:25.947560 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d28f3e9f-624c-4ca8-847c-e49d7acc4596 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:25.948505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d28f3e9f-624c-4ca8-847c-e49d7acc4596 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:25.949185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d28f3e9f-624c-4ca8-847c-e49d7acc4596 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:25.949855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d28f3e9f-624c-4ca8-847c-e49d7acc4596 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:26.122796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d28f3e9f-624c-4ca8-847c-e49d7acc4596 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:26.131665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d28f3e9f-624c-4ca8-847c-e49d7acc4596 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.198303 Oct 28 20:07:26.132740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 139/272] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:25 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:27.160748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b18a64e2-4e80-4985-b4f3-9e1fa4133b53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:27.161394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b18a64e2-4e80-4985-b4f3-9e1fa4133b53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:27.168373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b18a64e2-4e80-4985-b4f3-9e1fa4133b53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:27.168860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b18a64e2-4e80-4985-b4f3-9e1fa4133b53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:27.169297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b18a64e2-4e80-4985-b4f3-9e1fa4133b53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:27.170383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b18a64e2-4e80-4985-b4f3-9e1fa4133b53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:27.170776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b18a64e2-4e80-4985-b4f3-9e1fa4133b53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:27.171202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b18a64e2-4e80-4985-b4f3-9e1fa4133b53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:27.351255 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b18a64e2-4e80-4985-b4f3-9e1fa4133b53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:27.361146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b18a64e2-4e80-4985-b4f3-9e1fa4133b53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.204555 Oct 28 20:07:27.361887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 134/273] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:27 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:28.384698 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d34cd4a9-8ba0-483a-b0bb-632d0965b627 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:28.386124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d34cd4a9-8ba0-483a-b0bb-632d0965b627 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:28.390880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=44 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:28.395461 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d34cd4a9-8ba0-483a-b0bb-632d0965b627 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:28.396015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d34cd4a9-8ba0-483a-b0bb-632d0965b627 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:28.396577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d34cd4a9-8ba0-483a-b0bb-632d0965b627 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:28.397543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d34cd4a9-8ba0-483a-b0bb-632d0965b627 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:28.397996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d34cd4a9-8ba0-483a-b0bb-632d0965b627 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:28.398604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d34cd4a9-8ba0-483a-b0bb-632d0965b627 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:28.403455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:28.555289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d34cd4a9-8ba0-483a-b0bb-632d0965b627 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:28.564913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d34cd4a9-8ba0-483a-b0bb-632d0965b627 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.184704 Oct 28 20:07:28.565522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 140/274] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:28 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:29.588432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5d56b250-2ce8-4ce9-b2a0-af68297b08d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:29.589045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5d56b250-2ce8-4ce9-b2a0-af68297b08d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:29.597771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d56b250-2ce8-4ce9-b2a0-af68297b08d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:29.598741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d56b250-2ce8-4ce9-b2a0-af68297b08d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:29.599412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d56b250-2ce8-4ce9-b2a0-af68297b08d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:29.601148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d56b250-2ce8-4ce9-b2a0-af68297b08d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:29.601919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d56b250-2ce8-4ce9-b2a0-af68297b08d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:29.602568 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d56b250-2ce8-4ce9-b2a0-af68297b08d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:30.076709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5d56b250-2ce8-4ce9-b2a0-af68297b08d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:30.088643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5d56b250-2ce8-4ce9-b2a0-af68297b08d9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.504019 Oct 28 20:07:30.089359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 135/275] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:29 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:31.112879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9ac1d185-3ed1-43f5-89ad-e97951ce8279 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:31.114535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9ac1d185-3ed1-43f5-89ad-e97951ce8279 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:31.147267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ac1d185-3ed1-43f5-89ad-e97951ce8279 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:31.147774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ac1d185-3ed1-43f5-89ad-e97951ce8279 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:31.148221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ac1d185-3ed1-43f5-89ad-e97951ce8279 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:31.158573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ac1d185-3ed1-43f5-89ad-e97951ce8279 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:31.159446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ac1d185-3ed1-43f5-89ad-e97951ce8279 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:31.161674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ac1d185-3ed1-43f5-89ad-e97951ce8279 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:31.471421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9ac1d185-3ed1-43f5-89ad-e97951ce8279 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:31.481521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9ac1d185-3ed1-43f5-89ad-e97951ce8279 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.373346 Oct 28 20:07:31.494058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 141/276] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:31 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:32.163611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8ea4de2d-fb95-4fda-8006-467e26194fe0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:32.165209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8ea4de2d-fb95-4fda-8006-467e26194fe0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:32.173698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ea4de2d-fb95-4fda-8006-467e26194fe0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:32.174833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ea4de2d-fb95-4fda-8006-467e26194fe0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:32.175449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ea4de2d-fb95-4fda-8006-467e26194fe0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:32.176865 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ea4de2d-fb95-4fda-8006-467e26194fe0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:32.177980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ea4de2d-fb95-4fda-8006-467e26194fe0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:32.184489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ea4de2d-fb95-4fda-8006-467e26194fe0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:32.224122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8ea4de2d-fb95-4fda-8006-467e26194fe0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/ips" status: 200 len: 150 microversion: 2.1 time: 0.072646 Oct 28 20:07:32.224877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 136/277] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Oct 28 20:07:32 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/ips => generated 150 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:07:32.509378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0a08da9c-08a3-47b5-a7a0-0df25af519bc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:32.510594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0a08da9c-08a3-47b5-a7a0-0df25af519bc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:32.517803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a08da9c-08a3-47b5-a7a0-0df25af519bc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:32.518382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a08da9c-08a3-47b5-a7a0-0df25af519bc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:32.519243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a08da9c-08a3-47b5-a7a0-0df25af519bc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:32.520082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a08da9c-08a3-47b5-a7a0-0df25af519bc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:32.520718 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a08da9c-08a3-47b5-a7a0-0df25af519bc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:32.521244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a08da9c-08a3-47b5-a7a0-0df25af519bc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:32.737371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0a08da9c-08a3-47b5-a7a0-0df25af519bc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:32.746115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0a08da9c-08a3-47b5-a7a0-0df25af519bc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.240680 Oct 28 20:07:32.746697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 142/278] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:32 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:33.771534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4fbf1d3c-f94d-4f18-9342-1b0a7d80c76c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:33.772825 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4fbf1d3c-f94d-4f18-9342-1b0a7d80c76c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:33.780046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fbf1d3c-f94d-4f18-9342-1b0a7d80c76c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:33.780774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fbf1d3c-f94d-4f18-9342-1b0a7d80c76c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:33.781465 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fbf1d3c-f94d-4f18-9342-1b0a7d80c76c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:33.782255 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fbf1d3c-f94d-4f18-9342-1b0a7d80c76c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:33.782786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fbf1d3c-f94d-4f18-9342-1b0a7d80c76c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:33.783438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fbf1d3c-f94d-4f18-9342-1b0a7d80c76c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:34.020259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4fbf1d3c-f94d-4f18-9342-1b0a7d80c76c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:34.034933 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4fbf1d3c-f94d-4f18-9342-1b0a7d80c76c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.267721 Oct 28 20:07:34.035899 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 137/279] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:33 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:34.551193 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1dbca851-854f-497b-84f1-4f6b90897edb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Action: 'create', calling method: .version_select at 0x7f1f4d166700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-630547667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx8jDiSj/Rjh+MBrh6jZPNnyJr9fq6hIX3p+9lRp3yBJKCrSWdC/mpGCbae+yXBbhs2XDx7kdCMuV+/8f/YOGHIe5Wc3+ViUQQ5JrPdpU6nHjJ/nGFwWPQD+tQJ/kVPMw=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:07:34.574231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-1dbca851-854f-497b-84f1-4f6b90897edb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Getting quotas for project fac1485ccdeb434ca49caa52ebfdc24b. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:07:34.579240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-1dbca851-854f-497b-84f1-4f6b90897edb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Getting quotas for user a5c784f29d2e4cb4bb8bd6d62fbc2216 and project fac1485ccdeb434ca49caa52ebfdc24b. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:07:34.684639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1dbca851-854f-497b-84f1-4f6b90897edb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.313809 Oct 28 20:07:34.686237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 143/280] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Oct 28 20:07:34 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:07:35.060154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2ba76f83-e9c2-486c-8199-6cd510f0bf90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:35.060154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2ba76f83-e9c2-486c-8199-6cd510f0bf90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:35.065108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ba76f83-e9c2-486c-8199-6cd510f0bf90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:35.065661 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ba76f83-e9c2-486c-8199-6cd510f0bf90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:35.066101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ba76f83-e9c2-486c-8199-6cd510f0bf90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:35.066796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ba76f83-e9c2-486c-8199-6cd510f0bf90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:35.067251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ba76f83-e9c2-486c-8199-6cd510f0bf90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:35.067675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ba76f83-e9c2-486c-8199-6cd510f0bf90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:35.502614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2ba76f83-e9c2-486c-8199-6cd510f0bf90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:35.510427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2ba76f83-e9c2-486c-8199-6cd510f0bf90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.456527 Oct 28 20:07:35.511072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 138/281] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:35 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:36.534475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-afa7a91b-9569-451e-8d98-5c89e2d6de0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:36.535088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-afa7a91b-9569-451e-8d98-5c89e2d6de0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:36.541662 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afa7a91b-9569-451e-8d98-5c89e2d6de0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:36.542152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afa7a91b-9569-451e-8d98-5c89e2d6de0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:36.542588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afa7a91b-9569-451e-8d98-5c89e2d6de0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:36.543458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afa7a91b-9569-451e-8d98-5c89e2d6de0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:36.544073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afa7a91b-9569-451e-8d98-5c89e2d6de0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:36.544554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afa7a91b-9569-451e-8d98-5c89e2d6de0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:36.734854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-afa7a91b-9569-451e-8d98-5c89e2d6de0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:36.742938 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-afa7a91b-9569-451e-8d98-5c89e2d6de0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.212343 Oct 28 20:07:36.757349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 144/282] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:36 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:37.377311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fdac9c8f-4ffb-4315-9718-48607a3c58e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16204884-676d-4bca-84aa-d82d6ab87d89"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:07:37.379783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fdac9c8f-4ffb-4315-9718-48607a3c58e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:37.386502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdac9c8f-4ffb-4315-9718-48607a3c58e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:37.388113 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdac9c8f-4ffb-4315-9718-48607a3c58e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:37.388113 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdac9c8f-4ffb-4315-9718-48607a3c58e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:37.388113 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdac9c8f-4ffb-4315-9718-48607a3c58e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:37.389173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdac9c8f-4ffb-4315-9718-48607a3c58e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:37.389624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdac9c8f-4ffb-4315-9718-48607a3c58e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:37.766673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8592a809-b8b2-4261-bc0a-c3b88830f614 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:37.767352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8592a809-b8b2-4261-bc0a-c3b88830f614 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:37.773606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8592a809-b8b2-4261-bc0a-c3b88830f614 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:37.774312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8592a809-b8b2-4261-bc0a-c3b88830f614 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:37.774756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8592a809-b8b2-4261-bc0a-c3b88830f614 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:37.775464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8592a809-b8b2-4261-bc0a-c3b88830f614 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:37.775922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8592a809-b8b2-4261-bc0a-c3b88830f614 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:37.776351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8592a809-b8b2-4261-bc0a-c3b88830f614 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:37.924477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8592a809-b8b2-4261-bc0a-c3b88830f614 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:37.932484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8592a809-b8b2-4261-bc0a-c3b88830f614 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.170282 Oct 28 20:07:37.933051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 145/283] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:37 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:07:38.956331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a531df4-394d-41fc-8138-bcfb63616d79 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:38.957080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2a531df4-394d-41fc-8138-bcfb63616d79 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:38.963512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a531df4-394d-41fc-8138-bcfb63616d79 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:38.963991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a531df4-394d-41fc-8138-bcfb63616d79 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:38.964427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a531df4-394d-41fc-8138-bcfb63616d79 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:38.965114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a531df4-394d-41fc-8138-bcfb63616d79 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:38.965591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a531df4-394d-41fc-8138-bcfb63616d79 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:38.966011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a531df4-394d-41fc-8138-bcfb63616d79 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:39.097082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2a531df4-394d-41fc-8138-bcfb63616d79 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:39.104838 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a531df4-394d-41fc-8138-bcfb63616d79 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.152342 Oct 28 20:07:39.105532 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 146/284] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:38 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:07:40.129071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85d1021f-0552-43b6-b5e8-57e4488f3901 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:40.129908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-85d1021f-0552-43b6-b5e8-57e4488f3901 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:40.136679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d1021f-0552-43b6-b5e8-57e4488f3901 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:40.137334 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d1021f-0552-43b6-b5e8-57e4488f3901 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:40.138641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d1021f-0552-43b6-b5e8-57e4488f3901 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:40.139587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d1021f-0552-43b6-b5e8-57e4488f3901 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:40.140057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d1021f-0552-43b6-b5e8-57e4488f3901 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:40.140493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d1021f-0552-43b6-b5e8-57e4488f3901 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:40.281291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-85d1021f-0552-43b6-b5e8-57e4488f3901 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:40.289622 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-85d1021f-0552-43b6-b5e8-57e4488f3901 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.165369 Oct 28 20:07:40.290191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 147/285] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:40 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:07:40.414296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fdac9c8f-4ffb-4315-9718-48607a3c58e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "POST /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.041216 Oct 28 20:07:40.415276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 139/286] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Oct 28 20:07:37 2022] POST /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 194 bytes in 3043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:07:41.262329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4f20eec-24c2-41dc-9e29-cb28c43bc541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:41.262892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d4f20eec-24c2-41dc-9e29-cb28c43bc541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:41.270871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4f20eec-24c2-41dc-9e29-cb28c43bc541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:41.271350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4f20eec-24c2-41dc-9e29-cb28c43bc541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:41.271780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4f20eec-24c2-41dc-9e29-cb28c43bc541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:41.272473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4f20eec-24c2-41dc-9e29-cb28c43bc541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:41.272922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4f20eec-24c2-41dc-9e29-cb28c43bc541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:41.273362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4f20eec-24c2-41dc-9e29-cb28c43bc541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:41.297732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d4f20eec-24c2-41dc-9e29-cb28c43bc541 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57/ips" status: 200 len: 151 microversion: 2.20 time: 0.039097 Oct 28 20:07:41.298300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 148/287] 10.222.0.66 () {60 vars in 1289 bytes} [Fri Oct 28 20:07:41 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:07:41.315944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fb2e8077-e2a8-44bf-adf8-83c35787b0cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:41.316658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fb2e8077-e2a8-44bf-adf8-83c35787b0cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:41.323719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb2e8077-e2a8-44bf-adf8-83c35787b0cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:41.324409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb2e8077-e2a8-44bf-adf8-83c35787b0cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:41.324856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb2e8077-e2a8-44bf-adf8-83c35787b0cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:41.325692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb2e8077-e2a8-44bf-adf8-83c35787b0cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:41.326748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb2e8077-e2a8-44bf-adf8-83c35787b0cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:41.327176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb2e8077-e2a8-44bf-adf8-83c35787b0cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:41.332845 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:41.468850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fb2e8077-e2a8-44bf-adf8-83c35787b0cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:41.476805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fb2e8077-e2a8-44bf-adf8-83c35787b0cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.165412 Oct 28 20:07:41.477534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 140/288] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:41 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:42.499330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-84cca84e-985f-43e0-9e5f-c285e1ada0d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:42.500098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-84cca84e-985f-43e0-9e5f-c285e1ada0d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:42.506250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84cca84e-985f-43e0-9e5f-c285e1ada0d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:42.506736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84cca84e-985f-43e0-9e5f-c285e1ada0d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:42.507172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84cca84e-985f-43e0-9e5f-c285e1ada0d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:42.507868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84cca84e-985f-43e0-9e5f-c285e1ada0d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:42.508369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84cca84e-985f-43e0-9e5f-c285e1ada0d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:42.508868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84cca84e-985f-43e0-9e5f-c285e1ada0d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:42.642650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-84cca84e-985f-43e0-9e5f-c285e1ada0d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:42.650489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-84cca84e-985f-43e0-9e5f-c285e1ada0d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.155222 Oct 28 20:07:42.651052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 149/289] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:42 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:43.674846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3fb9dc6e-8722-4572-a1b7-c7dc3339bb86 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:43.675379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3fb9dc6e-8722-4572-a1b7-c7dc3339bb86 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:43.681687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fb9dc6e-8722-4572-a1b7-c7dc3339bb86 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:43.682171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fb9dc6e-8722-4572-a1b7-c7dc3339bb86 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:43.682607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fb9dc6e-8722-4572-a1b7-c7dc3339bb86 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:43.683295 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fb9dc6e-8722-4572-a1b7-c7dc3339bb86 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:43.683758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fb9dc6e-8722-4572-a1b7-c7dc3339bb86 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:43.684172 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fb9dc6e-8722-4572-a1b7-c7dc3339bb86 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:43.820937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3fb9dc6e-8722-4572-a1b7-c7dc3339bb86 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:43.830154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3fb9dc6e-8722-4572-a1b7-c7dc3339bb86 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.159556 Oct 28 20:07:43.830929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 141/290] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:43 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:44.854211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-64fcc1bb-5f29-40cf-b2c0-ce2592ec8aaf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:44.854824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-64fcc1bb-5f29-40cf-b2c0-ce2592ec8aaf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:44.857312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:44.862093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64fcc1bb-5f29-40cf-b2c0-ce2592ec8aaf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:44.862581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64fcc1bb-5f29-40cf-b2c0-ce2592ec8aaf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:44.863047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64fcc1bb-5f29-40cf-b2c0-ce2592ec8aaf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:44.863800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64fcc1bb-5f29-40cf-b2c0-ce2592ec8aaf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:44.864257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64fcc1bb-5f29-40cf-b2c0-ce2592ec8aaf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:44.864684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64fcc1bb-5f29-40cf-b2c0-ce2592ec8aaf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:45.002938 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-64fcc1bb-5f29-40cf-b2c0-ce2592ec8aaf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:45.011277 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-64fcc1bb-5f29-40cf-b2c0-ce2592ec8aaf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.161006 Oct 28 20:07:45.012045 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 150/291] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:44 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:46.035645 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9069eb3a-5aae-4577-9aa0-1d8abb667845 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:46.036950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9069eb3a-5aae-4577-9aa0-1d8abb667845 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:46.051760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9069eb3a-5aae-4577-9aa0-1d8abb667845 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:46.051760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9069eb3a-5aae-4577-9aa0-1d8abb667845 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:46.051760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9069eb3a-5aae-4577-9aa0-1d8abb667845 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:46.051760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9069eb3a-5aae-4577-9aa0-1d8abb667845 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:46.052146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9069eb3a-5aae-4577-9aa0-1d8abb667845 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:46.052146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9069eb3a-5aae-4577-9aa0-1d8abb667845 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:46.086297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ff2cf9b7-3134-4b04-b3ea-7cd0946af9b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fae26e0-f88b-4257-9f43-19df24a827e4", "device": "/dev/sdb"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:07:46.089194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ff2cf9b7-3134-4b04-b3ea-7cd0946af9b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:46.096127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff2cf9b7-3134-4b04-b3ea-7cd0946af9b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:46.096615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff2cf9b7-3134-4b04-b3ea-7cd0946af9b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:46.097044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff2cf9b7-3134-4b04-b3ea-7cd0946af9b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:46.097804 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff2cf9b7-3134-4b04-b3ea-7cd0946af9b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:46.098395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff2cf9b7-3134-4b04-b3ea-7cd0946af9b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:46.098821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff2cf9b7-3134-4b04-b3ea-7cd0946af9b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:46.191308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9069eb3a-5aae-4577-9aa0-1d8abb667845 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:46.200420 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9069eb3a-5aae-4577-9aa0-1d8abb667845 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.168889 Oct 28 20:07:46.201065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 142/292] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:46 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:46.254549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cbbd7c6e-1393-4fbb-bdf3-4181b1856f9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:07:46.255271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cbbd7c6e-1393-4fbb-bdf3-4181b1856f9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:46.264536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbbd7c6e-1393-4fbb-bdf3-4181b1856f9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:46.264536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbbd7c6e-1393-4fbb-bdf3-4181b1856f9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:46.265194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbbd7c6e-1393-4fbb-bdf3-4181b1856f9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:46.266134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbbd7c6e-1393-4fbb-bdf3-4181b1856f9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:46.266752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbbd7c6e-1393-4fbb-bdf3-4181b1856f9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:46.267329 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbbd7c6e-1393-4fbb-bdf3-4181b1856f9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:46.292298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-cbbd7c6e-1393-4fbb-bdf3-4181b1856f9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lazy-loading 'flavor' on Instance uuid 7582188f-bfab-4218-9104-9fb384141c57 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:07:46.808951 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cbbd7c6e-1393-4fbb-bdf3-4181b1856f9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "POST /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57/action" status: 202 len: 0 microversion: 2.20 time: 0.558362 Oct 28 20:07:46.809574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 143/293] 10.222.0.66 () {62 vars in 1319 bytes} [Fri Oct 28 20:07:46 2022] POST /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 20:07:46.818783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-91859be0-2b7b-4983-a7f7-d27088622720 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:46.819481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-91859be0-2b7b-4983-a7f7-d27088622720 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:46.825743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91859be0-2b7b-4983-a7f7-d27088622720 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:46.828258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91859be0-2b7b-4983-a7f7-d27088622720 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:46.828258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91859be0-2b7b-4983-a7f7-d27088622720 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:46.828258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91859be0-2b7b-4983-a7f7-d27088622720 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:46.828258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91859be0-2b7b-4983-a7f7-d27088622720 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:46.828614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91859be0-2b7b-4983-a7f7-d27088622720 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:46.970055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-91859be0-2b7b-4983-a7f7-d27088622720 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:46.978330 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-91859be0-2b7b-4983-a7f7-d27088622720 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:46.979887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-91859be0-2b7b-4983-a7f7-d27088622720 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:46.981092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-91859be0-2b7b-4983-a7f7-d27088622720 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.166289 Oct 28 20:07:46.981692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 144/294] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:07:46 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:07:47.078057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ff2cf9b7-3134-4b04-b3ea-7cd0946af9b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "POST /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.995651 Oct 28 20:07:47.084900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 151/295] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Oct 28 20:07:46 2022] POST /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a/os-volume_attachments => generated 194 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:07:47.223712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b3abcad-5299-4087-aefd-f71b589f0158 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:47.228305 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9b3abcad-5299-4087-aefd-f71b589f0158 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:47.231028 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b3abcad-5299-4087-aefd-f71b589f0158 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:47.231529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b3abcad-5299-4087-aefd-f71b589f0158 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:47.231988 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b3abcad-5299-4087-aefd-f71b589f0158 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:47.233564 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b3abcad-5299-4087-aefd-f71b589f0158 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:47.234062 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b3abcad-5299-4087-aefd-f71b589f0158 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:47.234500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b3abcad-5299-4087-aefd-f71b589f0158 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:47.365849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9b3abcad-5299-4087-aefd-f71b589f0158 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:47.373737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b3abcad-5299-4087-aefd-f71b589f0158 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.153717 Oct 28 20:07:47.374342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 145/296] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:47 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:48.009086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ea85d2f2-8e6e-493f-a29f-c7fa3847ec82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:48.010028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ea85d2f2-8e6e-493f-a29f-c7fa3847ec82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:48.017787 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea85d2f2-8e6e-493f-a29f-c7fa3847ec82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:48.018275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea85d2f2-8e6e-493f-a29f-c7fa3847ec82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:48.018711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea85d2f2-8e6e-493f-a29f-c7fa3847ec82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:48.019405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea85d2f2-8e6e-493f-a29f-c7fa3847ec82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:48.019856 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea85d2f2-8e6e-493f-a29f-c7fa3847ec82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:48.020279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea85d2f2-8e6e-493f-a29f-c7fa3847ec82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:48.157072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ea85d2f2-8e6e-493f-a29f-c7fa3847ec82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:48.165217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ea85d2f2-8e6e-493f-a29f-c7fa3847ec82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:48.166726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ea85d2f2-8e6e-493f-a29f-c7fa3847ec82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:48.167956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ea85d2f2-8e6e-493f-a29f-c7fa3847ec82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.163470 Oct 28 20:07:48.168509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 152/297] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:07:48 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:07:48.277825 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5c6a4bf7-58e6-422c-867f-1aba25a1ef2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:48.278392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5c6a4bf7-58e6-422c-867f-1aba25a1ef2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:48.286820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c6a4bf7-58e6-422c-867f-1aba25a1ef2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:48.287598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c6a4bf7-58e6-422c-867f-1aba25a1ef2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:48.288051 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c6a4bf7-58e6-422c-867f-1aba25a1ef2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:48.288792 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c6a4bf7-58e6-422c-867f-1aba25a1ef2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:48.289278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c6a4bf7-58e6-422c-867f-1aba25a1ef2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:48.289727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c6a4bf7-58e6-422c-867f-1aba25a1ef2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:48.315216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5c6a4bf7-58e6-422c-867f-1aba25a1ef2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/ips" status: 200 len: 147 microversion: 2.1 time: 0.041186 Oct 28 20:07:48.315813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 146/298] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Oct 28 20:07:48 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:07:48.397295 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-37ef75b7-961f-45ae-9177-f29c24884f0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:48.398250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-37ef75b7-961f-45ae-9177-f29c24884f0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:48.403922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37ef75b7-961f-45ae-9177-f29c24884f0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:48.404968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37ef75b7-961f-45ae-9177-f29c24884f0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:48.405430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37ef75b7-961f-45ae-9177-f29c24884f0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:48.406169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37ef75b7-961f-45ae-9177-f29c24884f0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:48.406626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37ef75b7-961f-45ae-9177-f29c24884f0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:48.407052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37ef75b7-961f-45ae-9177-f29c24884f0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:48.542019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-37ef75b7-961f-45ae-9177-f29c24884f0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:48.550243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-37ef75b7-961f-45ae-9177-f29c24884f0a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.156703 Oct 28 20:07:48.550822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 153/299] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:48 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:49.195007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e917a469-8bc4-4968-a98e-f6aadfd23072 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:49.195844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e917a469-8bc4-4968-a98e-f6aadfd23072 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:49.204983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e917a469-8bc4-4968-a98e-f6aadfd23072 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:49.204983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e917a469-8bc4-4968-a98e-f6aadfd23072 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:49.205469 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e917a469-8bc4-4968-a98e-f6aadfd23072 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:49.206163 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e917a469-8bc4-4968-a98e-f6aadfd23072 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:49.206988 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e917a469-8bc4-4968-a98e-f6aadfd23072 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:49.207637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e917a469-8bc4-4968-a98e-f6aadfd23072 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:49.353123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e917a469-8bc4-4968-a98e-f6aadfd23072 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:49.361711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e917a469-8bc4-4968-a98e-f6aadfd23072 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:49.363150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e917a469-8bc4-4968-a98e-f6aadfd23072 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:49.364288 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e917a469-8bc4-4968-a98e-f6aadfd23072 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.173336 Oct 28 20:07:49.364826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 147/300] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:07:49 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:07:49.573727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1cea8bda-1c66-473d-9303-b04143842fcc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:49.574297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1cea8bda-1c66-473d-9303-b04143842fcc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:49.581077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cea8bda-1c66-473d-9303-b04143842fcc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:49.581598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cea8bda-1c66-473d-9303-b04143842fcc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:49.582093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cea8bda-1c66-473d-9303-b04143842fcc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:49.582787 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cea8bda-1c66-473d-9303-b04143842fcc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:49.583318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cea8bda-1c66-473d-9303-b04143842fcc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:49.583793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cea8bda-1c66-473d-9303-b04143842fcc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:49.718590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1cea8bda-1c66-473d-9303-b04143842fcc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:49.726894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1cea8bda-1c66-473d-9303-b04143842fcc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1501 microversion: 2.1 time: 0.157101 Oct 28 20:07:49.727466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 154/301] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:49 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:49.750640 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2f4e1853-5d7e-4fc7-adf5-d79de1a40786 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "beb1fce3-bb51-4b12-8c0c-9d6be4a827fa"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:07:49.753165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2f4e1853-5d7e-4fc7-adf5-d79de1a40786 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:49.759662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f4e1853-5d7e-4fc7-adf5-d79de1a40786 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:49.760207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f4e1853-5d7e-4fc7-adf5-d79de1a40786 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:49.760593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f4e1853-5d7e-4fc7-adf5-d79de1a40786 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:49.761417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f4e1853-5d7e-4fc7-adf5-d79de1a40786 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:49.761873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f4e1853-5d7e-4fc7-adf5-d79de1a40786 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:49.762299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f4e1853-5d7e-4fc7-adf5-d79de1a40786 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:49.786251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-2f4e1853-5d7e-4fc7-adf5-d79de1a40786 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] HTTP exception thrown: Cannot 'attach_volume' instance 1e927409-017d-4d1b-9028-4b1ad64d9744 while it is in vm_state rescued Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2f4e1853-5d7e-4fc7-adf5-d79de1a40786 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Request method failure captured: Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744/os-volume_attachments HTTP/1.1 Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 74 Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDYVUSBBagLPNomxBBxHq3ECVaXkAjtcHj9JcVNYMaxZVPvZeFF2LWhPgX8h0QTtA_g0RNm0uMh_rJGZJiYwnK43exvmZqU6ooe06pRY35HWRYRkiTryZNEJfiI_TmdWen5RbyVIKZtJPJnUeqzCW__uExFDyZXfsIgrO0yv6wQJTu0 Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: ab907bf956554681beae45b8973db6e5 Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1880496931 Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:07:49.790891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:07:49.792540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ab907bf956554681beae45b8973db6e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ab907bf956554681beae45b8973db6e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ab907bf956554681beae45b8973db6e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ab907bf956554681beae45b8973db6e5", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:07:49.792540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1880496931 Oct 28 20:07:49.792540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: ab907bf956554681beae45b8973db6e5 Oct 28 20:07:49.792540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1880496931 Oct 28 20:07:49.792540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-ServerRescueNegativeTestJSON-1880496931-project Oct 28 20:07:49.792540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:07:49.792540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:07:49.792540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: ce7f52b7f96c400fb7d5fb0453c94362 Oct 28 20:07:49.792540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1880496931-project Oct 28 20:07:49.792540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Oct 28 20:07:49.792540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {"volumeAttachment": {"volumeId": "beb1fce3-bb51-4b12-8c0c-9d6be4a827fa"}} Oct 28 20:07:49.792540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Cannot 'attach_volume' instance 1e927409-017d-4d1b-9028-4b1ad64d9744 while it is in vm_state rescued Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'server_id': '1e927409-017d-4d1b-9028-4b1ad64d9744', 'body': {'volumeAttachment': {'volumeId': 'beb1fce3-bb51-4b12-8c0c-9d6be4a827fa'}}} Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1e927409-017d-4d1b-9028-4b1ad64d9744 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:07:49.793445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1e927409-017d-4d1b-9028-4b1ad64d9744 while it is in vm_state rescued Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:07:49.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:07:49.797984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:07:49.797984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:07:49.797984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1e927409-017d-4d1b-9028-4b1ad64d9744 while it is in vm_state rescued Oct 28 20:07:49.797984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:07:49.797984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2f4e1853-5d7e-4fc7-adf5-d79de1a40786 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Returning 409 to user: Cannot 'attach_volume' instance 1e927409-017d-4d1b-9028-4b1ad64d9744 while it is in vm_state rescued {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:07:49.797984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2f4e1853-5d7e-4fc7-adf5-d79de1a40786 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "POST /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042657 Oct 28 20:07:49.797984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 148/302] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Oct 28 20:07:49 2022] POST /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 20:07:49.799505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-44490bbf-c651-4cb6-aa12-8ba5d3177d44 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:07:49.800364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-44490bbf-c651-4cb6-aa12-8ba5d3177d44 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:49.806651 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44490bbf-c651-4cb6-aa12-8ba5d3177d44 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:49.811808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44490bbf-c651-4cb6-aa12-8ba5d3177d44 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:49.811808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44490bbf-c651-4cb6-aa12-8ba5d3177d44 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:49.811808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44490bbf-c651-4cb6-aa12-8ba5d3177d44 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:49.811808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44490bbf-c651-4cb6-aa12-8ba5d3177d44 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:49.812251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44490bbf-c651-4cb6-aa12-8ba5d3177d44 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:49.945666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:50.024466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-44490bbf-c651-4cb6-aa12-8ba5d3177d44 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "POST /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744/action" status: 202 len: 0 microversion: 2.1 time: 0.229525 Oct 28 20:07:50.028357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 155/303] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Oct 28 20:07:49 2022] POST /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:07:50.033812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c56d66e-279a-4a95-8eee-cd73c3549737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:50.034480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7c56d66e-279a-4a95-8eee-cd73c3549737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:50.040487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c56d66e-279a-4a95-8eee-cd73c3549737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:50.040965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c56d66e-279a-4a95-8eee-cd73c3549737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:50.041429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c56d66e-279a-4a95-8eee-cd73c3549737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:50.042114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c56d66e-279a-4a95-8eee-cd73c3549737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:50.042576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c56d66e-279a-4a95-8eee-cd73c3549737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:50.044078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c56d66e-279a-4a95-8eee-cd73c3549737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:50.189151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7c56d66e-279a-4a95-8eee-cd73c3549737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:50.197489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c56d66e-279a-4a95-8eee-cd73c3549737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1509 microversion: 2.1 time: 0.167995 Oct 28 20:07:50.198382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 149/304] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:50 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:07:50.392597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b81cd872-b979-4c9e-9531-cd98f78aebec tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:50.393612 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b81cd872-b979-4c9e-9531-cd98f78aebec tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:50.401745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b81cd872-b979-4c9e-9531-cd98f78aebec tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:50.402260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b81cd872-b979-4c9e-9531-cd98f78aebec tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:50.402883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b81cd872-b979-4c9e-9531-cd98f78aebec tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:50.405938 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b81cd872-b979-4c9e-9531-cd98f78aebec tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:50.405938 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b81cd872-b979-4c9e-9531-cd98f78aebec tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:50.405938 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b81cd872-b979-4c9e-9531-cd98f78aebec tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:50.562520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b81cd872-b979-4c9e-9531-cd98f78aebec tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:50.571596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b81cd872-b979-4c9e-9531-cd98f78aebec tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:50.581880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b81cd872-b979-4c9e-9531-cd98f78aebec tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:50.581880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b81cd872-b979-4c9e-9531-cd98f78aebec tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.187916 Oct 28 20:07:50.581880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 156/305] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:07:50 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:07:50.751288 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4ee11d5a-d66c-46c3-85a0-827bb246b52e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Action: 'create', calling method: .version_select at 0x7f1f4d1bce50>, body: {"keypair": {"name": "tempest-keypair-2141916370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo0uFVIQJlh066oaeKiYz5yhdg6/l/+l0SRymE8IvtlrK/NJEXiKkRHUsP2EzKKLRjaFsbzB+ADWc/xxm1anpLhz+Nx5joLzLb8BGMt1ZfEv69UkLTEjsESLPWikzl8hQ=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:07:50.771825 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-4ee11d5a-d66c-46c3-85a0-827bb246b52e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Getting quotas for project 940ce72c42534c5196dfb909cc2a8d54. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:07:50.775898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-4ee11d5a-d66c-46c3-85a0-827bb246b52e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Getting quotas for user 724baaa4aa834e609fe4f513f9fc0b4b and project 940ce72c42534c5196dfb909cc2a8d54. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:07:50.890696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4ee11d5a-d66c-46c3-85a0-827bb246b52e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.143926 Oct 28 20:07:50.891561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 150/306] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Oct 28 20:07:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:07:51.222400 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-326888d4-2b4e-46ba-bf69-7c28c4c7b551 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:51.223015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-326888d4-2b4e-46ba-bf69-7c28c4c7b551 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:51.230287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-326888d4-2b4e-46ba-bf69-7c28c4c7b551 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:51.230779 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-326888d4-2b4e-46ba-bf69-7c28c4c7b551 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:51.231241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-326888d4-2b4e-46ba-bf69-7c28c4c7b551 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:51.231941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-326888d4-2b4e-46ba-bf69-7c28c4c7b551 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:51.232474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-326888d4-2b4e-46ba-bf69-7c28c4c7b551 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:51.232899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-326888d4-2b4e-46ba-bf69-7c28c4c7b551 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:51.380408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-326888d4-2b4e-46ba-bf69-7c28c4c7b551 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:51.388630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-326888d4-2b4e-46ba-bf69-7c28c4c7b551 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1509 microversion: 2.1 time: 0.170193 Oct 28 20:07:51.389505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 157/307] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:51 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:51.622776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-53f3f992-b34b-419f-8d0d-610f4db280bf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:51.623429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-53f3f992-b34b-419f-8d0d-610f4db280bf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:51.630026 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53f3f992-b34b-419f-8d0d-610f4db280bf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:51.630521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53f3f992-b34b-419f-8d0d-610f4db280bf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:51.630964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53f3f992-b34b-419f-8d0d-610f4db280bf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:51.631667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53f3f992-b34b-419f-8d0d-610f4db280bf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:51.632149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53f3f992-b34b-419f-8d0d-610f4db280bf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:51.632575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53f3f992-b34b-419f-8d0d-610f4db280bf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:51.791605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-53f3f992-b34b-419f-8d0d-610f4db280bf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:51.800361 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-53f3f992-b34b-419f-8d0d-610f4db280bf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:51.801869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-53f3f992-b34b-419f-8d0d-610f4db280bf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:51.804808 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-53f3f992-b34b-419f-8d0d-610f4db280bf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.186363 Oct 28 20:07:51.805397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 151/308] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:07:51 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:07:52.411567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-10c7f169-b39c-41ca-8298-ab3d0aecc38d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:52.412264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-10c7f169-b39c-41ca-8298-ab3d0aecc38d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:52.418825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c7f169-b39c-41ca-8298-ab3d0aecc38d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:52.419442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c7f169-b39c-41ca-8298-ab3d0aecc38d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:52.419911 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c7f169-b39c-41ca-8298-ab3d0aecc38d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:52.420622 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c7f169-b39c-41ca-8298-ab3d0aecc38d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:52.421086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c7f169-b39c-41ca-8298-ab3d0aecc38d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:52.421547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c7f169-b39c-41ca-8298-ab3d0aecc38d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:52.612845 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-10c7f169-b39c-41ca-8298-ab3d0aecc38d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:52.620664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-10c7f169-b39c-41ca-8298-ab3d0aecc38d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1509 microversion: 2.1 time: 0.212917 Oct 28 20:07:52.622649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 158/309] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:52 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:52.831993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a4a21d0d-85cc-4d28-8b1a-9b7bea4777e5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:52.832529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a4a21d0d-85cc-4d28-8b1a-9b7bea4777e5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:52.838984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4a21d0d-85cc-4d28-8b1a-9b7bea4777e5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:52.839463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4a21d0d-85cc-4d28-8b1a-9b7bea4777e5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:52.839896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4a21d0d-85cc-4d28-8b1a-9b7bea4777e5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:52.840581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4a21d0d-85cc-4d28-8b1a-9b7bea4777e5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:52.841056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4a21d0d-85cc-4d28-8b1a-9b7bea4777e5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:52.843460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4a21d0d-85cc-4d28-8b1a-9b7bea4777e5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:53.038935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a4a21d0d-85cc-4d28-8b1a-9b7bea4777e5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:53.048045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a4a21d0d-85cc-4d28-8b1a-9b7bea4777e5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:53.049535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a4a21d0d-85cc-4d28-8b1a-9b7bea4777e5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:53.050705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a4a21d0d-85cc-4d28-8b1a-9b7bea4777e5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.222830 Oct 28 20:07:53.061348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 152/310] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:07:52 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:07:53.468715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-382182518", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9279e057-17ab-422f-8ee0-b121068c9ee3"}], "security_groups": [{"name": "tempest-securitygroup--1927894123"}], "key_name": "tempest-keypair-2141916370", "user_data": "}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:07:53.571272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] validate_networks() for [('9279e057-17ab-422f-8ee0-b121068c9ee3', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:07:53.644815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-acd32451-014f-4347-82c1-195496a72a89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:53.645347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-acd32451-014f-4347-82c1-195496a72a89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:53.651631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acd32451-014f-4347-82c1-195496a72a89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:53.652117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acd32451-014f-4347-82c1-195496a72a89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:53.652550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acd32451-014f-4347-82c1-195496a72a89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:53.653232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acd32451-014f-4347-82c1-195496a72a89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:53.653710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acd32451-014f-4347-82c1-195496a72a89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:53.654817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acd32451-014f-4347-82c1-195496a72a89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:53.887275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-acd32451-014f-4347-82c1-195496a72a89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:53.896994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-acd32451-014f-4347-82c1-195496a72a89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1509 microversion: 2.1 time: 0.255943 Oct 28 20:07:53.897674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 153/311] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:53 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:07:54.023157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:07:54.023578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:07:54.024046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:07:54.024453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:07:54.024861 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:07:54.034076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:54.034606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:54.035089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:54.036623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:54.037127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:54.037945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:54.056740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Getting quotas for project 940ce72c42534c5196dfb909cc2a8d54. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:07:54.061417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Getting quotas for user 724baaa4aa834e609fe4f513f9fc0b4b and project 940ce72c42534c5196dfb909cc2a8d54. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:07:54.072817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:07:54.075490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:07:54.076818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4da91080-035f-4b99-8c18-353387e70d4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:54.077534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4da91080-035f-4b99-8c18-353387e70d4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:54.083454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4da91080-035f-4b99-8c18-353387e70d4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:54.084001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4da91080-035f-4b99-8c18-353387e70d4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:54.087193 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4da91080-035f-4b99-8c18-353387e70d4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:54.087922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4da91080-035f-4b99-8c18-353387e70d4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:54.088370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4da91080-035f-4b99-8c18-353387e70d4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:54.088789 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4da91080-035f-4b99-8c18-353387e70d4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:54.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-06e010ad-47b3-4be2-9c5d-4b9e09d1b58f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.709169 Oct 28 20:07:54.173872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 159/312] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:07:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:07:54.184649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14e72320-63ce-4d68-9c39-45c12a5f0bc5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:54.185357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-14e72320-63ce-4d68-9c39-45c12a5f0bc5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:54.253732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-14e72320-63ce-4d68-9c39-45c12a5f0bc5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:54.260678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14e72320-63ce-4d68-9c39-45c12a5f0bc5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1241 microversion: 2.1 time: 0.079630 Oct 28 20:07:54.261565 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 160/313] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:54 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:54.279692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4da91080-035f-4b99-8c18-353387e70d4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:54.287818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4da91080-035f-4b99-8c18-353387e70d4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:54.289292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4da91080-035f-4b99-8c18-353387e70d4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:54.290637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4da91080-035f-4b99-8c18-353387e70d4c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.218482 Oct 28 20:07:54.305567 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 154/314] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:07:54 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:07:54.919975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e0d0c464-d844-45d5-98d2-9fcd3abcff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:54.921232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e0d0c464-d844-45d5-98d2-9fcd3abcff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:54.938872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0d0c464-d844-45d5-98d2-9fcd3abcff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:54.938872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0d0c464-d844-45d5-98d2-9fcd3abcff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:54.938872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0d0c464-d844-45d5-98d2-9fcd3abcff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:54.938872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0d0c464-d844-45d5-98d2-9fcd3abcff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:54.939251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0d0c464-d844-45d5-98d2-9fcd3abcff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:54.939251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0d0c464-d844-45d5-98d2-9fcd3abcff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:54.951172 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e553c483-8016-47f0-89b1-35af3391f211 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c11093d-2660-4ab4-990d-7931e2c42415"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:07:54.954726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e553c483-8016-47f0-89b1-35af3391f211 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:54.962031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e553c483-8016-47f0-89b1-35af3391f211 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:54.962635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e553c483-8016-47f0-89b1-35af3391f211 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:54.963050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e553c483-8016-47f0-89b1-35af3391f211 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:54.963759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e553c483-8016-47f0-89b1-35af3391f211 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:54.964223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e553c483-8016-47f0-89b1-35af3391f211 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:54.964650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e553c483-8016-47f0-89b1-35af3391f211 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:55.096824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e0d0c464-d844-45d5-98d2-9fcd3abcff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:55.104335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e0d0c464-d844-45d5-98d2-9fcd3abcff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1509 microversion: 2.1 time: 0.188140 Oct 28 20:07:55.106631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 161/315] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:54 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:55.283880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a957be18-792d-47cd-96f7-5c404fa3ce31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:55.284487 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a957be18-792d-47cd-96f7-5c404fa3ce31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:55.290441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a957be18-792d-47cd-96f7-5c404fa3ce31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:55.290920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a957be18-792d-47cd-96f7-5c404fa3ce31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:55.291414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a957be18-792d-47cd-96f7-5c404fa3ce31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:55.292039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a957be18-792d-47cd-96f7-5c404fa3ce31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:55.292598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a957be18-792d-47cd-96f7-5c404fa3ce31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:55.293025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a957be18-792d-47cd-96f7-5c404fa3ce31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:55.358093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a957be18-792d-47cd-96f7-5c404fa3ce31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:55.371259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a957be18-792d-47cd-96f7-5c404fa3ce31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1245 microversion: 2.1 time: 0.091466 Oct 28 20:07:55.371895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 162/316] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:55 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:07:55.377102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7b17b39a-c020-42a3-b76a-9d76040b6679 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:55.377794 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7b17b39a-c020-42a3-b76a-9d76040b6679 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:55.383609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b17b39a-c020-42a3-b76a-9d76040b6679 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:55.384086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b17b39a-c020-42a3-b76a-9d76040b6679 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:55.384521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b17b39a-c020-42a3-b76a-9d76040b6679 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:55.385207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b17b39a-c020-42a3-b76a-9d76040b6679 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:55.385696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b17b39a-c020-42a3-b76a-9d76040b6679 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:55.386119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b17b39a-c020-42a3-b76a-9d76040b6679 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:55.522298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7b17b39a-c020-42a3-b76a-9d76040b6679 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:55.530283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7b17b39a-c020-42a3-b76a-9d76040b6679 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:55.532249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7b17b39a-c020-42a3-b76a-9d76040b6679 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:55.533420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7b17b39a-c020-42a3-b76a-9d76040b6679 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.160600 Oct 28 20:07:55.533971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 163/317] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:07:55 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:07:56.129314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bfbd26c6-7592-4bca-90ca-0fbb5c5c2214 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:56.130035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bfbd26c6-7592-4bca-90ca-0fbb5c5c2214 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:56.136318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfbd26c6-7592-4bca-90ca-0fbb5c5c2214 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:56.136795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfbd26c6-7592-4bca-90ca-0fbb5c5c2214 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:56.137252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfbd26c6-7592-4bca-90ca-0fbb5c5c2214 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:56.137965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfbd26c6-7592-4bca-90ca-0fbb5c5c2214 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:56.138413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfbd26c6-7592-4bca-90ca-0fbb5c5c2214 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:56.138832 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfbd26c6-7592-4bca-90ca-0fbb5c5c2214 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:56.278018 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bfbd26c6-7592-4bca-90ca-0fbb5c5c2214 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:56.286084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bfbd26c6-7592-4bca-90ca-0fbb5c5c2214 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1509 microversion: 2.1 time: 0.161065 Oct 28 20:07:56.286509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 164/318] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:56 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:07:56.332196 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:56.401250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-81c21139-0b15-405b-85f1-6efc01683ab5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:56.402232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-81c21139-0b15-405b-85f1-6efc01683ab5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:56.413795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c21139-0b15-405b-85f1-6efc01683ab5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:56.414288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c21139-0b15-405b-85f1-6efc01683ab5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:56.415002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c21139-0b15-405b-85f1-6efc01683ab5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:56.415707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c21139-0b15-405b-85f1-6efc01683ab5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:56.416317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c21139-0b15-405b-85f1-6efc01683ab5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:56.416748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c21139-0b15-405b-85f1-6efc01683ab5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:56.480159 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-81c21139-0b15-405b-85f1-6efc01683ab5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:56.488479 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-81c21139-0b15-405b-85f1-6efc01683ab5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1245 microversion: 2.1 time: 0.091980 Oct 28 20:07:56.488979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 165/319] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:56 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:56.559815 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e900d18f-a495-4525-9550-d8715d278bb7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:56.560521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e900d18f-a495-4525-9550-d8715d278bb7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:56.566943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e900d18f-a495-4525-9550-d8715d278bb7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:56.567495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e900d18f-a495-4525-9550-d8715d278bb7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:56.567994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e900d18f-a495-4525-9550-d8715d278bb7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:56.568854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e900d18f-a495-4525-9550-d8715d278bb7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:56.569399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e900d18f-a495-4525-9550-d8715d278bb7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:56.569886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e900d18f-a495-4525-9550-d8715d278bb7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:56.710176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e900d18f-a495-4525-9550-d8715d278bb7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:56.719962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e900d18f-a495-4525-9550-d8715d278bb7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:56.721673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e900d18f-a495-4525-9550-d8715d278bb7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:56.722965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e900d18f-a495-4525-9550-d8715d278bb7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.167230 Oct 28 20:07:56.723586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 166/320] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:07:56 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:07:56.912745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e553c483-8016-47f0-89b1-35af3391f211 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "POST /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.970428 Oct 28 20:07:56.914436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 155/321] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Oct 28 20:07:54 2022] POST /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 194 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:07:57.308855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e9986a6b-14cc-4124-a326-6634c985a15e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:57.309528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e9986a6b-14cc-4124-a326-6634c985a15e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:57.316656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9986a6b-14cc-4124-a326-6634c985a15e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:57.317143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9986a6b-14cc-4124-a326-6634c985a15e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:57.317611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9986a6b-14cc-4124-a326-6634c985a15e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:57.318313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9986a6b-14cc-4124-a326-6634c985a15e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:57.318772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9986a6b-14cc-4124-a326-6634c985a15e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:57.319333 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9986a6b-14cc-4124-a326-6634c985a15e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:57.451255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e9986a6b-14cc-4124-a326-6634c985a15e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:57.460006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e9986a6b-14cc-4124-a326-6634c985a15e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1515 microversion: 2.1 time: 0.154750 Oct 28 20:07:57.460577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 167/322] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:57 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:57.511627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-836b50ff-cb23-4ef2-a20d-3eaa1ed0ff3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:57.512392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-836b50ff-cb23-4ef2-a20d-3eaa1ed0ff3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:57.514825 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:57.519737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-836b50ff-cb23-4ef2-a20d-3eaa1ed0ff3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:57.520216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-836b50ff-cb23-4ef2-a20d-3eaa1ed0ff3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:57.520650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-836b50ff-cb23-4ef2-a20d-3eaa1ed0ff3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:57.521350 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-836b50ff-cb23-4ef2-a20d-3eaa1ed0ff3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:57.521805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-836b50ff-cb23-4ef2-a20d-3eaa1ed0ff3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:57.522312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-836b50ff-cb23-4ef2-a20d-3eaa1ed0ff3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:57.595839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-836b50ff-cb23-4ef2-a20d-3eaa1ed0ff3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:57.603966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-836b50ff-cb23-4ef2-a20d-3eaa1ed0ff3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1237 microversion: 2.1 time: 0.096570 Oct 28 20:07:57.604535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 156/323] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:57 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1237 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:57.749530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2c27ac1e-0243-4e8c-874b-4c632e8e11f2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:57.750164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2c27ac1e-0243-4e8c-874b-4c632e8e11f2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:57.756446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c27ac1e-0243-4e8c-874b-4c632e8e11f2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:57.756938 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c27ac1e-0243-4e8c-874b-4c632e8e11f2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:57.757425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c27ac1e-0243-4e8c-874b-4c632e8e11f2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:57.758133 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c27ac1e-0243-4e8c-874b-4c632e8e11f2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:57.758591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c27ac1e-0243-4e8c-874b-4c632e8e11f2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:57.759047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c27ac1e-0243-4e8c-874b-4c632e8e11f2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:57.919727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2c27ac1e-0243-4e8c-874b-4c632e8e11f2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:57.929263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2c27ac1e-0243-4e8c-874b-4c632e8e11f2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:57.930743 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2c27ac1e-0243-4e8c-874b-4c632e8e11f2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:57.932006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2c27ac1e-0243-4e8c-874b-4c632e8e11f2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.186256 Oct 28 20:07:57.932553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 168/324] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:07:57 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:07:58.628789 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2c35bf25-060f-4706-a14c-abd006cd567b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:58.629548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2c35bf25-060f-4706-a14c-abd006cd567b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:58.636468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c35bf25-060f-4706-a14c-abd006cd567b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:58.638232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c35bf25-060f-4706-a14c-abd006cd567b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:58.638232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c35bf25-060f-4706-a14c-abd006cd567b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:58.638232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c35bf25-060f-4706-a14c-abd006cd567b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:58.638842 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c35bf25-060f-4706-a14c-abd006cd567b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:58.639259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c35bf25-060f-4706-a14c-abd006cd567b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:58.728209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2c35bf25-060f-4706-a14c-abd006cd567b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:58.736824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2c35bf25-060f-4706-a14c-abd006cd567b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1293 microversion: 2.1 time: 0.112786 Oct 28 20:07:58.737420 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 157/325] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:58 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1293 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:58.958346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ced3d0e9-fa78-492d-9fc8-8548026d99f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:58.958980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ced3d0e9-fa78-492d-9fc8-8548026d99f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:58.965649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ced3d0e9-fa78-492d-9fc8-8548026d99f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:58.966137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ced3d0e9-fa78-492d-9fc8-8548026d99f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:58.966579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ced3d0e9-fa78-492d-9fc8-8548026d99f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:58.967278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ced3d0e9-fa78-492d-9fc8-8548026d99f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:58.967744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ced3d0e9-fa78-492d-9fc8-8548026d99f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:58.968174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ced3d0e9-fa78-492d-9fc8-8548026d99f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:59.107364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ced3d0e9-fa78-492d-9fc8-8548026d99f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:59.118242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ced3d0e9-fa78-492d-9fc8-8548026d99f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:59.123082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ced3d0e9-fa78-492d-9fc8-8548026d99f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:59.126906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ced3d0e9-fa78-492d-9fc8-8548026d99f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.169976 Oct 28 20:07:59.126906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 169/326] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:07:58 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:07:59.128429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca9f4dd7-857b-4c40-99eb-7f996a7726ab tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Action: 'create', calling method: .version_select at 0x7f1f4d030f70>, body: {"keypair": {"name": "tempest-keypair-203961108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa3bg1M8j7lriqL5U+AHYenBiP7w7Jz7ep8bNA5wBWHZIaLOTiXfuRJmwIbxvsEwpPle/XI9A6GS4XTwJkIHpKB+kl++ozj9p0vO/c4T4CaW2ccN5ek5IDBDmTqEvUH4A=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:07:59.163001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-ca9f4dd7-857b-4c40-99eb-7f996a7726ab tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Getting quotas for project ab907bf956554681beae45b8973db6e5. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:07:59.167097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-ca9f4dd7-857b-4c40-99eb-7f996a7726ab tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Getting quotas for user ce7f52b7f96c400fb7d5fb0453c94362 and project ab907bf956554681beae45b8973db6e5. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:07:59.290544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ca9f4dd7-857b-4c40-99eb-7f996a7726ab tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.167377 Oct 28 20:07:59.291151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 158/327] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Oct 28 20:07:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:07:59.761115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-27cb6e3e-42e1-4f9c-8ad8-d33b11c17bd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:59.762059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-27cb6e3e-42e1-4f9c-8ad8-d33b11c17bd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:59.768598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27cb6e3e-42e1-4f9c-8ad8-d33b11c17bd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:59.769356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27cb6e3e-42e1-4f9c-8ad8-d33b11c17bd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:59.770000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27cb6e3e-42e1-4f9c-8ad8-d33b11c17bd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:59.770888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27cb6e3e-42e1-4f9c-8ad8-d33b11c17bd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:59.771554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27cb6e3e-42e1-4f9c-8ad8-d33b11c17bd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:59.772403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27cb6e3e-42e1-4f9c-8ad8-d33b11c17bd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:59.966025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-27cb6e3e-42e1-4f9c-8ad8-d33b11c17bd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:59.974352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-27cb6e3e-42e1-4f9c-8ad8-d33b11c17bd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.217951 Oct 28 20:07:59.974929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 170/328] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:59 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:00.158453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6bccf316-489d-478b-b947-411d7f8f2200 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:00.158997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6bccf316-489d-478b-b947-411d7f8f2200 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:00.164924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bccf316-489d-478b-b947-411d7f8f2200 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:00.165444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bccf316-489d-478b-b947-411d7f8f2200 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:00.165888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bccf316-489d-478b-b947-411d7f8f2200 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:00.166631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bccf316-489d-478b-b947-411d7f8f2200 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:00.167084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bccf316-489d-478b-b947-411d7f8f2200 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:00.167510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bccf316-489d-478b-b947-411d7f8f2200 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:00.335099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6bccf316-489d-478b-b947-411d7f8f2200 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:00.344345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6bccf316-489d-478b-b947-411d7f8f2200 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:00.346149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6bccf316-489d-478b-b947-411d7f8f2200 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:00.347524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6bccf316-489d-478b-b947-411d7f8f2200 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.194448 Oct 28 20:08:00.348083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 159/329] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:00 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:00.999148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dff82b37-b49b-4bad-bd7d-ac95684e5733 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:00.999772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dff82b37-b49b-4bad-bd7d-ac95684e5733 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:01.008133 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff82b37-b49b-4bad-bd7d-ac95684e5733 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:01.008630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff82b37-b49b-4bad-bd7d-ac95684e5733 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:01.009282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff82b37-b49b-4bad-bd7d-ac95684e5733 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:01.010247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff82b37-b49b-4bad-bd7d-ac95684e5733 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:01.010899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff82b37-b49b-4bad-bd7d-ac95684e5733 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:01.011518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff82b37-b49b-4bad-bd7d-ac95684e5733 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:01.169456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dff82b37-b49b-4bad-bd7d-ac95684e5733 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:01.178233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dff82b37-b49b-4bad-bd7d-ac95684e5733 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.183074 Oct 28 20:08:01.178812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 171/330] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:00 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:01.373869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1dc9a3ac-5a9d-4d3c-b10d-5cdbb1766322 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:01.374467 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1dc9a3ac-5a9d-4d3c-b10d-5cdbb1766322 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:01.381777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc9a3ac-5a9d-4d3c-b10d-5cdbb1766322 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:01.382261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc9a3ac-5a9d-4d3c-b10d-5cdbb1766322 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:01.382874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc9a3ac-5a9d-4d3c-b10d-5cdbb1766322 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:01.383741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc9a3ac-5a9d-4d3c-b10d-5cdbb1766322 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:01.384373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc9a3ac-5a9d-4d3c-b10d-5cdbb1766322 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:01.384807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc9a3ac-5a9d-4d3c-b10d-5cdbb1766322 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:01.524100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1dc9a3ac-5a9d-4d3c-b10d-5cdbb1766322 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:01.532677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1dc9a3ac-5a9d-4d3c-b10d-5cdbb1766322 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:01.534169 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1dc9a3ac-5a9d-4d3c-b10d-5cdbb1766322 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:01.535349 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1dc9a3ac-5a9d-4d3c-b10d-5cdbb1766322 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.165696 Oct 28 20:08:01.535911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 160/331] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:01 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:01.824891 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1263015047", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c983a099-9298-4ad4-a46a-5c42259ab55a"}], "security_groups": [{"name": "tempest-securitygroup--1558208602"}], "key_name": "tempest-keypair-203961108", "user_data": "}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:01.836644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:01.936129 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] validate_networks() for [('c983a099-9298-4ad4-a46a-5c42259ab55a', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:08:02.201924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-47c65cbe-9889-46cd-8832-e5403b11f64e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:02.202994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-47c65cbe-9889-46cd-8832-e5403b11f64e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:02.211786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47c65cbe-9889-46cd-8832-e5403b11f64e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:02.212287 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47c65cbe-9889-46cd-8832-e5403b11f64e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:02.212735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47c65cbe-9889-46cd-8832-e5403b11f64e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:02.213485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47c65cbe-9889-46cd-8832-e5403b11f64e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:02.214299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47c65cbe-9889-46cd-8832-e5403b11f64e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:02.221096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47c65cbe-9889-46cd-8832-e5403b11f64e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:02.445243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-47c65cbe-9889-46cd-8832-e5403b11f64e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:02.454927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-47c65cbe-9889-46cd-8832-e5403b11f64e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.255422 Oct 28 20:08:02.455831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 161/332] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:02 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:02.476096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:08:02.476577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:08:02.476988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:08:02.477436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:08:02.477858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:08:02.487345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:02.487834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:02.488277 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:02.489009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:02.489574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:02.489925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:02.507551 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Getting quotas for project ab907bf956554681beae45b8973db6e5. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:08:02.511373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Getting quotas for user ce7f52b7f96c400fb7d5fb0453c94362 and project ab907bf956554681beae45b8973db6e5. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:08:02.522728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:08:02.524906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:08:02.561400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ff044b13-f4d3-4ad5-a188-f90d00e53184 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:02.562016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ff044b13-f4d3-4ad5-a188-f90d00e53184 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:02.568772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff044b13-f4d3-4ad5-a188-f90d00e53184 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:02.569353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff044b13-f4d3-4ad5-a188-f90d00e53184 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:02.569827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff044b13-f4d3-4ad5-a188-f90d00e53184 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:02.570547 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff044b13-f4d3-4ad5-a188-f90d00e53184 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:02.570986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff044b13-f4d3-4ad5-a188-f90d00e53184 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:02.571410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff044b13-f4d3-4ad5-a188-f90d00e53184 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:02.626061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0083a33d-7520-4dff-a69f-4acb78983b9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.807108 Oct 28 20:08:02.627437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 172/333] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:08:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:08:02.639521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f87d6456-eb30-47fd-b768-8996a7274cc0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:02.640507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f87d6456-eb30-47fd-b768-8996a7274cc0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:02.716399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f87d6456-eb30-47fd-b768-8996a7274cc0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:02.726572 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f87d6456-eb30-47fd-b768-8996a7274cc0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1245 microversion: 2.1 time: 0.091969 Oct 28 20:08:02.727166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 173/334] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:02 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:02.762575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ff044b13-f4d3-4ad5-a188-f90d00e53184 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:02.783050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ff044b13-f4d3-4ad5-a188-f90d00e53184 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:02.784502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ff044b13-f4d3-4ad5-a188-f90d00e53184 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:02.785704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ff044b13-f4d3-4ad5-a188-f90d00e53184 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.228241 Oct 28 20:08:02.786831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 162/335] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:02 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:08:03.131337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-985433bb-3751-42f4-8d36-ed50e8ff2efb req-128c550a-513c-4ac3-90bc-4cc8066ee435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2", "tag": "85e3fd0b-83fb-48bf-8cd7-071823c4c38c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:03.141009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-985433bb-3751-42f4-8d36-ed50e8ff2efb req-128c550a-513c-4ac3-90bc-4cc8066ee435 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:03.141804 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-985433bb-3751-42f4-8d36-ed50e8ff2efb req-128c550a-513c-4ac3-90bc-4cc8066ee435 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:03.142421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-985433bb-3751-42f4-8d36-ed50e8ff2efb req-128c550a-513c-4ac3-90bc-4cc8066ee435 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:03.153703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-985433bb-3751-42f4-8d36-ed50e8ff2efb req-128c550a-513c-4ac3-90bc-4cc8066ee435 service nova] Creating event network-changed:85e3fd0b-83fb-48bf-8cd7-071823c4c38c for instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 on hv-cinder-86236 Oct 28 20:08:03.160062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-985433bb-3751-42f4-8d36-ed50e8ff2efb req-128c550a-513c-4ac3-90bc-4cc8066ee435 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040668 Oct 28 20:08:03.162237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 174/336] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:08:03.478005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-46afe2d8-24a6-4b7a-b59d-ec629a109c30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:03.478826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-46afe2d8-24a6-4b7a-b59d-ec629a109c30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:03.507029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46afe2d8-24a6-4b7a-b59d-ec629a109c30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:03.507645 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46afe2d8-24a6-4b7a-b59d-ec629a109c30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:03.508539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46afe2d8-24a6-4b7a-b59d-ec629a109c30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:03.509457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46afe2d8-24a6-4b7a-b59d-ec629a109c30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:03.510059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46afe2d8-24a6-4b7a-b59d-ec629a109c30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:03.510630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46afe2d8-24a6-4b7a-b59d-ec629a109c30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:03.700228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-46afe2d8-24a6-4b7a-b59d-ec629a109c30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:03.709436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-46afe2d8-24a6-4b7a-b59d-ec629a109c30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.235088 Oct 28 20:08:03.712565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 163/337] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:03 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:03.754185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2eb33188-7948-4036-b32b-73839edcfd5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:03.754904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2eb33188-7948-4036-b32b-73839edcfd5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:03.761743 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eb33188-7948-4036-b32b-73839edcfd5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:03.762233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eb33188-7948-4036-b32b-73839edcfd5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:03.763149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eb33188-7948-4036-b32b-73839edcfd5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:03.763872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eb33188-7948-4036-b32b-73839edcfd5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:03.764337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eb33188-7948-4036-b32b-73839edcfd5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:03.764769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eb33188-7948-4036-b32b-73839edcfd5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:03.816326 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d635d5e1-8f02-40b5-9c6a-9eaa1d2bc32e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:03.817167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d635d5e1-8f02-40b5-9c6a-9eaa1d2bc32e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:03.825373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d635d5e1-8f02-40b5-9c6a-9eaa1d2bc32e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:03.825952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d635d5e1-8f02-40b5-9c6a-9eaa1d2bc32e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:03.826367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d635d5e1-8f02-40b5-9c6a-9eaa1d2bc32e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:03.827121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d635d5e1-8f02-40b5-9c6a-9eaa1d2bc32e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:03.827573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d635d5e1-8f02-40b5-9c6a-9eaa1d2bc32e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:03.828061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d635d5e1-8f02-40b5-9c6a-9eaa1d2bc32e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:03.832068 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2eb33188-7948-4036-b32b-73839edcfd5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:03.841593 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2eb33188-7948-4036-b32b-73839edcfd5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.092914 Oct 28 20:08:03.842285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 175/338] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:03 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:03.986073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d635d5e1-8f02-40b5-9c6a-9eaa1d2bc32e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:03.994735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d635d5e1-8f02-40b5-9c6a-9eaa1d2bc32e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:03.996218 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d635d5e1-8f02-40b5-9c6a-9eaa1d2bc32e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:03.997496 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d635d5e1-8f02-40b5-9c6a-9eaa1d2bc32e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.186383 Oct 28 20:08:03.998377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 164/339] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:03 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:04.225495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-95113856", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-630547667", "security_groups": [{"name": "tempest-secgroup-smoke-261326879"}], "block_device_mapping_v2": [{"uuid": "1f8f3e63-8ab1-4e27-a68d-cb1669f912ae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7fbbe129-1fcc-46d5-84db-9c5854f102d9"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:04.359448 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] validate_networks() for [('7fbbe129-1fcc-46d5-84db-9c5854f102d9', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:08:04.733554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-839ec178-427d-43a0-a4d0-542f8e68a689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:04.734166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-839ec178-427d-43a0-a4d0-542f8e68a689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:04.741722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839ec178-427d-43a0-a4d0-542f8e68a689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:04.742230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839ec178-427d-43a0-a4d0-542f8e68a689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:04.742623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839ec178-427d-43a0-a4d0-542f8e68a689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:04.743486 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839ec178-427d-43a0-a4d0-542f8e68a689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:04.743748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839ec178-427d-43a0-a4d0-542f8e68a689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:04.744465 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839ec178-427d-43a0-a4d0-542f8e68a689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:04.764847 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:08:04.765344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:08:04.765821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:08:04.766733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:08:04.766933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:08:04.777681 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:04.779000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:04.779000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:04.779381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:04.779854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:04.780282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:04.802993 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Getting quotas for project fac1485ccdeb434ca49caa52ebfdc24b. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:08:04.810589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Getting quotas for user a5c784f29d2e4cb4bb8bd6d62fbc2216 and project fac1485ccdeb434ca49caa52ebfdc24b. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:08:04.890975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:08:04.895078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1f8f3e63-8ab1-4e27-a68d-cb1669f912ae',volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:08:04.900489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-839ec178-427d-43a0-a4d0-542f8e68a689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:04.910310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-839ec178-427d-43a0-a4d0-542f8e68a689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.178809 Oct 28 20:08:04.910310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 165/340] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:04 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:04.913684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f24cd0fe-dbbf-4a3f-8cf2-b5ea534c38d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:04.914271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f24cd0fe-dbbf-4a3f-8cf2-b5ea534c38d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:04.919989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f24cd0fe-dbbf-4a3f-8cf2-b5ea534c38d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:04.920464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f24cd0fe-dbbf-4a3f-8cf2-b5ea534c38d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:04.920894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f24cd0fe-dbbf-4a3f-8cf2-b5ea534c38d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:04.921613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f24cd0fe-dbbf-4a3f-8cf2-b5ea534c38d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:04.923122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f24cd0fe-dbbf-4a3f-8cf2-b5ea534c38d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:04.923709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f24cd0fe-dbbf-4a3f-8cf2-b5ea534c38d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:04.989630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f24cd0fe-dbbf-4a3f-8cf2-b5ea534c38d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:04.997236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f24cd0fe-dbbf-4a3f-8cf2-b5ea534c38d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.087478 Oct 28 20:08:04.997824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 166/341] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:04 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:05.023314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a29154d5-ac90-4f7a-8098-3abba529566c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:05.023981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a29154d5-ac90-4f7a-8098-3abba529566c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:05.032431 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29154d5-ac90-4f7a-8098-3abba529566c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:05.032986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29154d5-ac90-4f7a-8098-3abba529566c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:05.033451 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29154d5-ac90-4f7a-8098-3abba529566c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:05.036497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29154d5-ac90-4f7a-8098-3abba529566c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:05.036497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29154d5-ac90-4f7a-8098-3abba529566c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:05.036497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29154d5-ac90-4f7a-8098-3abba529566c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:05.169927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a29154d5-ac90-4f7a-8098-3abba529566c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:05.178696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a29154d5-ac90-4f7a-8098-3abba529566c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:05.180140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a29154d5-ac90-4f7a-8098-3abba529566c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:05.181409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a29154d5-ac90-4f7a-8098-3abba529566c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.162008 Oct 28 20:08:05.182000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 167/342] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:05 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:08:05.277567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-024b0477-3a02-4bcb-9a93-22f7c4ff4bac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.055841 Oct 28 20:08:05.278803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 176/343] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:08:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:08:05.298200 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-41d157ea-a474-449d-86e1-8ac20afbc4fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:05.299717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-41d157ea-a474-449d-86e1-8ac20afbc4fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:05.354482 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-41d157ea-a474-449d-86e1-8ac20afbc4fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:05.361962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-41d157ea-a474-449d-86e1-8ac20afbc4fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1092 microversion: 2.1 time: 0.067540 Oct 28 20:08:05.362536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 168/344] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:05 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1092 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:05.935920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-feadfe88-98ef-4d03-b59f-664ba6aa76f6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:05.937151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-feadfe88-98ef-4d03-b59f-664ba6aa76f6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:05.944401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-feadfe88-98ef-4d03-b59f-664ba6aa76f6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:05.944869 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-feadfe88-98ef-4d03-b59f-664ba6aa76f6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:05.945309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-feadfe88-98ef-4d03-b59f-664ba6aa76f6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:05.946037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-feadfe88-98ef-4d03-b59f-664ba6aa76f6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:05.946496 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-feadfe88-98ef-4d03-b59f-664ba6aa76f6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:05.946924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-feadfe88-98ef-4d03-b59f-664ba6aa76f6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:05.951074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:06.021836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a974f2b-896a-498d-be99-3147f8bf8b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:06.022729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0a974f2b-896a-498d-be99-3147f8bf8b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:06.029939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a974f2b-896a-498d-be99-3147f8bf8b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:06.030480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a974f2b-896a-498d-be99-3147f8bf8b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:06.031158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a974f2b-896a-498d-be99-3147f8bf8b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:06.032649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a974f2b-896a-498d-be99-3147f8bf8b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:06.033383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a974f2b-896a-498d-be99-3147f8bf8b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:06.034409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a974f2b-896a-498d-be99-3147f8bf8b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:06.097543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-feadfe88-98ef-4d03-b59f-664ba6aa76f6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:06.105475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-feadfe88-98ef-4d03-b59f-664ba6aa76f6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.175898 Oct 28 20:08:06.106061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 177/345] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:05 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:06.210080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d3d170ee-f0fd-4ed5-8cc5-a7db92b37bb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:06.210699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d3d170ee-f0fd-4ed5-8cc5-a7db92b37bb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:06.217007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3d170ee-f0fd-4ed5-8cc5-a7db92b37bb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:06.217536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3d170ee-f0fd-4ed5-8cc5-a7db92b37bb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:06.217973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3d170ee-f0fd-4ed5-8cc5-a7db92b37bb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:06.218679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3d170ee-f0fd-4ed5-8cc5-a7db92b37bb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:06.219134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3d170ee-f0fd-4ed5-8cc5-a7db92b37bb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:06.219665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3d170ee-f0fd-4ed5-8cc5-a7db92b37bb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:06.348171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a974f2b-896a-498d-be99-3147f8bf8b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:06.360171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0a974f2b-896a-498d-be99-3147f8bf8b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.343612 Oct 28 20:08:06.374302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 169/346] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:06 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:06.385943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-70db5d23-10c4-4600-83bf-05b9e922ea28 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:06.386751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-70db5d23-10c4-4600-83bf-05b9e922ea28 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:06.395461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70db5d23-10c4-4600-83bf-05b9e922ea28 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:06.396158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70db5d23-10c4-4600-83bf-05b9e922ea28 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:06.396701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70db5d23-10c4-4600-83bf-05b9e922ea28 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:06.397538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70db5d23-10c4-4600-83bf-05b9e922ea28 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:06.398204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70db5d23-10c4-4600-83bf-05b9e922ea28 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:06.398815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70db5d23-10c4-4600-83bf-05b9e922ea28 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:06.461846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d3d170ee-f0fd-4ed5-8cc5-a7db92b37bb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:06.472836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d3d170ee-f0fd-4ed5-8cc5-a7db92b37bb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:06.474625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d3d170ee-f0fd-4ed5-8cc5-a7db92b37bb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:06.476509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d3d170ee-f0fd-4ed5-8cc5-a7db92b37bb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.270630 Oct 28 20:08:06.477090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 178/347] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:06 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:08:06.477234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-70db5d23-10c4-4600-83bf-05b9e922ea28 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:06.486388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-70db5d23-10c4-4600-83bf-05b9e922ea28 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.104347 Oct 28 20:08:06.487075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 170/348] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:06 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:07.129789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78acf255-d836-46e7-8480-ebc502117dd6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:07.130410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-78acf255-d836-46e7-8480-ebc502117dd6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:07.136512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78acf255-d836-46e7-8480-ebc502117dd6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:07.136999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78acf255-d836-46e7-8480-ebc502117dd6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:07.137471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78acf255-d836-46e7-8480-ebc502117dd6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:07.138242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78acf255-d836-46e7-8480-ebc502117dd6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:07.138719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78acf255-d836-46e7-8480-ebc502117dd6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:07.139236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78acf255-d836-46e7-8480-ebc502117dd6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:07.270447 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-78acf255-d836-46e7-8480-ebc502117dd6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:07.277886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-78acf255-d836-46e7-8480-ebc502117dd6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.152654 Oct 28 20:08:07.278444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 179/349] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:07 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:07.382854 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f4c2b10b-404e-4e0b-a70c-8a2e5d2c033a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:07.383474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f4c2b10b-404e-4e0b-a70c-8a2e5d2c033a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:07.389817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4c2b10b-404e-4e0b-a70c-8a2e5d2c033a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:07.390302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4c2b10b-404e-4e0b-a70c-8a2e5d2c033a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:07.390735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4c2b10b-404e-4e0b-a70c-8a2e5d2c033a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:07.391419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4c2b10b-404e-4e0b-a70c-8a2e5d2c033a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:07.391870 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4c2b10b-404e-4e0b-a70c-8a2e5d2c033a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:07.392290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4c2b10b-404e-4e0b-a70c-8a2e5d2c033a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:07.453253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f4c2b10b-404e-4e0b-a70c-8a2e5d2c033a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:07.461704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f4c2b10b-404e-4e0b-a70c-8a2e5d2c033a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.082687 Oct 28 20:08:07.462252 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 171/350] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:07 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:07.503175 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78cc2dd7-c4b3-47f5-ae43-04420456c572 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:07.503810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-78cc2dd7-c4b3-47f5-ae43-04420456c572 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:07.509111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f0972942-2c93-47de-b9d4-0327639fa5db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:07.509695 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78cc2dd7-c4b3-47f5-ae43-04420456c572 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:07.509805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f0972942-2c93-47de-b9d4-0327639fa5db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:07.510187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78cc2dd7-c4b3-47f5-ae43-04420456c572 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:07.510631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78cc2dd7-c4b3-47f5-ae43-04420456c572 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:07.511326 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78cc2dd7-c4b3-47f5-ae43-04420456c572 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:07.511783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78cc2dd7-c4b3-47f5-ae43-04420456c572 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:07.512210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78cc2dd7-c4b3-47f5-ae43-04420456c572 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:07.515489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0972942-2c93-47de-b9d4-0327639fa5db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:07.515977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0972942-2c93-47de-b9d4-0327639fa5db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:07.517098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0972942-2c93-47de-b9d4-0327639fa5db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:07.517936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0972942-2c93-47de-b9d4-0327639fa5db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:07.518401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0972942-2c93-47de-b9d4-0327639fa5db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:07.518830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0972942-2c93-47de-b9d4-0327639fa5db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:07.601511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f0972942-2c93-47de-b9d4-0327639fa5db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:07.609001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f0972942-2c93-47de-b9d4-0327639fa5db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.103700 Oct 28 20:08:07.609601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 172/351] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:07 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:07.661837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-78cc2dd7-c4b3-47f5-ae43-04420456c572 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:07.669892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-78cc2dd7-c4b3-47f5-ae43-04420456c572 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:07.671339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-78cc2dd7-c4b3-47f5-ae43-04420456c572 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:07.672550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-78cc2dd7-c4b3-47f5-ae43-04420456c572 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.174248 Oct 28 20:08:07.673138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 180/352] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:07 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:08.300813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f5a1981e-181f-419f-8fe7-1cc91fcf4a8b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:08.301395 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f5a1981e-181f-419f-8fe7-1cc91fcf4a8b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:08.307580 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a1981e-181f-419f-8fe7-1cc91fcf4a8b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:08.308069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a1981e-181f-419f-8fe7-1cc91fcf4a8b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:08.308509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a1981e-181f-419f-8fe7-1cc91fcf4a8b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:08.309200 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a1981e-181f-419f-8fe7-1cc91fcf4a8b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:08.309713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a1981e-181f-419f-8fe7-1cc91fcf4a8b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:08.310141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a1981e-181f-419f-8fe7-1cc91fcf4a8b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:08.436108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f5a1981e-181f-419f-8fe7-1cc91fcf4a8b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:08.438563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:08.444608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f5a1981e-181f-419f-8fe7-1cc91fcf4a8b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.148469 Oct 28 20:08:08.445180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 173/353] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:08 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:08.483732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-314dd163-5034-4419-80d8-623942a3f72b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:08.484351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-314dd163-5034-4419-80d8-623942a3f72b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:08.491794 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-314dd163-5034-4419-80d8-623942a3f72b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:08.492284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-314dd163-5034-4419-80d8-623942a3f72b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:08.492726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-314dd163-5034-4419-80d8-623942a3f72b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:08.493444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-314dd163-5034-4419-80d8-623942a3f72b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:08.493905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-314dd163-5034-4419-80d8-623942a3f72b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:08.494333 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-314dd163-5034-4419-80d8-623942a3f72b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:08.555114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-314dd163-5034-4419-80d8-623942a3f72b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:08.562507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-314dd163-5034-4419-80d8-623942a3f72b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.082550 Oct 28 20:08:08.563086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 181/354] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:08 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:08.631373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9fd156d1-38dc-4250-b2f7-8b87de336b7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:08.631988 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9fd156d1-38dc-4250-b2f7-8b87de336b7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:08.638659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fd156d1-38dc-4250-b2f7-8b87de336b7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:08.645449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fd156d1-38dc-4250-b2f7-8b87de336b7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:08.645449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fd156d1-38dc-4250-b2f7-8b87de336b7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:08.645449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fd156d1-38dc-4250-b2f7-8b87de336b7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:08.645449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fd156d1-38dc-4250-b2f7-8b87de336b7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:08.645779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fd156d1-38dc-4250-b2f7-8b87de336b7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:08.698304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-96f73b69-f02e-43ac-9c7c-603d5212b215 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:08.698939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-96f73b69-f02e-43ac-9c7c-603d5212b215 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:08.706096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96f73b69-f02e-43ac-9c7c-603d5212b215 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:08.706593 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96f73b69-f02e-43ac-9c7c-603d5212b215 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:08.707038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96f73b69-f02e-43ac-9c7c-603d5212b215 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:08.707441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9fd156d1-38dc-4250-b2f7-8b87de336b7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:08.707738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96f73b69-f02e-43ac-9c7c-603d5212b215 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:08.708203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96f73b69-f02e-43ac-9c7c-603d5212b215 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:08.708633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96f73b69-f02e-43ac-9c7c-603d5212b215 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:08.716948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9fd156d1-38dc-4250-b2f7-8b87de336b7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.089329 Oct 28 20:08:08.717588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 174/355] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:08 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:08.842384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-96f73b69-f02e-43ac-9c7c-603d5212b215 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:08.851196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-96f73b69-f02e-43ac-9c7c-603d5212b215 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:08.852653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-96f73b69-f02e-43ac-9c7c-603d5212b215 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:08.853848 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-96f73b69-f02e-43ac-9c7c-603d5212b215 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.159620 Oct 28 20:08:08.854410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 182/356] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:08 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:08:09.468093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f71b0f2f-d2dc-4591-9772-6f9fbd7622b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:09.468703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f71b0f2f-d2dc-4591-9772-6f9fbd7622b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:09.475059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f71b0f2f-d2dc-4591-9772-6f9fbd7622b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:09.475535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f71b0f2f-d2dc-4591-9772-6f9fbd7622b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:09.475962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f71b0f2f-d2dc-4591-9772-6f9fbd7622b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:09.476636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f71b0f2f-d2dc-4591-9772-6f9fbd7622b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:09.477082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f71b0f2f-d2dc-4591-9772-6f9fbd7622b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:09.477529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f71b0f2f-d2dc-4591-9772-6f9fbd7622b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:09.584617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f7c6e837-091f-44ad-9693-b7d157cd2ac4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:09.585618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f7c6e837-091f-44ad-9693-b7d157cd2ac4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:09.591942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c6e837-091f-44ad-9693-b7d157cd2ac4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:09.592427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c6e837-091f-44ad-9693-b7d157cd2ac4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:09.592891 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c6e837-091f-44ad-9693-b7d157cd2ac4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:09.593609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c6e837-091f-44ad-9693-b7d157cd2ac4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:09.594059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c6e837-091f-44ad-9693-b7d157cd2ac4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:09.595149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c6e837-091f-44ad-9693-b7d157cd2ac4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:09.608860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f71b0f2f-d2dc-4591-9772-6f9fbd7622b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:09.617354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f71b0f2f-d2dc-4591-9772-6f9fbd7622b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.153348 Oct 28 20:08:09.618112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 175/357] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:09 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:09.654617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f7c6e837-091f-44ad-9693-b7d157cd2ac4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:09.662613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f7c6e837-091f-44ad-9693-b7d157cd2ac4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.081852 Oct 28 20:08:09.663167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 183/358] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:09 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:09.740929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-28c2cbca-77f2-4ef5-9373-4d3019dbbf38 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:09.741501 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-28c2cbca-77f2-4ef5-9373-4d3019dbbf38 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:09.747337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28c2cbca-77f2-4ef5-9373-4d3019dbbf38 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:09.747820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28c2cbca-77f2-4ef5-9373-4d3019dbbf38 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:09.748258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28c2cbca-77f2-4ef5-9373-4d3019dbbf38 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:09.748944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28c2cbca-77f2-4ef5-9373-4d3019dbbf38 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:09.749433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28c2cbca-77f2-4ef5-9373-4d3019dbbf38 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:09.749859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28c2cbca-77f2-4ef5-9373-4d3019dbbf38 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:09.809348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-28c2cbca-77f2-4ef5-9373-4d3019dbbf38 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:09.818182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-28c2cbca-77f2-4ef5-9373-4d3019dbbf38 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.081105 Oct 28 20:08:09.819097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 176/359] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:09 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:09.878942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-23f68c90-d370-4c85-8812-c1e573cf8408 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:09.879602 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-23f68c90-d370-4c85-8812-c1e573cf8408 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:09.885438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23f68c90-d370-4c85-8812-c1e573cf8408 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:09.885927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23f68c90-d370-4c85-8812-c1e573cf8408 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:09.886370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23f68c90-d370-4c85-8812-c1e573cf8408 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:09.887088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23f68c90-d370-4c85-8812-c1e573cf8408 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:09.887543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23f68c90-d370-4c85-8812-c1e573cf8408 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:09.887968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23f68c90-d370-4c85-8812-c1e573cf8408 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:10.019903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-23f68c90-d370-4c85-8812-c1e573cf8408 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:10.027904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-23f68c90-d370-4c85-8812-c1e573cf8408 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:10.029362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-23f68c90-d370-4c85-8812-c1e573cf8408 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:10.030504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-23f68c90-d370-4c85-8812-c1e573cf8408 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.155544 Oct 28 20:08:10.031047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 184/360] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:09 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:10.640014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-28b7c9a6-c7cd-4b1e-84b1-4fb85af1dfb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:10.640631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-28b7c9a6-c7cd-4b1e-84b1-4fb85af1dfb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:10.647572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28b7c9a6-c7cd-4b1e-84b1-4fb85af1dfb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:10.648067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28b7c9a6-c7cd-4b1e-84b1-4fb85af1dfb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:10.648509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28b7c9a6-c7cd-4b1e-84b1-4fb85af1dfb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:10.649292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28b7c9a6-c7cd-4b1e-84b1-4fb85af1dfb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:10.649839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28b7c9a6-c7cd-4b1e-84b1-4fb85af1dfb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:10.650350 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28b7c9a6-c7cd-4b1e-84b1-4fb85af1dfb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:10.686047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dcb43f00-6e07-47c1-b6b4-4f941a08ec9a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:10.686666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dcb43f00-6e07-47c1-b6b4-4f941a08ec9a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:10.693183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcb43f00-6e07-47c1-b6b4-4f941a08ec9a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:10.693712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcb43f00-6e07-47c1-b6b4-4f941a08ec9a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:10.694160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcb43f00-6e07-47c1-b6b4-4f941a08ec9a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:10.694859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcb43f00-6e07-47c1-b6b4-4f941a08ec9a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:10.695325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcb43f00-6e07-47c1-b6b4-4f941a08ec9a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:10.695733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcb43f00-6e07-47c1-b6b4-4f941a08ec9a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:10.910963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dcb43f00-6e07-47c1-b6b4-4f941a08ec9a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:10.910963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dcb43f00-6e07-47c1-b6b4-4f941a08ec9a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.101539 Oct 28 20:08:10.910963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 185/361] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:10 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:10.911380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-28b7c9a6-c7cd-4b1e-84b1-4fb85af1dfb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:10.911380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-28b7c9a6-c7cd-4b1e-84b1-4fb85af1dfb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.176226 Oct 28 20:08:10.911380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 177/362] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:10 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:10.911664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b823d4ab-584c-4712-9f86-f36130326d68 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:10.911664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b823d4ab-584c-4712-9f86-f36130326d68 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:10.911664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b823d4ab-584c-4712-9f86-f36130326d68 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:10.911664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b823d4ab-584c-4712-9f86-f36130326d68 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:10.912134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b823d4ab-584c-4712-9f86-f36130326d68 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:10.912134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b823d4ab-584c-4712-9f86-f36130326d68 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:10.912134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b823d4ab-584c-4712-9f86-f36130326d68 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:10.912134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b823d4ab-584c-4712-9f86-f36130326d68 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:10.923713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b823d4ab-584c-4712-9f86-f36130326d68 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:10.932053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b823d4ab-584c-4712-9f86-f36130326d68 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.094154 Oct 28 20:08:10.932607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 186/363] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:10 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:11.056861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-95da4858-53df-406a-b57f-7378e294f7ed tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:11.057647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-95da4858-53df-406a-b57f-7378e294f7ed tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:11.063489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95da4858-53df-406a-b57f-7378e294f7ed tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:11.063965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95da4858-53df-406a-b57f-7378e294f7ed tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:11.064397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95da4858-53df-406a-b57f-7378e294f7ed tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:11.065070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95da4858-53df-406a-b57f-7378e294f7ed tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:11.065551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95da4858-53df-406a-b57f-7378e294f7ed tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:11.065973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95da4858-53df-406a-b57f-7378e294f7ed tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:11.195836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-95da4858-53df-406a-b57f-7378e294f7ed tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:11.203888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-95da4858-53df-406a-b57f-7378e294f7ed tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:11.205350 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-95da4858-53df-406a-b57f-7378e294f7ed tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:11.206489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-95da4858-53df-406a-b57f-7378e294f7ed tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.153591 Oct 28 20:08:11.207035 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 178/364] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:11 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:11.897430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d04af11c-4d56-4ae9-a771-03d143651f49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:11.898050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d04af11c-4d56-4ae9-a771-03d143651f49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:11.901453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-065be403-28cb-43fb-97b3-979157f8312e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:11.902072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-065be403-28cb-43fb-97b3-979157f8312e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:11.904432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04af11c-4d56-4ae9-a771-03d143651f49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:11.904922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04af11c-4d56-4ae9-a771-03d143651f49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:11.905379 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04af11c-4d56-4ae9-a771-03d143651f49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:11.906076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04af11c-4d56-4ae9-a771-03d143651f49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:11.906534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04af11c-4d56-4ae9-a771-03d143651f49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:11.907033 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04af11c-4d56-4ae9-a771-03d143651f49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:11.908354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-065be403-28cb-43fb-97b3-979157f8312e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:11.908834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-065be403-28cb-43fb-97b3-979157f8312e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:11.909272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-065be403-28cb-43fb-97b3-979157f8312e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:11.909987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-065be403-28cb-43fb-97b3-979157f8312e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:11.910442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-065be403-28cb-43fb-97b3-979157f8312e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:11.910866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-065be403-28cb-43fb-97b3-979157f8312e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:11.994864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d04af11c-4d56-4ae9-a771-03d143651f49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:12.002910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d04af11c-4d56-4ae9-a771-03d143651f49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.109358 Oct 28 20:08:12.003582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 187/365] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:11 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:12.008116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82180402-9bad-4190-a2ff-eeb5f62cfed3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:12.014305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-82180402-9bad-4190-a2ff-eeb5f62cfed3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:12.015195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82180402-9bad-4190-a2ff-eeb5f62cfed3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:12.015752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82180402-9bad-4190-a2ff-eeb5f62cfed3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:12.016837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82180402-9bad-4190-a2ff-eeb5f62cfed3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:12.017803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82180402-9bad-4190-a2ff-eeb5f62cfed3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:12.018330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82180402-9bad-4190-a2ff-eeb5f62cfed3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:12.018825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82180402-9bad-4190-a2ff-eeb5f62cfed3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:12.088624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-82180402-9bad-4190-a2ff-eeb5f62cfed3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:12.095888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-065be403-28cb-43fb-97b3-979157f8312e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:12.096196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-82180402-9bad-4190-a2ff-eeb5f62cfed3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.091581 Oct 28 20:08:12.096768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 188/366] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:12 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:12.103535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-065be403-28cb-43fb-97b3-979157f8312e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.205872 Oct 28 20:08:12.104087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 179/367] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:11 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:12.232175 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-73a5afc9-43d9-4220-8649-41b3f7291da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:12.232784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-73a5afc9-43d9-4220-8649-41b3f7291da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:12.239821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73a5afc9-43d9-4220-8649-41b3f7291da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:12.240315 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73a5afc9-43d9-4220-8649-41b3f7291da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:12.240748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73a5afc9-43d9-4220-8649-41b3f7291da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:12.241442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73a5afc9-43d9-4220-8649-41b3f7291da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:12.241932 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73a5afc9-43d9-4220-8649-41b3f7291da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:12.242352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73a5afc9-43d9-4220-8649-41b3f7291da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:12.376881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-73a5afc9-43d9-4220-8649-41b3f7291da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:12.385130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-73a5afc9-43d9-4220-8649-41b3f7291da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:12.386610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-73a5afc9-43d9-4220-8649-41b3f7291da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:12.387757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-73a5afc9-43d9-4220-8649-41b3f7291da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.159697 Oct 28 20:08:12.388303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 189/368] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:12 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:13.026045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e76893c9-ec06-4162-9573-0f97c9966982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:13.026727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e76893c9-ec06-4162-9573-0f97c9966982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:13.034264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e76893c9-ec06-4162-9573-0f97c9966982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:13.034680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e76893c9-ec06-4162-9573-0f97c9966982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:13.035129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e76893c9-ec06-4162-9573-0f97c9966982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:13.035894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e76893c9-ec06-4162-9573-0f97c9966982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:13.036359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e76893c9-ec06-4162-9573-0f97c9966982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:13.036793 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e76893c9-ec06-4162-9573-0f97c9966982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:13.096943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e76893c9-ec06-4162-9573-0f97c9966982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:13.104407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e76893c9-ec06-4162-9573-0f97c9966982 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.082093 Oct 28 20:08:13.104968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 180/369] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:13 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:13.118941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e18392b5-e8ba-466d-b071-b943663867e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:13.119674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e18392b5-e8ba-466d-b071-b943663867e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:13.126061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e18392b5-e8ba-466d-b071-b943663867e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:13.126301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d46c2e06-f5df-456d-a9f1-a87f14c33a0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:13.126539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e18392b5-e8ba-466d-b071-b943663867e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:13.126919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d46c2e06-f5df-456d-a9f1-a87f14c33a0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:13.127024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e18392b5-e8ba-466d-b071-b943663867e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:13.127636 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e18392b5-e8ba-466d-b071-b943663867e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:13.128114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e18392b5-e8ba-466d-b071-b943663867e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:13.128536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e18392b5-e8ba-466d-b071-b943663867e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:13.132649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d46c2e06-f5df-456d-a9f1-a87f14c33a0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:13.133128 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d46c2e06-f5df-456d-a9f1-a87f14c33a0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:13.133621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d46c2e06-f5df-456d-a9f1-a87f14c33a0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:13.134308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d46c2e06-f5df-456d-a9f1-a87f14c33a0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:13.134765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d46c2e06-f5df-456d-a9f1-a87f14c33a0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:13.135187 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d46c2e06-f5df-456d-a9f1-a87f14c33a0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:13.215405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e18392b5-e8ba-466d-b071-b943663867e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:13.223548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e18392b5-e8ba-466d-b071-b943663867e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.108357 Oct 28 20:08:13.224335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 190/370] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:13 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:13.282455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d46c2e06-f5df-456d-a9f1-a87f14c33a0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:13.290106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d46c2e06-f5df-456d-a9f1-a87f14c33a0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.167841 Oct 28 20:08:13.290671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 181/371] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:13 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:13.413016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-afed9503-f4b8-449c-95b5-5edb142da90c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:13.415900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-afed9503-f4b8-449c-95b5-5edb142da90c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:13.420140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afed9503-f4b8-449c-95b5-5edb142da90c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:13.420640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afed9503-f4b8-449c-95b5-5edb142da90c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:13.421082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afed9503-f4b8-449c-95b5-5edb142da90c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:13.421882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afed9503-f4b8-449c-95b5-5edb142da90c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:13.422454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afed9503-f4b8-449c-95b5-5edb142da90c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:13.423188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afed9503-f4b8-449c-95b5-5edb142da90c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:13.553503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-afed9503-f4b8-449c-95b5-5edb142da90c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:13.561652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-afed9503-f4b8-449c-95b5-5edb142da90c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:13.563636 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-afed9503-f4b8-449c-95b5-5edb142da90c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:13.565091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-afed9503-f4b8-449c-95b5-5edb142da90c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.155968 Oct 28 20:08:13.565685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 191/372] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:13 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:14.126843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a50d1dd8-2bf7-433a-998e-61fb31a8fdb2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:14.127443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a50d1dd8-2bf7-433a-998e-61fb31a8fdb2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:14.134079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a50d1dd8-2bf7-433a-998e-61fb31a8fdb2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:14.134557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a50d1dd8-2bf7-433a-998e-61fb31a8fdb2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:14.134987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a50d1dd8-2bf7-433a-998e-61fb31a8fdb2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:14.135660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a50d1dd8-2bf7-433a-998e-61fb31a8fdb2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:14.136108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a50d1dd8-2bf7-433a-998e-61fb31a8fdb2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:14.136534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a50d1dd8-2bf7-433a-998e-61fb31a8fdb2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:14.199844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a50d1dd8-2bf7-433a-998e-61fb31a8fdb2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:14.207362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a50d1dd8-2bf7-433a-998e-61fb31a8fdb2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.084413 Oct 28 20:08:14.207911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 182/373] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:14 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:14.247087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72459ec0-8f0d-4fd1-9a81-222e7984fca8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:14.247698 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-72459ec0-8f0d-4fd1-9a81-222e7984fca8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:14.254190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72459ec0-8f0d-4fd1-9a81-222e7984fca8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:14.254669 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72459ec0-8f0d-4fd1-9a81-222e7984fca8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:14.255103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72459ec0-8f0d-4fd1-9a81-222e7984fca8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:14.255787 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72459ec0-8f0d-4fd1-9a81-222e7984fca8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:14.256242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72459ec0-8f0d-4fd1-9a81-222e7984fca8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:14.256663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72459ec0-8f0d-4fd1-9a81-222e7984fca8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:14.318516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0acb8b3c-019c-454e-814d-6afde118e8aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:14.318756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-72459ec0-8f0d-4fd1-9a81-222e7984fca8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:14.319129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0acb8b3c-019c-454e-814d-6afde118e8aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:14.325193 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0acb8b3c-019c-454e-814d-6afde118e8aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:14.325715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0acb8b3c-019c-454e-814d-6afde118e8aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:14.326153 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0acb8b3c-019c-454e-814d-6afde118e8aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:14.326445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-72459ec0-8f0d-4fd1-9a81-222e7984fca8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.083141 Oct 28 20:08:14.326853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0acb8b3c-019c-454e-814d-6afde118e8aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:14.327265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 192/374] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:14 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:14.327386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0acb8b3c-019c-454e-814d-6afde118e8aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:14.327867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0acb8b3c-019c-454e-814d-6afde118e8aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:14.454088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0acb8b3c-019c-454e-814d-6afde118e8aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:14.461949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0acb8b3c-019c-454e-814d-6afde118e8aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.147302 Oct 28 20:08:14.462520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 183/375] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:14 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:14.591270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bd05e6d1-4c68-4581-b10e-b3d449504912 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:14.591818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bd05e6d1-4c68-4581-b10e-b3d449504912 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:14.598847 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd05e6d1-4c68-4581-b10e-b3d449504912 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:14.599338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd05e6d1-4c68-4581-b10e-b3d449504912 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:14.599783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd05e6d1-4c68-4581-b10e-b3d449504912 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:14.600478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd05e6d1-4c68-4581-b10e-b3d449504912 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:14.601066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd05e6d1-4c68-4581-b10e-b3d449504912 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:14.602016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd05e6d1-4c68-4581-b10e-b3d449504912 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:14.737070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bd05e6d1-4c68-4581-b10e-b3d449504912 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:14.740427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:14.745236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bd05e6d1-4c68-4581-b10e-b3d449504912 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:14.746722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bd05e6d1-4c68-4581-b10e-b3d449504912 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:14.747932 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bd05e6d1-4c68-4581-b10e-b3d449504912 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.160660 Oct 28 20:08:14.748486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 193/376] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:14 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:15.230281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-33e9b804-1ce0-467f-a481-21694a454f5d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:15.230952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-33e9b804-1ce0-467f-a481-21694a454f5d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:15.238280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33e9b804-1ce0-467f-a481-21694a454f5d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:15.238763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33e9b804-1ce0-467f-a481-21694a454f5d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:15.239195 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33e9b804-1ce0-467f-a481-21694a454f5d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:15.239876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33e9b804-1ce0-467f-a481-21694a454f5d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:15.240327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33e9b804-1ce0-467f-a481-21694a454f5d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:15.240747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33e9b804-1ce0-467f-a481-21694a454f5d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:15.301391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-33e9b804-1ce0-467f-a481-21694a454f5d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:15.309262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-33e9b804-1ce0-467f-a481-21694a454f5d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.082793 Oct 28 20:08:15.309920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 184/377] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:15 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:15.349188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4ab507f0-878a-4fb7-ab59-56b6174e8bab tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:15.349843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4ab507f0-878a-4fb7-ab59-56b6174e8bab tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:15.351955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:15.352617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=22 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:15.358435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ab507f0-878a-4fb7-ab59-56b6174e8bab tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:15.358926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ab507f0-878a-4fb7-ab59-56b6174e8bab tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:15.359366 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ab507f0-878a-4fb7-ab59-56b6174e8bab tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:15.360362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ab507f0-878a-4fb7-ab59-56b6174e8bab tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:15.360919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ab507f0-878a-4fb7-ab59-56b6174e8bab tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:15.361470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ab507f0-878a-4fb7-ab59-56b6174e8bab tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:15.422984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4ab507f0-878a-4fb7-ab59-56b6174e8bab tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:15.430607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4ab507f0-878a-4fb7-ab59-56b6174e8bab tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.085313 Oct 28 20:08:15.431181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 194/378] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:15 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:15.484787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f088894-4593-47f3-871e-7036332466e9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:15.485578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6f088894-4593-47f3-871e-7036332466e9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:15.487418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=10 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:15.492045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f088894-4593-47f3-871e-7036332466e9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:15.496259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f088894-4593-47f3-871e-7036332466e9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:15.496259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f088894-4593-47f3-871e-7036332466e9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:15.496259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f088894-4593-47f3-871e-7036332466e9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:15.496259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f088894-4593-47f3-871e-7036332466e9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:15.496616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f088894-4593-47f3-871e-7036332466e9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:15.628041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6f088894-4593-47f3-871e-7036332466e9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:15.635578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6f088894-4593-47f3-871e-7036332466e9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.154696 Oct 28 20:08:15.636139 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 185/379] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:15 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:15.773488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-112c5e64-5978-41a3-8409-211788ebbfbf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:15.774100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-112c5e64-5978-41a3-8409-211788ebbfbf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:15.780082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-112c5e64-5978-41a3-8409-211788ebbfbf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:15.780569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-112c5e64-5978-41a3-8409-211788ebbfbf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:15.781013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-112c5e64-5978-41a3-8409-211788ebbfbf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:15.781814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-112c5e64-5978-41a3-8409-211788ebbfbf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:15.782325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-112c5e64-5978-41a3-8409-211788ebbfbf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:15.782791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-112c5e64-5978-41a3-8409-211788ebbfbf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:15.911360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-112c5e64-5978-41a3-8409-211788ebbfbf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:15.919958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-112c5e64-5978-41a3-8409-211788ebbfbf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:15.921450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-112c5e64-5978-41a3-8409-211788ebbfbf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:15.922612 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-112c5e64-5978-41a3-8409-211788ebbfbf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.153209 Oct 28 20:08:15.923274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 195/380] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:15 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:16.332598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-985ff0d8-7d20-4c64-83de-0c628191762f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:16.333312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-985ff0d8-7d20-4c64-83de-0c628191762f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:16.340573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-985ff0d8-7d20-4c64-83de-0c628191762f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:16.341088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-985ff0d8-7d20-4c64-83de-0c628191762f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:16.341618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-985ff0d8-7d20-4c64-83de-0c628191762f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:16.342399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-985ff0d8-7d20-4c64-83de-0c628191762f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:16.342864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-985ff0d8-7d20-4c64-83de-0c628191762f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:16.343387 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-985ff0d8-7d20-4c64-83de-0c628191762f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:16.410009 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-985ff0d8-7d20-4c64-83de-0c628191762f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:16.418028 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-985ff0d8-7d20-4c64-83de-0c628191762f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.089859 Oct 28 20:08:16.429452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 186/381] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:16 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:16.453397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-08687e80-af53-4aff-8c6f-253bd696d0ef tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:16.454782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-08687e80-af53-4aff-8c6f-253bd696d0ef tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:16.461013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08687e80-af53-4aff-8c6f-253bd696d0ef tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:16.461539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08687e80-af53-4aff-8c6f-253bd696d0ef tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:16.461975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08687e80-af53-4aff-8c6f-253bd696d0ef tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:16.462655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08687e80-af53-4aff-8c6f-253bd696d0ef tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:16.463103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08687e80-af53-4aff-8c6f-253bd696d0ef tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:16.463521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08687e80-af53-4aff-8c6f-253bd696d0ef tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:16.523531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-08687e80-af53-4aff-8c6f-253bd696d0ef tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:16.531450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-08687e80-af53-4aff-8c6f-253bd696d0ef tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.082010 Oct 28 20:08:16.532802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 196/382] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:16 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:16.659165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2b968137-7a0a-4f5b-b18f-e37b914afb56 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:16.662725 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2b968137-7a0a-4f5b-b18f-e37b914afb56 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:16.666124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b968137-7a0a-4f5b-b18f-e37b914afb56 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:16.666689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b968137-7a0a-4f5b-b18f-e37b914afb56 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:16.667214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b968137-7a0a-4f5b-b18f-e37b914afb56 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:16.667979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b968137-7a0a-4f5b-b18f-e37b914afb56 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:16.668503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b968137-7a0a-4f5b-b18f-e37b914afb56 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:16.668995 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b968137-7a0a-4f5b-b18f-e37b914afb56 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:16.802257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2b968137-7a0a-4f5b-b18f-e37b914afb56 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:16.809822 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2b968137-7a0a-4f5b-b18f-e37b914afb56 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.154657 Oct 28 20:08:16.810380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 187/383] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:16 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:16.948126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-35fd57df-c79b-49fc-b4c2-49fee5b411b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:16.948736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-35fd57df-c79b-49fc-b4c2-49fee5b411b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:16.955119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35fd57df-c79b-49fc-b4c2-49fee5b411b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:16.955597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35fd57df-c79b-49fc-b4c2-49fee5b411b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:16.956026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35fd57df-c79b-49fc-b4c2-49fee5b411b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:16.956699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35fd57df-c79b-49fc-b4c2-49fee5b411b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:16.957147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35fd57df-c79b-49fc-b4c2-49fee5b411b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:16.957589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35fd57df-c79b-49fc-b4c2-49fee5b411b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:17.084439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-35fd57df-c79b-49fc-b4c2-49fee5b411b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:17.092705 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-35fd57df-c79b-49fc-b4c2-49fee5b411b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:17.094843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-35fd57df-c79b-49fc-b4c2-49fee5b411b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:17.096889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-35fd57df-c79b-49fc-b4c2-49fee5b411b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.152546 Oct 28 20:08:17.097931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 197/384] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:16 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:17.441751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-22256168-5a1b-4aeb-93d5-ff4611c2bad7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:17.442371 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22256168-5a1b-4aeb-93d5-ff4611c2bad7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:17.448617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22256168-5a1b-4aeb-93d5-ff4611c2bad7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:17.449095 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22256168-5a1b-4aeb-93d5-ff4611c2bad7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:17.449567 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22256168-5a1b-4aeb-93d5-ff4611c2bad7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:17.450250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22256168-5a1b-4aeb-93d5-ff4611c2bad7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:17.450701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22256168-5a1b-4aeb-93d5-ff4611c2bad7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:17.451126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22256168-5a1b-4aeb-93d5-ff4611c2bad7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:17.514641 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-22256168-5a1b-4aeb-93d5-ff4611c2bad7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:17.523368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-22256168-5a1b-4aeb-93d5-ff4611c2bad7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.086101 Oct 28 20:08:17.523942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 188/385] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:17 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:17.555415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-beca8193-6848-447b-ae1e-66311220cde8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:17.556034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-beca8193-6848-447b-ae1e-66311220cde8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:17.562367 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-beca8193-6848-447b-ae1e-66311220cde8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:17.563378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-beca8193-6848-447b-ae1e-66311220cde8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:17.564263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-beca8193-6848-447b-ae1e-66311220cde8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:17.564959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-beca8193-6848-447b-ae1e-66311220cde8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:17.565454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-beca8193-6848-447b-ae1e-66311220cde8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:17.565886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-beca8193-6848-447b-ae1e-66311220cde8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:17.626839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-beca8193-6848-447b-ae1e-66311220cde8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:17.634323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-beca8193-6848-447b-ae1e-66311220cde8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.082715 Oct 28 20:08:17.634883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 198/386] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:17 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:17.832322 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3477f32-5207-4903-8d28-0ee8aa7e443f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:17.832881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b3477f32-5207-4903-8d28-0ee8aa7e443f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:17.839059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3477f32-5207-4903-8d28-0ee8aa7e443f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:17.839539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3477f32-5207-4903-8d28-0ee8aa7e443f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:17.839969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3477f32-5207-4903-8d28-0ee8aa7e443f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:17.840647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3477f32-5207-4903-8d28-0ee8aa7e443f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:17.841094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3477f32-5207-4903-8d28-0ee8aa7e443f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:17.841550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3477f32-5207-4903-8d28-0ee8aa7e443f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:17.968424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b3477f32-5207-4903-8d28-0ee8aa7e443f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:17.976400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b3477f32-5207-4903-8d28-0ee8aa7e443f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.148669 Oct 28 20:08:17.977025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 189/387] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:17 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:18.122691 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ba96418-d22d-4543-92fb-1f75a99e097b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:18.123226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ba96418-d22d-4543-92fb-1f75a99e097b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:18.129801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba96418-d22d-4543-92fb-1f75a99e097b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:18.130257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba96418-d22d-4543-92fb-1f75a99e097b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:18.130750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba96418-d22d-4543-92fb-1f75a99e097b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:18.131427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba96418-d22d-4543-92fb-1f75a99e097b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:18.131872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba96418-d22d-4543-92fb-1f75a99e097b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:18.132290 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba96418-d22d-4543-92fb-1f75a99e097b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:18.264428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ba96418-d22d-4543-92fb-1f75a99e097b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:18.273526 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ba96418-d22d-4543-92fb-1f75a99e097b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:18.274973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ba96418-d22d-4543-92fb-1f75a99e097b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:18.276127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ba96418-d22d-4543-92fb-1f75a99e097b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.157403 Oct 28 20:08:18.276685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 199/388] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:18 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:18.545497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-33b224ec-b9a0-4d04-bfe2-a604e01f21d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:18.546110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-33b224ec-b9a0-4d04-bfe2-a604e01f21d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:18.553200 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b224ec-b9a0-4d04-bfe2-a604e01f21d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:18.553711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b224ec-b9a0-4d04-bfe2-a604e01f21d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:18.554145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b224ec-b9a0-4d04-bfe2-a604e01f21d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:18.554819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b224ec-b9a0-4d04-bfe2-a604e01f21d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:18.555269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b224ec-b9a0-4d04-bfe2-a604e01f21d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:18.555686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b224ec-b9a0-4d04-bfe2-a604e01f21d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:18.569991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:18.615824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-33b224ec-b9a0-4d04-bfe2-a604e01f21d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:18.623250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-33b224ec-b9a0-4d04-bfe2-a604e01f21d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.081589 Oct 28 20:08:18.623810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 190/389] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:18 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:18.658222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aba24ec3-782b-45dd-8965-339db4efa3c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:18.659461 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aba24ec3-782b-45dd-8965-339db4efa3c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:18.665858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba24ec3-782b-45dd-8965-339db4efa3c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:18.666345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba24ec3-782b-45dd-8965-339db4efa3c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:18.671358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba24ec3-782b-45dd-8965-339db4efa3c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:18.671358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba24ec3-782b-45dd-8965-339db4efa3c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:18.671358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba24ec3-782b-45dd-8965-339db4efa3c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:18.671358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba24ec3-782b-45dd-8965-339db4efa3c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:18.728226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-aba24ec3-782b-45dd-8965-339db4efa3c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:18.736878 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aba24ec3-782b-45dd-8965-339db4efa3c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.083403 Oct 28 20:08:18.737485 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 200/390] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:18 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:19.004541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a8c58d3-4f0f-4211-9bef-42c0b6beb3c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:19.005158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0a8c58d3-4f0f-4211-9bef-42c0b6beb3c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:19.011142 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a8c58d3-4f0f-4211-9bef-42c0b6beb3c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:19.011628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a8c58d3-4f0f-4211-9bef-42c0b6beb3c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:19.012068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a8c58d3-4f0f-4211-9bef-42c0b6beb3c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:19.012756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a8c58d3-4f0f-4211-9bef-42c0b6beb3c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:19.013211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a8c58d3-4f0f-4211-9bef-42c0b6beb3c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:19.013665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a8c58d3-4f0f-4211-9bef-42c0b6beb3c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:19.141546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a8c58d3-4f0f-4211-9bef-42c0b6beb3c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:19.149057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0a8c58d3-4f0f-4211-9bef-42c0b6beb3c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.149045 Oct 28 20:08:19.149651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 191/391] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:18 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:19.304355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4924efac-643b-43fb-8240-e36630ab5070 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:19.304965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4924efac-643b-43fb-8240-e36630ab5070 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:19.310839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4924efac-643b-43fb-8240-e36630ab5070 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:19.311319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4924efac-643b-43fb-8240-e36630ab5070 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:19.311754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4924efac-643b-43fb-8240-e36630ab5070 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:19.312442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4924efac-643b-43fb-8240-e36630ab5070 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:19.312894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4924efac-643b-43fb-8240-e36630ab5070 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:19.313508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4924efac-643b-43fb-8240-e36630ab5070 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:19.440988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4924efac-643b-43fb-8240-e36630ab5070 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:19.449027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4924efac-643b-43fb-8240-e36630ab5070 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:19.450509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4924efac-643b-43fb-8240-e36630ab5070 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:19.451652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4924efac-643b-43fb-8240-e36630ab5070 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.151233 Oct 28 20:08:19.452204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 201/392] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:19 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:19.645310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef63ae54-e1a7-4156-8338-ed7438c4a134 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:19.645897 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef63ae54-e1a7-4156-8338-ed7438c4a134 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:19.652177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef63ae54-e1a7-4156-8338-ed7438c4a134 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:19.652658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef63ae54-e1a7-4156-8338-ed7438c4a134 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:19.653087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef63ae54-e1a7-4156-8338-ed7438c4a134 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:19.653798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef63ae54-e1a7-4156-8338-ed7438c4a134 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:19.654265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef63ae54-e1a7-4156-8338-ed7438c4a134 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:19.654667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef63ae54-e1a7-4156-8338-ed7438c4a134 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:19.714638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ef63ae54-e1a7-4156-8338-ed7438c4a134 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:19.722307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ef63ae54-e1a7-4156-8338-ed7438c4a134 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.080877 Oct 28 20:08:19.722875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 192/393] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:19 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:19.759990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0c4e2252-3612-4e2e-b771-18c6f4cc47cb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:19.760661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0c4e2252-3612-4e2e-b771-18c6f4cc47cb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:19.767659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c4e2252-3612-4e2e-b771-18c6f4cc47cb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:19.768149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c4e2252-3612-4e2e-b771-18c6f4cc47cb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:19.768593 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c4e2252-3612-4e2e-b771-18c6f4cc47cb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:19.769284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c4e2252-3612-4e2e-b771-18c6f4cc47cb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:19.769767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c4e2252-3612-4e2e-b771-18c6f4cc47cb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:19.770259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c4e2252-3612-4e2e-b771-18c6f4cc47cb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:19.834486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0c4e2252-3612-4e2e-b771-18c6f4cc47cb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:19.842526 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0c4e2252-3612-4e2e-b771-18c6f4cc47cb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.086438 Oct 28 20:08:19.843078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 202/394] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:19 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:20.172730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7ae07130-de00-4a41-8a6b-13a845dcb7f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:20.173359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7ae07130-de00-4a41-8a6b-13a845dcb7f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:20.179301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ae07130-de00-4a41-8a6b-13a845dcb7f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:20.179786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ae07130-de00-4a41-8a6b-13a845dcb7f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:20.180482 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ae07130-de00-4a41-8a6b-13a845dcb7f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:20.181166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ae07130-de00-4a41-8a6b-13a845dcb7f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:20.181359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ae07130-de00-4a41-8a6b-13a845dcb7f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:20.181786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ae07130-de00-4a41-8a6b-13a845dcb7f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:20.310301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7ae07130-de00-4a41-8a6b-13a845dcb7f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:20.318396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7ae07130-de00-4a41-8a6b-13a845dcb7f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.149542 Oct 28 20:08:20.318958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 193/395] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:20 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:20.478093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5386d993-f040-46d3-9586-55184f8f8eb8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:20.478828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5386d993-f040-46d3-9586-55184f8f8eb8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:20.484633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5386d993-f040-46d3-9586-55184f8f8eb8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:20.485119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5386d993-f040-46d3-9586-55184f8f8eb8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:20.485604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5386d993-f040-46d3-9586-55184f8f8eb8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:20.486297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5386d993-f040-46d3-9586-55184f8f8eb8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:20.486755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5386d993-f040-46d3-9586-55184f8f8eb8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:20.487184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5386d993-f040-46d3-9586-55184f8f8eb8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:20.612428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5386d993-f040-46d3-9586-55184f8f8eb8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:20.620462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5386d993-f040-46d3-9586-55184f8f8eb8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:20.621954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5386d993-f040-46d3-9586-55184f8f8eb8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:20.623102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5386d993-f040-46d3-9586-55184f8f8eb8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.148930 Oct 28 20:08:20.623651 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 203/396] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:20 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:20.745022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eb4e09f1-a785-4a62-a2e3-b35c9827991d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:20.745709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eb4e09f1-a785-4a62-a2e3-b35c9827991d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:20.752507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb4e09f1-a785-4a62-a2e3-b35c9827991d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:20.752986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb4e09f1-a785-4a62-a2e3-b35c9827991d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:20.753457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb4e09f1-a785-4a62-a2e3-b35c9827991d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:20.754133 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb4e09f1-a785-4a62-a2e3-b35c9827991d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:20.754582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb4e09f1-a785-4a62-a2e3-b35c9827991d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:20.755002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb4e09f1-a785-4a62-a2e3-b35c9827991d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:20.818487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-eb4e09f1-a785-4a62-a2e3-b35c9827991d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:20.825958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eb4e09f1-a785-4a62-a2e3-b35c9827991d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.084728 Oct 28 20:08:20.826523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 194/397] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:20 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:20.866963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c23dd1f5-ee48-4e07-9cf7-643244c2fad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:20.867579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c23dd1f5-ee48-4e07-9cf7-643244c2fad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:20.873931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c23dd1f5-ee48-4e07-9cf7-643244c2fad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:20.874412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c23dd1f5-ee48-4e07-9cf7-643244c2fad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:20.874853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c23dd1f5-ee48-4e07-9cf7-643244c2fad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:20.875534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c23dd1f5-ee48-4e07-9cf7-643244c2fad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:20.876551 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c23dd1f5-ee48-4e07-9cf7-643244c2fad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:20.877129 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c23dd1f5-ee48-4e07-9cf7-643244c2fad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:20.936478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c23dd1f5-ee48-4e07-9cf7-643244c2fad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:20.945781 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c23dd1f5-ee48-4e07-9cf7-643244c2fad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.082532 Oct 28 20:08:20.946360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 204/398] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:20 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:21.341930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d32662f2-de54-4fef-bc84-c2b700347b6b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:21.342647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d32662f2-de54-4fef-bc84-c2b700347b6b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:21.349427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d32662f2-de54-4fef-bc84-c2b700347b6b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:21.349919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d32662f2-de54-4fef-bc84-c2b700347b6b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:21.350361 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d32662f2-de54-4fef-bc84-c2b700347b6b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:21.351049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d32662f2-de54-4fef-bc84-c2b700347b6b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:21.351511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d32662f2-de54-4fef-bc84-c2b700347b6b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:21.351938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d32662f2-de54-4fef-bc84-c2b700347b6b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:21.478042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d32662f2-de54-4fef-bc84-c2b700347b6b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:21.486235 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d32662f2-de54-4fef-bc84-c2b700347b6b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.147345 Oct 28 20:08:21.486909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 195/399] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:21 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:21.650964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8eec3c3f-01bf-420c-8488-e796e5abdee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:21.651525 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8eec3c3f-01bf-420c-8488-e796e5abdee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:21.653339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:21.658060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8eec3c3f-01bf-420c-8488-e796e5abdee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:21.658540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8eec3c3f-01bf-420c-8488-e796e5abdee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:21.658974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8eec3c3f-01bf-420c-8488-e796e5abdee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:21.659659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8eec3c3f-01bf-420c-8488-e796e5abdee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:21.660112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8eec3c3f-01bf-420c-8488-e796e5abdee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:21.660533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8eec3c3f-01bf-420c-8488-e796e5abdee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:21.791344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8eec3c3f-01bf-420c-8488-e796e5abdee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:21.799962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8eec3c3f-01bf-420c-8488-e796e5abdee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:21.801437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8eec3c3f-01bf-420c-8488-e796e5abdee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:21.802595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8eec3c3f-01bf-420c-8488-e796e5abdee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.155608 Oct 28 20:08:21.803150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 205/400] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:21 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:21.849261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3ac051e3-f705-41be-a1d5-fe6da8e9c21f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:21.849893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3ac051e3-f705-41be-a1d5-fe6da8e9c21f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:21.856120 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ac051e3-f705-41be-a1d5-fe6da8e9c21f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:21.856609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ac051e3-f705-41be-a1d5-fe6da8e9c21f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:21.857046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ac051e3-f705-41be-a1d5-fe6da8e9c21f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:21.857772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ac051e3-f705-41be-a1d5-fe6da8e9c21f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:21.858228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ac051e3-f705-41be-a1d5-fe6da8e9c21f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:21.858652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ac051e3-f705-41be-a1d5-fe6da8e9c21f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:21.919122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3ac051e3-f705-41be-a1d5-fe6da8e9c21f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:21.927077 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3ac051e3-f705-41be-a1d5-fe6da8e9c21f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.081720 Oct 28 20:08:21.927637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 196/401] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:21 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:21.968313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0e3e977-9d5d-4412-889d-73146fab198e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:21.968934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0e3e977-9d5d-4412-889d-73146fab198e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:21.975982 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e3e977-9d5d-4412-889d-73146fab198e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:21.976468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e3e977-9d5d-4412-889d-73146fab198e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:21.976907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e3e977-9d5d-4412-889d-73146fab198e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:21.977626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e3e977-9d5d-4412-889d-73146fab198e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:21.978088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e3e977-9d5d-4412-889d-73146fab198e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:21.978516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e3e977-9d5d-4412-889d-73146fab198e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:22.041036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0e3e977-9d5d-4412-889d-73146fab198e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:22.048982 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0e3e977-9d5d-4412-889d-73146fab198e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.084506 Oct 28 20:08:22.049672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 206/402] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:21 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:22.509467 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d2a81839-8c5d-445f-8d15-bf6ee1527869 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:22.510082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d2a81839-8c5d-445f-8d15-bf6ee1527869 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:22.516006 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2a81839-8c5d-445f-8d15-bf6ee1527869 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:22.516623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2a81839-8c5d-445f-8d15-bf6ee1527869 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:22.517080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2a81839-8c5d-445f-8d15-bf6ee1527869 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:22.517783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2a81839-8c5d-445f-8d15-bf6ee1527869 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:22.518240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2a81839-8c5d-445f-8d15-bf6ee1527869 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:22.518664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2a81839-8c5d-445f-8d15-bf6ee1527869 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:22.648556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d2a81839-8c5d-445f-8d15-bf6ee1527869 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:22.656112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d2a81839-8c5d-445f-8d15-bf6ee1527869 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.150515 Oct 28 20:08:22.656684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 197/403] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:22 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:22.828818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7c717325-f688-43b9-bcb3-4e734858136f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:22.829476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7c717325-f688-43b9-bcb3-4e734858136f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:22.835744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c717325-f688-43b9-bcb3-4e734858136f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:22.836239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c717325-f688-43b9-bcb3-4e734858136f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:22.836679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c717325-f688-43b9-bcb3-4e734858136f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:22.837392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c717325-f688-43b9-bcb3-4e734858136f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:22.840609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c717325-f688-43b9-bcb3-4e734858136f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:22.840609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c717325-f688-43b9-bcb3-4e734858136f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:22.949926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-10e07f83-f7ad-4ab2-a1e3-02d48d24c1f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:22.950541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-10e07f83-f7ad-4ab2-a1e3-02d48d24c1f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:22.957092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10e07f83-f7ad-4ab2-a1e3-02d48d24c1f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:22.957614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10e07f83-f7ad-4ab2-a1e3-02d48d24c1f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:22.958057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10e07f83-f7ad-4ab2-a1e3-02d48d24c1f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:22.958755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10e07f83-f7ad-4ab2-a1e3-02d48d24c1f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:22.959213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10e07f83-f7ad-4ab2-a1e3-02d48d24c1f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:22.959642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10e07f83-f7ad-4ab2-a1e3-02d48d24c1f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:22.966853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7c717325-f688-43b9-bcb3-4e734858136f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:22.976286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7c717325-f688-43b9-bcb3-4e734858136f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:22.977772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7c717325-f688-43b9-bcb3-4e734858136f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:22.978921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7c717325-f688-43b9-bcb3-4e734858136f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.154140 Oct 28 20:08:22.979464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 207/404] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:22 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:23.020806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-10e07f83-f7ad-4ab2-a1e3-02d48d24c1f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:23.028442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-10e07f83-f7ad-4ab2-a1e3-02d48d24c1f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.082380 Oct 28 20:08:23.029004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 198/405] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:22 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:23.071619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-30c870aa-8380-4f7e-a904-65c5e2dd6a46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:23.072314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-30c870aa-8380-4f7e-a904-65c5e2dd6a46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:23.078268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30c870aa-8380-4f7e-a904-65c5e2dd6a46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:23.079547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30c870aa-8380-4f7e-a904-65c5e2dd6a46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:23.080046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30c870aa-8380-4f7e-a904-65c5e2dd6a46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:23.080945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30c870aa-8380-4f7e-a904-65c5e2dd6a46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:23.081516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30c870aa-8380-4f7e-a904-65c5e2dd6a46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:23.082014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30c870aa-8380-4f7e-a904-65c5e2dd6a46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:23.143792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-30c870aa-8380-4f7e-a904-65c5e2dd6a46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:23.151429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-30c870aa-8380-4f7e-a904-65c5e2dd6a46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.083584 Oct 28 20:08:23.151988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 208/406] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:23 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:23.679693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7ef90e05-4430-4f39-8b6b-62191232ec34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:23.680305 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7ef90e05-4430-4f39-8b6b-62191232ec34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:23.686300 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ef90e05-4430-4f39-8b6b-62191232ec34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:23.686777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ef90e05-4430-4f39-8b6b-62191232ec34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:23.687212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ef90e05-4430-4f39-8b6b-62191232ec34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:23.687895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ef90e05-4430-4f39-8b6b-62191232ec34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:23.688428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ef90e05-4430-4f39-8b6b-62191232ec34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:23.688892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ef90e05-4430-4f39-8b6b-62191232ec34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:23.820453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7ef90e05-4430-4f39-8b6b-62191232ec34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:23.828017 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7ef90e05-4430-4f39-8b6b-62191232ec34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.152155 Oct 28 20:08:23.828614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 199/407] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:23 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:24.004131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e67f0a39-f445-41a8-b306-24b3783bd5ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:24.004739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e67f0a39-f445-41a8-b306-24b3783bd5ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:24.011135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67f0a39-f445-41a8-b306-24b3783bd5ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:24.011613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67f0a39-f445-41a8-b306-24b3783bd5ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:24.012046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67f0a39-f445-41a8-b306-24b3783bd5ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:24.012736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67f0a39-f445-41a8-b306-24b3783bd5ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:24.013186 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67f0a39-f445-41a8-b306-24b3783bd5ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:24.013641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67f0a39-f445-41a8-b306-24b3783bd5ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:24.052277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-da6fe95e-0bbe-4314-86ad-9961174033de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:24.052893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-da6fe95e-0bbe-4314-86ad-9961174033de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:24.054819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:24.059587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da6fe95e-0bbe-4314-86ad-9961174033de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:24.060082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da6fe95e-0bbe-4314-86ad-9961174033de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:24.060523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da6fe95e-0bbe-4314-86ad-9961174033de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:24.061222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da6fe95e-0bbe-4314-86ad-9961174033de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:24.061714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da6fe95e-0bbe-4314-86ad-9961174033de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:24.062144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da6fe95e-0bbe-4314-86ad-9961174033de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:24.137015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-da6fe95e-0bbe-4314-86ad-9961174033de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:24.145438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-da6fe95e-0bbe-4314-86ad-9961174033de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.097897 Oct 28 20:08:24.146050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 200/408] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:24 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:24.173162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e67f0a39-f445-41a8-b306-24b3783bd5ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:24.174941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dd7457f6-f7eb-4141-a930-56328b1d0b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:24.175559 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dd7457f6-f7eb-4141-a930-56328b1d0b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:24.181473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd7457f6-f7eb-4141-a930-56328b1d0b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:24.181957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd7457f6-f7eb-4141-a930-56328b1d0b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:24.182387 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd7457f6-f7eb-4141-a930-56328b1d0b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:24.183101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd7457f6-f7eb-4141-a930-56328b1d0b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:24.183547 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd7457f6-f7eb-4141-a930-56328b1d0b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:24.183663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e67f0a39-f445-41a8-b306-24b3783bd5ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:24.183962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd7457f6-f7eb-4141-a930-56328b1d0b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:24.185274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e67f0a39-f445-41a8-b306-24b3783bd5ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:24.186558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e67f0a39-f445-41a8-b306-24b3783bd5ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.186545 Oct 28 20:08:24.187320 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 209/409] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:23 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:24.249001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-dd7457f6-f7eb-4141-a930-56328b1d0b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:24.256454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dd7457f6-f7eb-4141-a930-56328b1d0b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.086114 Oct 28 20:08:24.257013 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 201/410] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:24 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:24.852197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cc109ffe-07d0-4538-a233-8a1e5b56c249 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:24.852835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cc109ffe-07d0-4538-a233-8a1e5b56c249 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:24.858768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc109ffe-07d0-4538-a233-8a1e5b56c249 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:24.859253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc109ffe-07d0-4538-a233-8a1e5b56c249 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:24.859694 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc109ffe-07d0-4538-a233-8a1e5b56c249 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:24.860901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc109ffe-07d0-4538-a233-8a1e5b56c249 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:24.861399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc109ffe-07d0-4538-a233-8a1e5b56c249 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:24.861831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc109ffe-07d0-4538-a233-8a1e5b56c249 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:24.880615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:24.988979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cc109ffe-07d0-4538-a233-8a1e5b56c249 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:24.996432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cc109ffe-07d0-4538-a233-8a1e5b56c249 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.148178 Oct 28 20:08:24.996997 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 210/411] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:24 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:25.167949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d3bbaf09-a75d-4aac-a66a-2f9c99ab7d69 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:25.168499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d3bbaf09-a75d-4aac-a66a-2f9c99ab7d69 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:25.175029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3bbaf09-a75d-4aac-a66a-2f9c99ab7d69 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:25.175509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3bbaf09-a75d-4aac-a66a-2f9c99ab7d69 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:25.175948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3bbaf09-a75d-4aac-a66a-2f9c99ab7d69 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:25.176632 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3bbaf09-a75d-4aac-a66a-2f9c99ab7d69 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:25.177087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3bbaf09-a75d-4aac-a66a-2f9c99ab7d69 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:25.177537 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3bbaf09-a75d-4aac-a66a-2f9c99ab7d69 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:25.213752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-16e0ef6f-e176-4e81-ab09-05d4f62d64f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:25.214371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-16e0ef6f-e176-4e81-ab09-05d4f62d64f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:25.221720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16e0ef6f-e176-4e81-ab09-05d4f62d64f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:25.222219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16e0ef6f-e176-4e81-ab09-05d4f62d64f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:25.222745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16e0ef6f-e176-4e81-ab09-05d4f62d64f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:25.223353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16e0ef6f-e176-4e81-ab09-05d4f62d64f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:25.223879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16e0ef6f-e176-4e81-ab09-05d4f62d64f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:25.224210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16e0ef6f-e176-4e81-ab09-05d4f62d64f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:25.241211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d3bbaf09-a75d-4aac-a66a-2f9c99ab7d69 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:25.249036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d3bbaf09-a75d-4aac-a66a-2f9c99ab7d69 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.084900 Oct 28 20:08:25.249791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 202/412] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:25 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:25.278600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e0111077-85c0-44da-9714-ac34a92fb386 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:25.279220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e0111077-85c0-44da-9714-ac34a92fb386 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:25.285282 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0111077-85c0-44da-9714-ac34a92fb386 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:25.285799 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0111077-85c0-44da-9714-ac34a92fb386 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:25.286238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0111077-85c0-44da-9714-ac34a92fb386 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:25.287001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0111077-85c0-44da-9714-ac34a92fb386 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:25.287459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0111077-85c0-44da-9714-ac34a92fb386 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:25.287883 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0111077-85c0-44da-9714-ac34a92fb386 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:25.365888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e0111077-85c0-44da-9714-ac34a92fb386 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:25.374029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e0111077-85c0-44da-9714-ac34a92fb386 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.099181 Oct 28 20:08:25.374606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 203/413] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:25 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:25.400253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-16e0ef6f-e176-4e81-ab09-05d4f62d64f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:25.408874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-16e0ef6f-e176-4e81-ab09-05d4f62d64f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:25.410352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-16e0ef6f-e176-4e81-ab09-05d4f62d64f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:25.411509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-16e0ef6f-e176-4e81-ab09-05d4f62d64f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.201968 Oct 28 20:08:25.412059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 211/414] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:25 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:08:26.019649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-920288e2-28a1-4c8d-bfc2-67e2c21d0de3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:26.020266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-920288e2-28a1-4c8d-bfc2-67e2c21d0de3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:26.026457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-920288e2-28a1-4c8d-bfc2-67e2c21d0de3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:26.026941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-920288e2-28a1-4c8d-bfc2-67e2c21d0de3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:26.027376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-920288e2-28a1-4c8d-bfc2-67e2c21d0de3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:26.028058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-920288e2-28a1-4c8d-bfc2-67e2c21d0de3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:26.028508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-920288e2-28a1-4c8d-bfc2-67e2c21d0de3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:26.028925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-920288e2-28a1-4c8d-bfc2-67e2c21d0de3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:26.160289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-920288e2-28a1-4c8d-bfc2-67e2c21d0de3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:26.167784 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-920288e2-28a1-4c8d-bfc2-67e2c21d0de3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.152029 Oct 28 20:08:26.168350 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 204/415] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:26 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:26.272377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5411a808-7363-484d-b8f1-80ea060bd2d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:26.272951 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5411a808-7363-484d-b8f1-80ea060bd2d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:26.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5411a808-7363-484d-b8f1-80ea060bd2d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:26.280011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5411a808-7363-484d-b8f1-80ea060bd2d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:26.280450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5411a808-7363-484d-b8f1-80ea060bd2d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:26.281178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5411a808-7363-484d-b8f1-80ea060bd2d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:26.281752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5411a808-7363-484d-b8f1-80ea060bd2d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:26.282339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5411a808-7363-484d-b8f1-80ea060bd2d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:26.354878 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5411a808-7363-484d-b8f1-80ea060bd2d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:26.361940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5411a808-7363-484d-b8f1-80ea060bd2d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.093471 Oct 28 20:08:26.362512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 212/416] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:26 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:26.397527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a26dc015-4eec-4033-9d13-500feb421d7f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:26.398135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a26dc015-4eec-4033-9d13-500feb421d7f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:26.404555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a26dc015-4eec-4033-9d13-500feb421d7f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:26.405039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a26dc015-4eec-4033-9d13-500feb421d7f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:26.405542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a26dc015-4eec-4033-9d13-500feb421d7f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:26.406227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a26dc015-4eec-4033-9d13-500feb421d7f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:26.406680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a26dc015-4eec-4033-9d13-500feb421d7f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:26.407752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a26dc015-4eec-4033-9d13-500feb421d7f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:26.438007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-611b20f8-134b-4716-a35e-176175402a02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:26.439236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-611b20f8-134b-4716-a35e-176175402a02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:26.445064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-611b20f8-134b-4716-a35e-176175402a02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:26.445573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-611b20f8-134b-4716-a35e-176175402a02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:26.446008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-611b20f8-134b-4716-a35e-176175402a02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:26.446694 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-611b20f8-134b-4716-a35e-176175402a02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:26.447140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-611b20f8-134b-4716-a35e-176175402a02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:26.447559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-611b20f8-134b-4716-a35e-176175402a02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:26.468123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a26dc015-4eec-4033-9d13-500feb421d7f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:26.476180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a26dc015-4eec-4033-9d13-500feb421d7f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.082443 Oct 28 20:08:26.476750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 205/417] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:26 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:26.574628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-611b20f8-134b-4716-a35e-176175402a02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:26.582695 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-611b20f8-134b-4716-a35e-176175402a02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:26.584127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-611b20f8-134b-4716-a35e-176175402a02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:26.585269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-611b20f8-134b-4716-a35e-176175402a02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.151085 Oct 28 20:08:26.586110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 213/418] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:26 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:08:27.191964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6feb02c9-3708-4a75-8fc5-dd15a9d03946 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:27.192603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6feb02c9-3708-4a75-8fc5-dd15a9d03946 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:27.198533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6feb02c9-3708-4a75-8fc5-dd15a9d03946 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:27.199015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6feb02c9-3708-4a75-8fc5-dd15a9d03946 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:27.199451 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6feb02c9-3708-4a75-8fc5-dd15a9d03946 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:27.200132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6feb02c9-3708-4a75-8fc5-dd15a9d03946 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:27.200685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6feb02c9-3708-4a75-8fc5-dd15a9d03946 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:27.201113 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6feb02c9-3708-4a75-8fc5-dd15a9d03946 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:27.332144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6feb02c9-3708-4a75-8fc5-dd15a9d03946 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:27.340198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6feb02c9-3708-4a75-8fc5-dd15a9d03946 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.152899 Oct 28 20:08:27.340767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 206/419] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:27 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:27.383815 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-787d012a-b49a-4182-96ec-b7e8e459d355 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:27.384484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-787d012a-b49a-4182-96ec-b7e8e459d355 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:27.390860 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-787d012a-b49a-4182-96ec-b7e8e459d355 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:27.391346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-787d012a-b49a-4182-96ec-b7e8e459d355 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:27.391786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-787d012a-b49a-4182-96ec-b7e8e459d355 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:27.392475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-787d012a-b49a-4182-96ec-b7e8e459d355 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:27.392929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-787d012a-b49a-4182-96ec-b7e8e459d355 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:27.393373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-787d012a-b49a-4182-96ec-b7e8e459d355 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:27.453745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-787d012a-b49a-4182-96ec-b7e8e459d355 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:27.461656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-787d012a-b49a-4182-96ec-b7e8e459d355 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.081393 Oct 28 20:08:27.462213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 214/420] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:27 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:27.499014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4692a18f-05fd-4727-a788-4b93aadb6c07 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:27.499624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4692a18f-05fd-4727-a788-4b93aadb6c07 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:27.506580 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4692a18f-05fd-4727-a788-4b93aadb6c07 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:27.507059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4692a18f-05fd-4727-a788-4b93aadb6c07 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:27.507497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4692a18f-05fd-4727-a788-4b93aadb6c07 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:27.508180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4692a18f-05fd-4727-a788-4b93aadb6c07 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:27.508633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4692a18f-05fd-4727-a788-4b93aadb6c07 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:27.509058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4692a18f-05fd-4727-a788-4b93aadb6c07 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:27.511589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:27.569220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4692a18f-05fd-4727-a788-4b93aadb6c07 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:27.576652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4692a18f-05fd-4727-a788-4b93aadb6c07 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.081420 Oct 28 20:08:27.577217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 207/421] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:27 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:27.611701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dcbc894c-7956-442e-b097-b0e151ea7aac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:27.612248 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dcbc894c-7956-442e-b097-b0e151ea7aac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:27.618113 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcbc894c-7956-442e-b097-b0e151ea7aac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:27.618599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcbc894c-7956-442e-b097-b0e151ea7aac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:27.619036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcbc894c-7956-442e-b097-b0e151ea7aac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:27.619732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcbc894c-7956-442e-b097-b0e151ea7aac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:27.620194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcbc894c-7956-442e-b097-b0e151ea7aac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:27.620618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcbc894c-7956-442e-b097-b0e151ea7aac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:27.749874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dcbc894c-7956-442e-b097-b0e151ea7aac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:27.758446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dcbc894c-7956-442e-b097-b0e151ea7aac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:27.760859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dcbc894c-7956-442e-b097-b0e151ea7aac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:27.761014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dcbc894c-7956-442e-b097-b0e151ea7aac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.154199 Oct 28 20:08:27.761552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 215/422] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:27 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:28.364487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2b6f8755-5d3e-4d0e-a973-b4200e8d88c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:28.365051 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2b6f8755-5d3e-4d0e-a973-b4200e8d88c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:28.370934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b6f8755-5d3e-4d0e-a973-b4200e8d88c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:28.371420 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b6f8755-5d3e-4d0e-a973-b4200e8d88c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:28.371857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b6f8755-5d3e-4d0e-a973-b4200e8d88c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:28.372550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b6f8755-5d3e-4d0e-a973-b4200e8d88c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:28.373008 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b6f8755-5d3e-4d0e-a973-b4200e8d88c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:28.373464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b6f8755-5d3e-4d0e-a973-b4200e8d88c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:28.483941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4111e60c-765c-4f6e-a852-4a17962c9d06 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:28.484554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4111e60c-765c-4f6e-a852-4a17962c9d06 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:28.491730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4111e60c-765c-4f6e-a852-4a17962c9d06 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:28.492214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4111e60c-765c-4f6e-a852-4a17962c9d06 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:28.492908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4111e60c-765c-4f6e-a852-4a17962c9d06 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:28.493689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4111e60c-765c-4f6e-a852-4a17962c9d06 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:28.494146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4111e60c-765c-4f6e-a852-4a17962c9d06 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:28.494651 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4111e60c-765c-4f6e-a852-4a17962c9d06 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:28.502266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2b6f8755-5d3e-4d0e-a973-b4200e8d88c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:28.510179 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2b6f8755-5d3e-4d0e-a973-b4200e8d88c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.150283 Oct 28 20:08:28.510930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 208/423] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:28 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:28.558397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4111e60c-765c-4f6e-a852-4a17962c9d06 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:28.566399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4111e60c-765c-4f6e-a852-4a17962c9d06 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.086289 Oct 28 20:08:28.566957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 216/424] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:28 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:28.600632 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-349fdf70-e6d2-4302-bed2-3c350a624df7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:28.601260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-349fdf70-e6d2-4302-bed2-3c350a624df7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:28.607123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-349fdf70-e6d2-4302-bed2-3c350a624df7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:28.607603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-349fdf70-e6d2-4302-bed2-3c350a624df7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:28.608037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-349fdf70-e6d2-4302-bed2-3c350a624df7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:28.608719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-349fdf70-e6d2-4302-bed2-3c350a624df7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:28.609173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-349fdf70-e6d2-4302-bed2-3c350a624df7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:28.609622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-349fdf70-e6d2-4302-bed2-3c350a624df7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:28.668840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-349fdf70-e6d2-4302-bed2-3c350a624df7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:28.677064 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-349fdf70-e6d2-4302-bed2-3c350a624df7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.080272 Oct 28 20:08:28.677650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 209/425] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:28 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:28.786373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d80cc2ba-80fc-4325-ac0a-23a20e1e3b09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:28.786975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d80cc2ba-80fc-4325-ac0a-23a20e1e3b09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:28.792751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d80cc2ba-80fc-4325-ac0a-23a20e1e3b09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:28.793224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d80cc2ba-80fc-4325-ac0a-23a20e1e3b09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:28.793685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d80cc2ba-80fc-4325-ac0a-23a20e1e3b09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:28.794363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d80cc2ba-80fc-4325-ac0a-23a20e1e3b09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:28.794807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d80cc2ba-80fc-4325-ac0a-23a20e1e3b09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:28.795270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d80cc2ba-80fc-4325-ac0a-23a20e1e3b09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:28.926756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d80cc2ba-80fc-4325-ac0a-23a20e1e3b09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:28.934802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d80cc2ba-80fc-4325-ac0a-23a20e1e3b09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:28.936248 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d80cc2ba-80fc-4325-ac0a-23a20e1e3b09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:28.937437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d80cc2ba-80fc-4325-ac0a-23a20e1e3b09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.154928 Oct 28 20:08:28.937986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 217/426] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:28 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:29.533797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c658097e-7f37-4424-b650-90bff415eff7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:29.534409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c658097e-7f37-4424-b650-90bff415eff7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:29.540779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c658097e-7f37-4424-b650-90bff415eff7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:29.541263 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c658097e-7f37-4424-b650-90bff415eff7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:29.541740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c658097e-7f37-4424-b650-90bff415eff7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:29.542428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c658097e-7f37-4424-b650-90bff415eff7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:29.542882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c658097e-7f37-4424-b650-90bff415eff7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:29.543306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c658097e-7f37-4424-b650-90bff415eff7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:29.588844 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-79e552f9-48b3-422a-b2b4-971b345fa7f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:29.590009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-79e552f9-48b3-422a-b2b4-971b345fa7f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:29.596424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79e552f9-48b3-422a-b2b4-971b345fa7f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:29.596919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79e552f9-48b3-422a-b2b4-971b345fa7f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:29.597394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79e552f9-48b3-422a-b2b4-971b345fa7f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:29.598103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79e552f9-48b3-422a-b2b4-971b345fa7f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:29.598558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79e552f9-48b3-422a-b2b4-971b345fa7f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:29.599187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79e552f9-48b3-422a-b2b4-971b345fa7f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:29.673272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-79e552f9-48b3-422a-b2b4-971b345fa7f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:29.680611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-79e552f9-48b3-422a-b2b4-971b345fa7f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.095871 Oct 28 20:08:29.681170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 218/427] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:29 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:29.696629 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c658097e-7f37-4424-b650-90bff415eff7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:29.698737 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc415951-6c3c-4cd4-a100-b872ec9553e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:29.699341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bc415951-6c3c-4cd4-a100-b872ec9553e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:29.705660 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc415951-6c3c-4cd4-a100-b872ec9553e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:29.706065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c658097e-7f37-4424-b650-90bff415eff7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.176304 Oct 28 20:08:29.706169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc415951-6c3c-4cd4-a100-b872ec9553e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:29.706547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc415951-6c3c-4cd4-a100-b872ec9553e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:29.706638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 210/428] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:29 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:29.707236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc415951-6c3c-4cd4-a100-b872ec9553e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:29.707685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc415951-6c3c-4cd4-a100-b872ec9553e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:29.708102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc415951-6c3c-4cd4-a100-b872ec9553e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:29.771246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bc415951-6c3c-4cd4-a100-b872ec9553e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:29.778625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bc415951-6c3c-4cd4-a100-b872ec9553e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.083726 Oct 28 20:08:29.779170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 219/429] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:29 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:29.964129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b04f0963-49cd-4572-8a37-f4a6ce8517ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:29.964761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b04f0963-49cd-4572-8a37-f4a6ce8517ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:29.970519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b04f0963-49cd-4572-8a37-f4a6ce8517ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:29.971059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b04f0963-49cd-4572-8a37-f4a6ce8517ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:29.971405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b04f0963-49cd-4572-8a37-f4a6ce8517ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:29.972085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b04f0963-49cd-4572-8a37-f4a6ce8517ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:29.972602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b04f0963-49cd-4572-8a37-f4a6ce8517ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:29.973022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b04f0963-49cd-4572-8a37-f4a6ce8517ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:30.106693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b04f0963-49cd-4572-8a37-f4a6ce8517ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:30.115756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b04f0963-49cd-4572-8a37-f4a6ce8517ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:30.117244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b04f0963-49cd-4572-8a37-f4a6ce8517ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:30.118450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b04f0963-49cd-4572-8a37-f4a6ce8517ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.158359 Oct 28 20:08:30.118998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 211/430] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:29 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:30.704591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8b6c20dd-d0af-4178-b17b-213c515a4305 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:30.705563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8b6c20dd-d0af-4178-b17b-213c515a4305 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:30.711771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b6c20dd-d0af-4178-b17b-213c515a4305 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:30.712252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b6c20dd-d0af-4178-b17b-213c515a4305 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:30.712688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b6c20dd-d0af-4178-b17b-213c515a4305 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:30.713406 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b6c20dd-d0af-4178-b17b-213c515a4305 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:30.713864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b6c20dd-d0af-4178-b17b-213c515a4305 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:30.714286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b6c20dd-d0af-4178-b17b-213c515a4305 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:30.729349 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a53d6a7e-ae3a-428b-b1a9-eba5d4f10d76 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:30.729987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a53d6a7e-ae3a-428b-b1a9-eba5d4f10d76 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:30.736518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a53d6a7e-ae3a-428b-b1a9-eba5d4f10d76 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:30.737005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a53d6a7e-ae3a-428b-b1a9-eba5d4f10d76 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:30.737476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a53d6a7e-ae3a-428b-b1a9-eba5d4f10d76 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:30.738177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a53d6a7e-ae3a-428b-b1a9-eba5d4f10d76 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:30.738698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a53d6a7e-ae3a-428b-b1a9-eba5d4f10d76 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:30.739128 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a53d6a7e-ae3a-428b-b1a9-eba5d4f10d76 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:30.784742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8b6c20dd-d0af-4178-b17b-213c515a4305 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:30.792313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8b6c20dd-d0af-4178-b17b-213c515a4305 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.092211 Oct 28 20:08:30.792883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 220/431] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:30 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:30.801434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-935ba742-ce64-4fda-93e5-1ece47d7102b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:30.802772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-935ba742-ce64-4fda-93e5-1ece47d7102b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:30.807896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935ba742-ce64-4fda-93e5-1ece47d7102b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:30.808405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935ba742-ce64-4fda-93e5-1ece47d7102b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:30.808834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935ba742-ce64-4fda-93e5-1ece47d7102b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:30.809543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935ba742-ce64-4fda-93e5-1ece47d7102b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:30.810617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935ba742-ce64-4fda-93e5-1ece47d7102b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:30.810617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935ba742-ce64-4fda-93e5-1ece47d7102b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:30.879793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-935ba742-ce64-4fda-93e5-1ece47d7102b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:30.887363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-935ba742-ce64-4fda-93e5-1ece47d7102b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.089799 Oct 28 20:08:30.887934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 221/432] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:30 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:30.901281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a53d6a7e-ae3a-428b-b1a9-eba5d4f10d76 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:30.908903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a53d6a7e-ae3a-428b-b1a9-eba5d4f10d76 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.183366 Oct 28 20:08:30.909489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 212/433] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:30 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:31.144212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-01c19a84-3ab2-487a-a279-74ba2f369507 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:31.144769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-01c19a84-3ab2-487a-a279-74ba2f369507 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:31.150760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01c19a84-3ab2-487a-a279-74ba2f369507 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:31.151243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01c19a84-3ab2-487a-a279-74ba2f369507 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:31.151684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01c19a84-3ab2-487a-a279-74ba2f369507 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:31.152371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01c19a84-3ab2-487a-a279-74ba2f369507 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:31.152827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01c19a84-3ab2-487a-a279-74ba2f369507 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:31.153250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01c19a84-3ab2-487a-a279-74ba2f369507 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:31.279715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-01c19a84-3ab2-487a-a279-74ba2f369507 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:31.288084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-01c19a84-3ab2-487a-a279-74ba2f369507 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:31.289555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-01c19a84-3ab2-487a-a279-74ba2f369507 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:31.290691 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-01c19a84-3ab2-487a-a279-74ba2f369507 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.150781 Oct 28 20:08:31.291235 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 222/434] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:31 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:31.815570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60f5ecc4-2975-4b6b-af2b-3dde717b6d16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:31.816224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60f5ecc4-2975-4b6b-af2b-3dde717b6d16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:31.822602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f5ecc4-2975-4b6b-af2b-3dde717b6d16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:31.823073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f5ecc4-2975-4b6b-af2b-3dde717b6d16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:31.823503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f5ecc4-2975-4b6b-af2b-3dde717b6d16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:31.824179 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f5ecc4-2975-4b6b-af2b-3dde717b6d16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:31.824627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f5ecc4-2975-4b6b-af2b-3dde717b6d16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:31.828240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f5ecc4-2975-4b6b-af2b-3dde717b6d16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:31.887295 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-60f5ecc4-2975-4b6b-af2b-3dde717b6d16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:31.894752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60f5ecc4-2975-4b6b-af2b-3dde717b6d16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.083148 Oct 28 20:08:31.895315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 213/435] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:31 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:31.910060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-975019d2-899a-4473-a22d-d0e297869b57 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:31.910703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-975019d2-899a-4473-a22d-d0e297869b57 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:31.916979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-975019d2-899a-4473-a22d-d0e297869b57 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:31.917505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-975019d2-899a-4473-a22d-d0e297869b57 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:31.917944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-975019d2-899a-4473-a22d-d0e297869b57 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:31.918626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-975019d2-899a-4473-a22d-d0e297869b57 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:31.919081 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-975019d2-899a-4473-a22d-d0e297869b57 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:31.919505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-975019d2-899a-4473-a22d-d0e297869b57 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:31.931142 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bbffff07-ec34-4340-800d-e106c45e3751 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:31.931764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bbffff07-ec34-4340-800d-e106c45e3751 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:31.937742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbffff07-ec34-4340-800d-e106c45e3751 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:31.938232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbffff07-ec34-4340-800d-e106c45e3751 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:31.939138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbffff07-ec34-4340-800d-e106c45e3751 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:31.939833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbffff07-ec34-4340-800d-e106c45e3751 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:31.940296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbffff07-ec34-4340-800d-e106c45e3751 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:31.940761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbffff07-ec34-4340-800d-e106c45e3751 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:31.982685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-975019d2-899a-4473-a22d-d0e297869b57 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:31.991131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-975019d2-899a-4473-a22d-d0e297869b57 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.085310 Oct 28 20:08:31.991701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 223/436] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:31 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:32.076319 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bbffff07-ec34-4340-800d-e106c45e3751 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:32.084593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bbffff07-ec34-4340-800d-e106c45e3751 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.157175 Oct 28 20:08:32.085410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 214/437] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:31 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:32.316292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d89bfe1-8d32-4fd5-b7ea-922c51cdcaea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:32.316907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4d89bfe1-8d32-4fd5-b7ea-922c51cdcaea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:32.322782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d89bfe1-8d32-4fd5-b7ea-922c51cdcaea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:32.323269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d89bfe1-8d32-4fd5-b7ea-922c51cdcaea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:32.323715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d89bfe1-8d32-4fd5-b7ea-922c51cdcaea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:32.324404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d89bfe1-8d32-4fd5-b7ea-922c51cdcaea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:32.324871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d89bfe1-8d32-4fd5-b7ea-922c51cdcaea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:32.325350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d89bfe1-8d32-4fd5-b7ea-922c51cdcaea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:32.462601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d89bfe1-8d32-4fd5-b7ea-922c51cdcaea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:32.471141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d89bfe1-8d32-4fd5-b7ea-922c51cdcaea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:32.472566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d89bfe1-8d32-4fd5-b7ea-922c51cdcaea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:32.473736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4d89bfe1-8d32-4fd5-b7ea-922c51cdcaea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.161577 Oct 28 20:08:32.474280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 224/438] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:32 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:32.917590 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-47dc0618-03a9-4aae-aea9-2dc3331ce1a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:32.918124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-47dc0618-03a9-4aae-aea9-2dc3331ce1a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:32.924916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47dc0618-03a9-4aae-aea9-2dc3331ce1a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:32.925432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47dc0618-03a9-4aae-aea9-2dc3331ce1a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:32.925871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47dc0618-03a9-4aae-aea9-2dc3331ce1a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:32.926563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47dc0618-03a9-4aae-aea9-2dc3331ce1a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:32.927016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47dc0618-03a9-4aae-aea9-2dc3331ce1a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:32.927438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47dc0618-03a9-4aae-aea9-2dc3331ce1a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:32.987705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-47dc0618-03a9-4aae-aea9-2dc3331ce1a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:32.995041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-47dc0618-03a9-4aae-aea9-2dc3331ce1a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.081438 Oct 28 20:08:32.995593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 215/439] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:32 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:33.013510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc349699-615d-4324-8ea8-7e1a50ff380e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:33.014126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dc349699-615d-4324-8ea8-7e1a50ff380e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:33.020636 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc349699-615d-4324-8ea8-7e1a50ff380e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:33.021063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc349699-615d-4324-8ea8-7e1a50ff380e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:33.021544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc349699-615d-4324-8ea8-7e1a50ff380e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:33.022234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc349699-615d-4324-8ea8-7e1a50ff380e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:33.022690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc349699-615d-4324-8ea8-7e1a50ff380e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:33.023110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc349699-615d-4324-8ea8-7e1a50ff380e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:33.082393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dc349699-615d-4324-8ea8-7e1a50ff380e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:33.090092 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc349699-615d-4324-8ea8-7e1a50ff380e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.080549 Oct 28 20:08:33.090649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 225/440] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:33 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:33.111276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5797752a-1719-4c1f-ab37-d07a5affee2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:33.111896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5797752a-1719-4c1f-ab37-d07a5affee2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:33.118000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5797752a-1719-4c1f-ab37-d07a5affee2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:33.118485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5797752a-1719-4c1f-ab37-d07a5affee2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:33.118947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5797752a-1719-4c1f-ab37-d07a5affee2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:33.119634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5797752a-1719-4c1f-ab37-d07a5affee2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:33.120114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5797752a-1719-4c1f-ab37-d07a5affee2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:33.120536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5797752a-1719-4c1f-ab37-d07a5affee2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:33.249848 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5797752a-1719-4c1f-ab37-d07a5affee2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:33.258234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5797752a-1719-4c1f-ab37-d07a5affee2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.151450 Oct 28 20:08:33.258806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 216/441] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:33 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:33.499235 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-060d194c-6cd8-428e-91b1-397e77a58266 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:33.499846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-060d194c-6cd8-428e-91b1-397e77a58266 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:33.506253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-060d194c-6cd8-428e-91b1-397e77a58266 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:33.506733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-060d194c-6cd8-428e-91b1-397e77a58266 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:33.507164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-060d194c-6cd8-428e-91b1-397e77a58266 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:33.507845 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-060d194c-6cd8-428e-91b1-397e77a58266 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:33.508297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-060d194c-6cd8-428e-91b1-397e77a58266 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:33.508718 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-060d194c-6cd8-428e-91b1-397e77a58266 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:33.638752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-060d194c-6cd8-428e-91b1-397e77a58266 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:33.646969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-060d194c-6cd8-428e-91b1-397e77a58266 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:33.648421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-060d194c-6cd8-428e-91b1-397e77a58266 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:33.649600 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-060d194c-6cd8-428e-91b1-397e77a58266 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.154294 Oct 28 20:08:33.650159 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 226/442] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:33 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:34.017681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f7368547-6183-4292-8e06-1698086bc055 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:34.018317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f7368547-6183-4292-8e06-1698086bc055 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:34.024771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7368547-6183-4292-8e06-1698086bc055 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:34.025263 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7368547-6183-4292-8e06-1698086bc055 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:34.025735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7368547-6183-4292-8e06-1698086bc055 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:34.026428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7368547-6183-4292-8e06-1698086bc055 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:34.026883 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7368547-6183-4292-8e06-1698086bc055 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:34.027308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7368547-6183-4292-8e06-1698086bc055 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:34.087759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f7368547-6183-4292-8e06-1698086bc055 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:34.095920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f7368547-6183-4292-8e06-1698086bc055 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.081824 Oct 28 20:08:34.096419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 217/443] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:34 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:34.113275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e6a8d729-db12-4846-82d5-3fd9c22eeec2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:34.114397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e6a8d729-db12-4846-82d5-3fd9c22eeec2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:34.122423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6a8d729-db12-4846-82d5-3fd9c22eeec2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:34.122905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6a8d729-db12-4846-82d5-3fd9c22eeec2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:34.123345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6a8d729-db12-4846-82d5-3fd9c22eeec2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:34.124039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6a8d729-db12-4846-82d5-3fd9c22eeec2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:34.124490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6a8d729-db12-4846-82d5-3fd9c22eeec2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:34.124906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6a8d729-db12-4846-82d5-3fd9c22eeec2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:34.129253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:34.185117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e6a8d729-db12-4846-82d5-3fd9c22eeec2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:34.193912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e6a8d729-db12-4846-82d5-3fd9c22eeec2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.085628 Oct 28 20:08:34.195087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 227/444] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:34 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:34.281167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-af857ec0-3c97-4d1d-aaed-2f2b2b236cfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:34.282304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-af857ec0-3c97-4d1d-aaed-2f2b2b236cfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:34.288298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af857ec0-3c97-4d1d-aaed-2f2b2b236cfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:34.288776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af857ec0-3c97-4d1d-aaed-2f2b2b236cfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:34.289206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af857ec0-3c97-4d1d-aaed-2f2b2b236cfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:34.289906 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af857ec0-3c97-4d1d-aaed-2f2b2b236cfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:34.290357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af857ec0-3c97-4d1d-aaed-2f2b2b236cfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:34.290775 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af857ec0-3c97-4d1d-aaed-2f2b2b236cfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:34.428011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-af857ec0-3c97-4d1d-aaed-2f2b2b236cfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:34.435486 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-af857ec0-3c97-4d1d-aaed-2f2b2b236cfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.158128 Oct 28 20:08:34.436036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 218/445] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:34 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:34.675753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b46776c5-bba1-4836-8e49-e4d1730088dd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:34.676279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b46776c5-bba1-4836-8e49-e4d1730088dd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:34.682148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b46776c5-bba1-4836-8e49-e4d1730088dd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:34.682631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b46776c5-bba1-4836-8e49-e4d1730088dd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:34.683070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b46776c5-bba1-4836-8e49-e4d1730088dd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:34.683760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b46776c5-bba1-4836-8e49-e4d1730088dd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:34.684211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b46776c5-bba1-4836-8e49-e4d1730088dd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:34.684635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b46776c5-bba1-4836-8e49-e4d1730088dd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:34.811722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b46776c5-bba1-4836-8e49-e4d1730088dd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:34.819797 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b46776c5-bba1-4836-8e49-e4d1730088dd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:34.821236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b46776c5-bba1-4836-8e49-e4d1730088dd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:34.822403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b46776c5-bba1-4836-8e49-e4d1730088dd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.151351 Oct 28 20:08:34.822952 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 228/446] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:34 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:35.118927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7549827d-a852-4ea4-9dd7-80f8aac76369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:35.119547 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7549827d-a852-4ea4-9dd7-80f8aac76369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:35.125869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7549827d-a852-4ea4-9dd7-80f8aac76369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:35.126344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7549827d-a852-4ea4-9dd7-80f8aac76369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:35.126768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7549827d-a852-4ea4-9dd7-80f8aac76369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:35.127445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7549827d-a852-4ea4-9dd7-80f8aac76369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:35.127892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7549827d-a852-4ea4-9dd7-80f8aac76369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:35.128314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7549827d-a852-4ea4-9dd7-80f8aac76369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:35.187697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7549827d-a852-4ea4-9dd7-80f8aac76369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:35.195278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7549827d-a852-4ea4-9dd7-80f8aac76369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.080191 Oct 28 20:08:35.195869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 219/447] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:35 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:35.215940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ec674620-1f3b-4a48-be5a-164cbc2f60c2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:35.216673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ec674620-1f3b-4a48-be5a-164cbc2f60c2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:35.224080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec674620-1f3b-4a48-be5a-164cbc2f60c2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:35.224625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec674620-1f3b-4a48-be5a-164cbc2f60c2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:35.225080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec674620-1f3b-4a48-be5a-164cbc2f60c2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:35.225790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec674620-1f3b-4a48-be5a-164cbc2f60c2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:35.226241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec674620-1f3b-4a48-be5a-164cbc2f60c2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:35.226837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec674620-1f3b-4a48-be5a-164cbc2f60c2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:35.291464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ec674620-1f3b-4a48-be5a-164cbc2f60c2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:35.299472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ec674620-1f3b-4a48-be5a-164cbc2f60c2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.087230 Oct 28 20:08:35.300066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 229/448] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:35 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:35.459297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dd330e96-106b-4229-a142-3b6d5437ddee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:35.459915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dd330e96-106b-4229-a142-3b6d5437ddee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:35.466149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd330e96-106b-4229-a142-3b6d5437ddee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:35.466636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd330e96-106b-4229-a142-3b6d5437ddee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:35.467079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd330e96-106b-4229-a142-3b6d5437ddee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:35.467767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd330e96-106b-4229-a142-3b6d5437ddee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:35.468272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd330e96-106b-4229-a142-3b6d5437ddee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:35.468699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd330e96-106b-4229-a142-3b6d5437ddee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:35.595797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-dd330e96-106b-4229-a142-3b6d5437ddee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:35.603327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dd330e96-106b-4229-a142-3b6d5437ddee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.148145 Oct 28 20:08:35.603886 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 220/449] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:35 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:35.848266 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a08b63c4-4e2f-42dc-9925-5cd33fbd9935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:35.848793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a08b63c4-4e2f-42dc-9925-5cd33fbd9935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:35.854719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a08b63c4-4e2f-42dc-9925-5cd33fbd9935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:35.855194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a08b63c4-4e2f-42dc-9925-5cd33fbd9935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:35.855631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a08b63c4-4e2f-42dc-9925-5cd33fbd9935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:35.856309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a08b63c4-4e2f-42dc-9925-5cd33fbd9935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:35.856759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a08b63c4-4e2f-42dc-9925-5cd33fbd9935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:35.857174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a08b63c4-4e2f-42dc-9925-5cd33fbd9935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:35.986705 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a08b63c4-4e2f-42dc-9925-5cd33fbd9935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:35.995100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a08b63c4-4e2f-42dc-9925-5cd33fbd9935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:35.996590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a08b63c4-4e2f-42dc-9925-5cd33fbd9935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:35.997780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a08b63c4-4e2f-42dc-9925-5cd33fbd9935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.153678 Oct 28 20:08:35.998343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 230/450] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:35 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:36.218645 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aced0da1-006e-45d0-9b7a-da89adf9a488 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:36.219961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aced0da1-006e-45d0-9b7a-da89adf9a488 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:36.226579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aced0da1-006e-45d0-9b7a-da89adf9a488 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:36.227067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aced0da1-006e-45d0-9b7a-da89adf9a488 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:36.227515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aced0da1-006e-45d0-9b7a-da89adf9a488 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:36.228202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aced0da1-006e-45d0-9b7a-da89adf9a488 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:36.228687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aced0da1-006e-45d0-9b7a-da89adf9a488 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:36.229117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aced0da1-006e-45d0-9b7a-da89adf9a488 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:36.291845 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-aced0da1-006e-45d0-9b7a-da89adf9a488 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:36.299603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aced0da1-006e-45d0-9b7a-da89adf9a488 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.084776 Oct 28 20:08:36.300164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 221/451] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:36 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:36.322281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dbadb7cf-b487-4530-9af4-08cd3e8ccc8e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:36.323018 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dbadb7cf-b487-4530-9af4-08cd3e8ccc8e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:36.330196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbadb7cf-b487-4530-9af4-08cd3e8ccc8e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:36.330682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbadb7cf-b487-4530-9af4-08cd3e8ccc8e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:36.331114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbadb7cf-b487-4530-9af4-08cd3e8ccc8e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:36.331809 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbadb7cf-b487-4530-9af4-08cd3e8ccc8e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:36.332304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbadb7cf-b487-4530-9af4-08cd3e8ccc8e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:36.332703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbadb7cf-b487-4530-9af4-08cd3e8ccc8e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:36.394112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dbadb7cf-b487-4530-9af4-08cd3e8ccc8e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:36.401541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dbadb7cf-b487-4530-9af4-08cd3e8ccc8e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.083242 Oct 28 20:08:36.402096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 231/452] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:36 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:36.627958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32a784e3-679e-4c03-92cd-60c0589d465f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:36.628497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-32a784e3-679e-4c03-92cd-60c0589d465f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:36.634501 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32a784e3-679e-4c03-92cd-60c0589d465f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:36.634993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32a784e3-679e-4c03-92cd-60c0589d465f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:36.635434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32a784e3-679e-4c03-92cd-60c0589d465f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:36.636121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32a784e3-679e-4c03-92cd-60c0589d465f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:36.636578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32a784e3-679e-4c03-92cd-60c0589d465f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:36.637005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32a784e3-679e-4c03-92cd-60c0589d465f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:36.762576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-32a784e3-679e-4c03-92cd-60c0589d465f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:36.770281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-32a784e3-679e-4c03-92cd-60c0589d465f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.148263 Oct 28 20:08:36.770872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 222/453] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:36 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:37.023893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9ee6b5ee-05e1-4f7f-a9de-b145f787b683 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:37.024522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9ee6b5ee-05e1-4f7f-a9de-b145f787b683 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:37.030486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ee6b5ee-05e1-4f7f-a9de-b145f787b683 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:37.030963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ee6b5ee-05e1-4f7f-a9de-b145f787b683 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:37.031392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ee6b5ee-05e1-4f7f-a9de-b145f787b683 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:37.032326 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ee6b5ee-05e1-4f7f-a9de-b145f787b683 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:37.032934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ee6b5ee-05e1-4f7f-a9de-b145f787b683 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:37.033377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ee6b5ee-05e1-4f7f-a9de-b145f787b683 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:37.164525 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9ee6b5ee-05e1-4f7f-a9de-b145f787b683 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:37.172673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9ee6b5ee-05e1-4f7f-a9de-b145f787b683 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:37.174083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9ee6b5ee-05e1-4f7f-a9de-b145f787b683 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:37.175230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9ee6b5ee-05e1-4f7f-a9de-b145f787b683 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.155297 Oct 28 20:08:37.175788 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 232/454] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:37 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:37.323528 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fbe4965b-8321-4099-8d5c-6488f92938e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:37.324147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fbe4965b-8321-4099-8d5c-6488f92938e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:37.331447 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbe4965b-8321-4099-8d5c-6488f92938e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:37.331937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbe4965b-8321-4099-8d5c-6488f92938e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:37.332376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbe4965b-8321-4099-8d5c-6488f92938e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:37.333073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbe4965b-8321-4099-8d5c-6488f92938e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:37.333573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbe4965b-8321-4099-8d5c-6488f92938e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:37.334005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbe4965b-8321-4099-8d5c-6488f92938e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:37.395711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fbe4965b-8321-4099-8d5c-6488f92938e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:37.397936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:37.403875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fbe4965b-8321-4099-8d5c-6488f92938e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.084178 Oct 28 20:08:37.404430 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 223/455] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:37 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:37.424629 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-52181abc-230b-4ad1-84ae-59296b40c28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:37.425185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-52181abc-230b-4ad1-84ae-59296b40c28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:37.431567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52181abc-230b-4ad1-84ae-59296b40c28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:37.432032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52181abc-230b-4ad1-84ae-59296b40c28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:37.432476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52181abc-230b-4ad1-84ae-59296b40c28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:37.433173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52181abc-230b-4ad1-84ae-59296b40c28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:37.433666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52181abc-230b-4ad1-84ae-59296b40c28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:37.434097 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52181abc-230b-4ad1-84ae-59296b40c28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:37.494228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-52181abc-230b-4ad1-84ae-59296b40c28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:37.502493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-52181abc-230b-4ad1-84ae-59296b40c28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.082327 Oct 28 20:08:37.503053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 233/456] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:37 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:37.792387 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-13ba6155-9411-4256-ad0f-13434f812320 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:37.793005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-13ba6155-9411-4256-ad0f-13434f812320 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:37.800109 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13ba6155-9411-4256-ad0f-13434f812320 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:37.800603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13ba6155-9411-4256-ad0f-13434f812320 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:37.801084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13ba6155-9411-4256-ad0f-13434f812320 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:37.801810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13ba6155-9411-4256-ad0f-13434f812320 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:37.802272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13ba6155-9411-4256-ad0f-13434f812320 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:37.802704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13ba6155-9411-4256-ad0f-13434f812320 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:37.932291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-13ba6155-9411-4256-ad0f-13434f812320 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:37.939975 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-13ba6155-9411-4256-ad0f-13434f812320 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.151905 Oct 28 20:08:37.940539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 224/457] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:37 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:38.201989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e151835a-0fd1-46fb-828b-1fdbd371f823 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:38.202662 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e151835a-0fd1-46fb-828b-1fdbd371f823 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:38.208464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e151835a-0fd1-46fb-828b-1fdbd371f823 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:38.208947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e151835a-0fd1-46fb-828b-1fdbd371f823 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:38.209426 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e151835a-0fd1-46fb-828b-1fdbd371f823 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:38.210149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e151835a-0fd1-46fb-828b-1fdbd371f823 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:38.210604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e151835a-0fd1-46fb-828b-1fdbd371f823 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:38.211292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e151835a-0fd1-46fb-828b-1fdbd371f823 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:38.340607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e151835a-0fd1-46fb-828b-1fdbd371f823 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:38.349112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e151835a-0fd1-46fb-828b-1fdbd371f823 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:38.350576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e151835a-0fd1-46fb-828b-1fdbd371f823 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:38.351722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e151835a-0fd1-46fb-828b-1fdbd371f823 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.153872 Oct 28 20:08:38.352267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 234/458] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:38 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:38.427149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b2566c39-2fd1-4b9d-857b-adbd41db1ee6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:38.427852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b2566c39-2fd1-4b9d-857b-adbd41db1ee6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:38.434110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2566c39-2fd1-4b9d-857b-adbd41db1ee6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:38.434779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2566c39-2fd1-4b9d-857b-adbd41db1ee6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:38.435011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2566c39-2fd1-4b9d-857b-adbd41db1ee6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:38.435711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2566c39-2fd1-4b9d-857b-adbd41db1ee6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:38.436145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2566c39-2fd1-4b9d-857b-adbd41db1ee6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:38.436569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2566c39-2fd1-4b9d-857b-adbd41db1ee6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:38.497786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b2566c39-2fd1-4b9d-857b-adbd41db1ee6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:38.505138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b2566c39-2fd1-4b9d-857b-adbd41db1ee6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.082474 Oct 28 20:08:38.505730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 225/459] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:38 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:38.523910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-03b1733b-f259-4f31-b8c3-8daf6896e782 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:38.524565 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-03b1733b-f259-4f31-b8c3-8daf6896e782 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:38.530892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b1733b-f259-4f31-b8c3-8daf6896e782 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:38.531377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b1733b-f259-4f31-b8c3-8daf6896e782 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:38.532385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b1733b-f259-4f31-b8c3-8daf6896e782 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:38.533078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b1733b-f259-4f31-b8c3-8daf6896e782 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:38.533561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b1733b-f259-4f31-b8c3-8daf6896e782 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:38.533991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b1733b-f259-4f31-b8c3-8daf6896e782 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:38.597671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-03b1733b-f259-4f31-b8c3-8daf6896e782 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:38.605177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-03b1733b-f259-4f31-b8c3-8daf6896e782 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.085149 Oct 28 20:08:38.605782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 235/460] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:38 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:38.962099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0b0612e8-9164-4157-9575-6fde68c182a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:38.962714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0b0612e8-9164-4157-9575-6fde68c182a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:38.968592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b0612e8-9164-4157-9575-6fde68c182a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:38.969073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b0612e8-9164-4157-9575-6fde68c182a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:38.969545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b0612e8-9164-4157-9575-6fde68c182a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:38.970932 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b0612e8-9164-4157-9575-6fde68c182a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:38.971383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b0612e8-9164-4157-9575-6fde68c182a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:38.971804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b0612e8-9164-4157-9575-6fde68c182a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:39.100889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0b0612e8-9164-4157-9575-6fde68c182a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:39.108398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0b0612e8-9164-4157-9575-6fde68c182a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.150407 Oct 28 20:08:39.108956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 226/461] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:38 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:39.376950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-19c18972-c7da-4570-a342-d17dc2738060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:39.377586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-19c18972-c7da-4570-a342-d17dc2738060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:39.383422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-19c18972-c7da-4570-a342-d17dc2738060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:39.383900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-19c18972-c7da-4570-a342-d17dc2738060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:39.384328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-19c18972-c7da-4570-a342-d17dc2738060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:39.385005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-19c18972-c7da-4570-a342-d17dc2738060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:39.385479 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-19c18972-c7da-4570-a342-d17dc2738060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:39.385902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-19c18972-c7da-4570-a342-d17dc2738060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:39.512704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-19c18972-c7da-4570-a342-d17dc2738060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:39.521558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-19c18972-c7da-4570-a342-d17dc2738060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:39.523098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-19c18972-c7da-4570-a342-d17dc2738060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:39.524338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-19c18972-c7da-4570-a342-d17dc2738060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.151248 Oct 28 20:08:39.525436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 236/462] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:39 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:39.528078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c5058c2-176e-42d4-a49d-153ad801003a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:39.528682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8c5058c2-176e-42d4-a49d-153ad801003a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:39.535908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c5058c2-176e-42d4-a49d-153ad801003a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:39.536382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c5058c2-176e-42d4-a49d-153ad801003a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:39.536900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c5058c2-176e-42d4-a49d-153ad801003a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:39.537625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c5058c2-176e-42d4-a49d-153ad801003a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:39.538075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c5058c2-176e-42d4-a49d-153ad801003a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:39.538492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c5058c2-176e-42d4-a49d-153ad801003a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:39.602404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8c5058c2-176e-42d4-a49d-153ad801003a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:39.609977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8c5058c2-176e-42d4-a49d-153ad801003a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.085977 Oct 28 20:08:39.611186 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 227/463] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:39 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:39.627852 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bbf01b67-7113-4a81-962b-5fbe9057a60b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:39.628455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bbf01b67-7113-4a81-962b-5fbe9057a60b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:39.634665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbf01b67-7113-4a81-962b-5fbe9057a60b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:39.635140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbf01b67-7113-4a81-962b-5fbe9057a60b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:39.635580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbf01b67-7113-4a81-962b-5fbe9057a60b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:39.636260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbf01b67-7113-4a81-962b-5fbe9057a60b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:39.636709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbf01b67-7113-4a81-962b-5fbe9057a60b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:39.637154 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbf01b67-7113-4a81-962b-5fbe9057a60b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:39.696260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bbf01b67-7113-4a81-962b-5fbe9057a60b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:39.703900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bbf01b67-7113-4a81-962b-5fbe9057a60b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.079911 Oct 28 20:08:39.705089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 237/464] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:39 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:40.131469 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f030c10e-24b3-484a-a461-3f471ca5191c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:40.132096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f030c10e-24b3-484a-a461-3f471ca5191c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:40.137988 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f030c10e-24b3-484a-a461-3f471ca5191c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:40.138474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f030c10e-24b3-484a-a461-3f471ca5191c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:40.138912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f030c10e-24b3-484a-a461-3f471ca5191c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:40.139595 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f030c10e-24b3-484a-a461-3f471ca5191c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:40.140069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f030c10e-24b3-484a-a461-3f471ca5191c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:40.140474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f030c10e-24b3-484a-a461-3f471ca5191c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:40.273130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f030c10e-24b3-484a-a461-3f471ca5191c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:40.280697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f030c10e-24b3-484a-a461-3f471ca5191c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.153116 Oct 28 20:08:40.281258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 228/465] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:40 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:40.550615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e7cff464-998e-4108-9457-48261992e5f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:40.551243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e7cff464-998e-4108-9457-48261992e5f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:40.557058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7cff464-998e-4108-9457-48261992e5f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:40.557588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7cff464-998e-4108-9457-48261992e5f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:40.558026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7cff464-998e-4108-9457-48261992e5f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:40.558716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7cff464-998e-4108-9457-48261992e5f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:40.559169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7cff464-998e-4108-9457-48261992e5f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:40.559591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7cff464-998e-4108-9457-48261992e5f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:40.633264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1f52da44-fa46-4962-bd6b-b9d9c9897c41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:40.633901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1f52da44-fa46-4962-bd6b-b9d9c9897c41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:40.640203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f52da44-fa46-4962-bd6b-b9d9c9897c41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:40.640684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f52da44-fa46-4962-bd6b-b9d9c9897c41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:40.641115 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f52da44-fa46-4962-bd6b-b9d9c9897c41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:40.641978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f52da44-fa46-4962-bd6b-b9d9c9897c41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:40.642434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f52da44-fa46-4962-bd6b-b9d9c9897c41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:40.642856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f52da44-fa46-4962-bd6b-b9d9c9897c41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:40.716338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1f52da44-fa46-4962-bd6b-b9d9c9897c41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:40.720564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e7cff464-998e-4108-9457-48261992e5f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:40.724796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1f52da44-fa46-4962-bd6b-b9d9c9897c41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.095424 Oct 28 20:08:40.725385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 229/466] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:40 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:40.728610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e7cff464-998e-4108-9457-48261992e5f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:40.729735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b9d268a-2b6b-4bc6-98bb-3a6b60806e4a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:40.730090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e7cff464-998e-4108-9457-48261992e5f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:40.730338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9b9d268a-2b6b-4bc6-98bb-3a6b60806e4a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:40.731245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e7cff464-998e-4108-9457-48261992e5f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.184980 Oct 28 20:08:40.731930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 238/467] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:40 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:40.736692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b9d268a-2b6b-4bc6-98bb-3a6b60806e4a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:40.737209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b9d268a-2b6b-4bc6-98bb-3a6b60806e4a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:40.737671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b9d268a-2b6b-4bc6-98bb-3a6b60806e4a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:40.738361 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b9d268a-2b6b-4bc6-98bb-3a6b60806e4a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:40.738817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b9d268a-2b6b-4bc6-98bb-3a6b60806e4a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:40.739240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b9d268a-2b6b-4bc6-98bb-3a6b60806e4a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:40.800601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9b9d268a-2b6b-4bc6-98bb-3a6b60806e4a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:40.808115 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b9d268a-2b6b-4bc6-98bb-3a6b60806e4a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.081794 Oct 28 20:08:40.808682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 230/468] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:40 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:41.303749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ae56b946-350b-48b5-8a80-a6bd2dcfef4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:41.304355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ae56b946-350b-48b5-8a80-a6bd2dcfef4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:41.310218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae56b946-350b-48b5-8a80-a6bd2dcfef4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:41.310720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae56b946-350b-48b5-8a80-a6bd2dcfef4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:41.311149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae56b946-350b-48b5-8a80-a6bd2dcfef4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:41.311824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae56b946-350b-48b5-8a80-a6bd2dcfef4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:41.312308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae56b946-350b-48b5-8a80-a6bd2dcfef4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:41.312722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae56b946-350b-48b5-8a80-a6bd2dcfef4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:41.446899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ae56b946-350b-48b5-8a80-a6bd2dcfef4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:41.454454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ae56b946-350b-48b5-8a80-a6bd2dcfef4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.154480 Oct 28 20:08:41.455016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 239/469] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:41 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:41.748033 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8f3fb972-1ab4-4f61-bae3-ef47a49b1874 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:41.748626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8f3fb972-1ab4-4f61-bae3-ef47a49b1874 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:41.755307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f3fb972-1ab4-4f61-bae3-ef47a49b1874 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:41.755784 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f3fb972-1ab4-4f61-bae3-ef47a49b1874 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:41.756214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f3fb972-1ab4-4f61-bae3-ef47a49b1874 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:41.756896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f3fb972-1ab4-4f61-bae3-ef47a49b1874 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:41.757370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f3fb972-1ab4-4f61-bae3-ef47a49b1874 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:41.757792 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f3fb972-1ab4-4f61-bae3-ef47a49b1874 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:41.758461 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-30619b55-05df-4870-862f-684e9bf6cb8a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:41.759138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-30619b55-05df-4870-862f-684e9bf6cb8a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:41.765727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30619b55-05df-4870-862f-684e9bf6cb8a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:41.766293 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30619b55-05df-4870-862f-684e9bf6cb8a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:41.767376 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30619b55-05df-4870-862f-684e9bf6cb8a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:41.768196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30619b55-05df-4870-862f-684e9bf6cb8a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:41.768746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30619b55-05df-4870-862f-684e9bf6cb8a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:41.769244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30619b55-05df-4870-862f-684e9bf6cb8a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:41.821561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8f3fb972-1ab4-4f61-bae3-ef47a49b1874 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:41.829577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8f3fb972-1ab4-4f61-bae3-ef47a49b1874 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.085334 Oct 28 20:08:41.833861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 231/470] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:41 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:41.834496 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3b4ea05d-7cd1-492c-9b6f-ea1e3d91fe12 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:41.835125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3b4ea05d-7cd1-492c-9b6f-ea1e3d91fe12 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:41.841035 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b4ea05d-7cd1-492c-9b6f-ea1e3d91fe12 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:41.841612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b4ea05d-7cd1-492c-9b6f-ea1e3d91fe12 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:41.842114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b4ea05d-7cd1-492c-9b6f-ea1e3d91fe12 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:41.842857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b4ea05d-7cd1-492c-9b6f-ea1e3d91fe12 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:41.843378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b4ea05d-7cd1-492c-9b6f-ea1e3d91fe12 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:41.843859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b4ea05d-7cd1-492c-9b6f-ea1e3d91fe12 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:41.916790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3b4ea05d-7cd1-492c-9b6f-ea1e3d91fe12 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:41.924342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3b4ea05d-7cd1-492c-9b6f-ea1e3d91fe12 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.093264 Oct 28 20:08:41.924898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 232/471] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:41 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:41.948176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-30619b55-05df-4870-862f-684e9bf6cb8a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:41.953792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-30619b55-05df-4870-862f-684e9bf6cb8a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:41.955896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-30619b55-05df-4870-862f-684e9bf6cb8a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:41.957039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-30619b55-05df-4870-862f-684e9bf6cb8a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.203446 Oct 28 20:08:41.957663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 240/472] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:41 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:08:42.480591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3f78c70c-bef9-457a-b8e1-5c05f1653290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:42.481208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3f78c70c-bef9-457a-b8e1-5c05f1653290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:42.490160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f78c70c-bef9-457a-b8e1-5c05f1653290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:42.490580 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f78c70c-bef9-457a-b8e1-5c05f1653290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:42.491025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f78c70c-bef9-457a-b8e1-5c05f1653290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:42.491739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f78c70c-bef9-457a-b8e1-5c05f1653290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:42.492197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f78c70c-bef9-457a-b8e1-5c05f1653290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:42.492651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f78c70c-bef9-457a-b8e1-5c05f1653290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:42.652093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3f78c70c-bef9-457a-b8e1-5c05f1653290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:42.660069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3f78c70c-bef9-457a-b8e1-5c05f1653290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.185288 Oct 28 20:08:42.660639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 233/473] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:42 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:42.854550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eb367d95-3d2b-4553-befe-15d2e8535c3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:42.855163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eb367d95-3d2b-4553-befe-15d2e8535c3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:42.862940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb367d95-3d2b-4553-befe-15d2e8535c3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:42.863424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb367d95-3d2b-4553-befe-15d2e8535c3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:42.863861 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb367d95-3d2b-4553-befe-15d2e8535c3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:42.864548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb367d95-3d2b-4553-befe-15d2e8535c3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:42.864998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb367d95-3d2b-4553-befe-15d2e8535c3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:42.865528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb367d95-3d2b-4553-befe-15d2e8535c3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:42.930904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-eb367d95-3d2b-4553-befe-15d2e8535c3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:42.940311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eb367d95-3d2b-4553-befe-15d2e8535c3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.089868 Oct 28 20:08:42.940884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 241/474] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:42 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:42.948033 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b8ebdd93-77f3-4426-9b77-b48a0248c010 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:42.948698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b8ebdd93-77f3-4426-9b77-b48a0248c010 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:42.955258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8ebdd93-77f3-4426-9b77-b48a0248c010 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:42.955739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8ebdd93-77f3-4426-9b77-b48a0248c010 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:42.956174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8ebdd93-77f3-4426-9b77-b48a0248c010 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:42.956860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8ebdd93-77f3-4426-9b77-b48a0248c010 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:42.957311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8ebdd93-77f3-4426-9b77-b48a0248c010 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:42.957921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8ebdd93-77f3-4426-9b77-b48a0248c010 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:42.988392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7cac42d4-1955-4ca6-b731-da308526d387 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:42.989073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7cac42d4-1955-4ca6-b731-da308526d387 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:42.995211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cac42d4-1955-4ca6-b731-da308526d387 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:42.995762 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cac42d4-1955-4ca6-b731-da308526d387 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:42.996496 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cac42d4-1955-4ca6-b731-da308526d387 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:42.997671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cac42d4-1955-4ca6-b731-da308526d387 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:42.998153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cac42d4-1955-4ca6-b731-da308526d387 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:42.998578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cac42d4-1955-4ca6-b731-da308526d387 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:43.030539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b8ebdd93-77f3-4426-9b77-b48a0248c010 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:43.044118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b8ebdd93-77f3-4426-9b77-b48a0248c010 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.099988 Oct 28 20:08:43.044710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 234/475] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:42 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:43.135763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7cac42d4-1955-4ca6-b731-da308526d387 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:43.144273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7cac42d4-1955-4ca6-b731-da308526d387 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:43.145778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7cac42d4-1955-4ca6-b731-da308526d387 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:43.146948 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7cac42d4-1955-4ca6-b731-da308526d387 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.166411 Oct 28 20:08:43.147536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 242/476] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:42 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:43.691013 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-22de39a3-3e8e-4c22-8457-9f60d9c5fbd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:43.691620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22de39a3-3e8e-4c22-8457-9f60d9c5fbd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:43.697506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22de39a3-3e8e-4c22-8457-9f60d9c5fbd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:43.697983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22de39a3-3e8e-4c22-8457-9f60d9c5fbd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:43.698414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22de39a3-3e8e-4c22-8457-9f60d9c5fbd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:43.699088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22de39a3-3e8e-4c22-8457-9f60d9c5fbd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:43.699533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22de39a3-3e8e-4c22-8457-9f60d9c5fbd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:43.699950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22de39a3-3e8e-4c22-8457-9f60d9c5fbd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:43.828852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-22de39a3-3e8e-4c22-8457-9f60d9c5fbd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:43.837292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-22de39a3-3e8e-4c22-8457-9f60d9c5fbd5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.150930 Oct 28 20:08:43.837882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 235/477] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:43 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:43.970563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-511a3b88-35de-45d1-947f-f64ecc21e935 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:43.971209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-511a3b88-35de-45d1-947f-f64ecc21e935 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:43.977432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-511a3b88-35de-45d1-947f-f64ecc21e935 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:43.977913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-511a3b88-35de-45d1-947f-f64ecc21e935 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:43.978348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-511a3b88-35de-45d1-947f-f64ecc21e935 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:43.979029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-511a3b88-35de-45d1-947f-f64ecc21e935 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:43.979476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-511a3b88-35de-45d1-947f-f64ecc21e935 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:43.979890 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-511a3b88-35de-45d1-947f-f64ecc21e935 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:44.041684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-511a3b88-35de-45d1-947f-f64ecc21e935 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:44.045007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:44.050202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-511a3b88-35de-45d1-947f-f64ecc21e935 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.083962 Oct 28 20:08:44.050759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 243/478] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:43 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:44.080492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cef2e9af-c6cd-447e-bc9d-d69d1c19e312 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:44.081395 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cef2e9af-c6cd-447e-bc9d-d69d1c19e312 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:44.087931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cef2e9af-c6cd-447e-bc9d-d69d1c19e312 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:44.088410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cef2e9af-c6cd-447e-bc9d-d69d1c19e312 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:44.088844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cef2e9af-c6cd-447e-bc9d-d69d1c19e312 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:44.089558 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cef2e9af-c6cd-447e-bc9d-d69d1c19e312 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:44.090008 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cef2e9af-c6cd-447e-bc9d-d69d1c19e312 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:44.090430 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cef2e9af-c6cd-447e-bc9d-d69d1c19e312 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:44.149365 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-cef2e9af-c6cd-447e-bc9d-d69d1c19e312 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:44.156748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cef2e9af-c6cd-447e-bc9d-d69d1c19e312 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.080713 Oct 28 20:08:44.158050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 236/479] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:44 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:44.172227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ceea79af-4de7-441d-a95c-81a2dd64b1cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:44.172994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ceea79af-4de7-441d-a95c-81a2dd64b1cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:44.178967 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ceea79af-4de7-441d-a95c-81a2dd64b1cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:44.179451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ceea79af-4de7-441d-a95c-81a2dd64b1cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:44.179887 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ceea79af-4de7-441d-a95c-81a2dd64b1cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:44.180570 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ceea79af-4de7-441d-a95c-81a2dd64b1cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:44.181021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ceea79af-4de7-441d-a95c-81a2dd64b1cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:44.181471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ceea79af-4de7-441d-a95c-81a2dd64b1cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:44.306819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ceea79af-4de7-441d-a95c-81a2dd64b1cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:44.314856 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ceea79af-4de7-441d-a95c-81a2dd64b1cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:44.316294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ceea79af-4de7-441d-a95c-81a2dd64b1cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:44.317481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ceea79af-4de7-441d-a95c-81a2dd64b1cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.149367 Oct 28 20:08:44.318030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 244/480] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:44 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:44.859868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-16bf0141-2f6e-4ac0-b723-082a1c2e90dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:44.861070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-16bf0141-2f6e-4ac0-b723-082a1c2e90dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:44.866967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16bf0141-2f6e-4ac0-b723-082a1c2e90dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:44.867443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16bf0141-2f6e-4ac0-b723-082a1c2e90dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:44.867871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16bf0141-2f6e-4ac0-b723-082a1c2e90dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:44.868551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16bf0141-2f6e-4ac0-b723-082a1c2e90dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:44.868996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16bf0141-2f6e-4ac0-b723-082a1c2e90dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:44.869444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16bf0141-2f6e-4ac0-b723-082a1c2e90dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:44.997342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-16bf0141-2f6e-4ac0-b723-082a1c2e90dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:45.005532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-16bf0141-2f6e-4ac0-b723-082a1c2e90dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.149515 Oct 28 20:08:45.006094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 237/481] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:44 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:45.072669 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-643b5d2a-dfea-4ead-99ac-039de962c05e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:45.073274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-643b5d2a-dfea-4ead-99ac-039de962c05e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:45.079761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-643b5d2a-dfea-4ead-99ac-039de962c05e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:45.080231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-643b5d2a-dfea-4ead-99ac-039de962c05e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:45.080663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-643b5d2a-dfea-4ead-99ac-039de962c05e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:45.081361 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-643b5d2a-dfea-4ead-99ac-039de962c05e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:45.081812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-643b5d2a-dfea-4ead-99ac-039de962c05e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:45.082230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-643b5d2a-dfea-4ead-99ac-039de962c05e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:45.140886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-643b5d2a-dfea-4ead-99ac-039de962c05e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:45.148327 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-643b5d2a-dfea-4ead-99ac-039de962c05e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.079448 Oct 28 20:08:45.148876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 245/482] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:45 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:45.179956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-755c6d17-28a6-4702-814b-c43d0a1595ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:45.180569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-755c6d17-28a6-4702-814b-c43d0a1595ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:45.187032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-755c6d17-28a6-4702-814b-c43d0a1595ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:45.187515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-755c6d17-28a6-4702-814b-c43d0a1595ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:45.187950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-755c6d17-28a6-4702-814b-c43d0a1595ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:45.189383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-755c6d17-28a6-4702-814b-c43d0a1595ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:45.189843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-755c6d17-28a6-4702-814b-c43d0a1595ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:45.190262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-755c6d17-28a6-4702-814b-c43d0a1595ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:45.249549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-755c6d17-28a6-4702-814b-c43d0a1595ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:45.258106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-755c6d17-28a6-4702-814b-c43d0a1595ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.081991 Oct 28 20:08:45.258667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 238/483] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:45 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:45.342831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a858da98-29c5-48f2-b5fe-edee130e81df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:45.343436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a858da98-29c5-48f2-b5fe-edee130e81df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:45.349396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a858da98-29c5-48f2-b5fe-edee130e81df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:45.354533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a858da98-29c5-48f2-b5fe-edee130e81df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:45.354533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a858da98-29c5-48f2-b5fe-edee130e81df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:45.354533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a858da98-29c5-48f2-b5fe-edee130e81df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:45.354533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a858da98-29c5-48f2-b5fe-edee130e81df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:45.355102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a858da98-29c5-48f2-b5fe-edee130e81df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:45.480677 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a858da98-29c5-48f2-b5fe-edee130e81df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:45.489148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a858da98-29c5-48f2-b5fe-edee130e81df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:45.490644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a858da98-29c5-48f2-b5fe-edee130e81df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:45.491792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a858da98-29c5-48f2-b5fe-edee130e81df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.152814 Oct 28 20:08:45.492343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 246/484] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:45 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:46.027943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5a833b8b-58ea-400d-85ce-e18f9dbb980f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:46.028550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5a833b8b-58ea-400d-85ce-e18f9dbb980f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:46.035514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a833b8b-58ea-400d-85ce-e18f9dbb980f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:46.035987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a833b8b-58ea-400d-85ce-e18f9dbb980f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:46.036412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a833b8b-58ea-400d-85ce-e18f9dbb980f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:46.037090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a833b8b-58ea-400d-85ce-e18f9dbb980f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:46.037566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a833b8b-58ea-400d-85ce-e18f9dbb980f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:46.037983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a833b8b-58ea-400d-85ce-e18f9dbb980f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:46.162963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5a833b8b-58ea-400d-85ce-e18f9dbb980f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:46.170313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85abba6d-8050-4289-9721-76ece3852459 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:46.170896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5a833b8b-58ea-400d-85ce-e18f9dbb980f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.146444 Oct 28 20:08:46.171010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-85abba6d-8050-4289-9721-76ece3852459 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:46.171195 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 239/485] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:46 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:46.178243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85abba6d-8050-4289-9721-76ece3852459 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:46.178724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85abba6d-8050-4289-9721-76ece3852459 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:46.179152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85abba6d-8050-4289-9721-76ece3852459 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:46.179836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85abba6d-8050-4289-9721-76ece3852459 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:46.180284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85abba6d-8050-4289-9721-76ece3852459 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:46.180703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85abba6d-8050-4289-9721-76ece3852459 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:46.241519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-85abba6d-8050-4289-9721-76ece3852459 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:46.249006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-85abba6d-8050-4289-9721-76ece3852459 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.082433 Oct 28 20:08:46.249598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 247/486] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:46 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:46.281913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-366cc546-d6da-4bf5-9122-512e680b1bf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:46.283214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-366cc546-d6da-4bf5-9122-512e680b1bf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:46.289246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366cc546-d6da-4bf5-9122-512e680b1bf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:46.289757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366cc546-d6da-4bf5-9122-512e680b1bf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:46.290181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366cc546-d6da-4bf5-9122-512e680b1bf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:46.290883 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366cc546-d6da-4bf5-9122-512e680b1bf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:46.291331 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366cc546-d6da-4bf5-9122-512e680b1bf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:46.291751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366cc546-d6da-4bf5-9122-512e680b1bf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:46.306770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:46.352681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-366cc546-d6da-4bf5-9122-512e680b1bf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:46.360809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-366cc546-d6da-4bf5-9122-512e680b1bf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.082324 Oct 28 20:08:46.370722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 240/487] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:46 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:46.517941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c15f5323-a1c0-4d99-8537-da8877e682ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:46.518582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c15f5323-a1c0-4d99-8537-da8877e682ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:46.524497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c15f5323-a1c0-4d99-8537-da8877e682ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:46.524983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c15f5323-a1c0-4d99-8537-da8877e682ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:46.525459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c15f5323-a1c0-4d99-8537-da8877e682ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:46.526150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c15f5323-a1c0-4d99-8537-da8877e682ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:46.526609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c15f5323-a1c0-4d99-8537-da8877e682ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:46.527035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c15f5323-a1c0-4d99-8537-da8877e682ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:46.887155 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c15f5323-a1c0-4d99-8537-da8877e682ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:46.891897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c15f5323-a1c0-4d99-8537-da8877e682ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:46.893565 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c15f5323-a1c0-4d99-8537-da8877e682ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:46.894711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c15f5323-a1c0-4d99-8537-da8877e682ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.380910 Oct 28 20:08:46.895261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 248/488] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:46 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:47.194007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c2da6c25-b6cb-42aa-b056-c2a87b44fa88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:47.194620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c2da6c25-b6cb-42aa-b056-c2a87b44fa88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:47.200569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2da6c25-b6cb-42aa-b056-c2a87b44fa88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:47.201049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2da6c25-b6cb-42aa-b056-c2a87b44fa88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:47.201511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2da6c25-b6cb-42aa-b056-c2a87b44fa88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:47.202197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2da6c25-b6cb-42aa-b056-c2a87b44fa88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:47.202650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2da6c25-b6cb-42aa-b056-c2a87b44fa88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:47.203073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2da6c25-b6cb-42aa-b056-c2a87b44fa88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:47.272533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d0754c23-0304-4711-83f7-5298cd36967f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:47.273157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d0754c23-0304-4711-83f7-5298cd36967f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:47.279798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0754c23-0304-4711-83f7-5298cd36967f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:47.280289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0754c23-0304-4711-83f7-5298cd36967f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:47.280732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0754c23-0304-4711-83f7-5298cd36967f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:47.281537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0754c23-0304-4711-83f7-5298cd36967f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:47.282001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0754c23-0304-4711-83f7-5298cd36967f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:47.283015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0754c23-0304-4711-83f7-5298cd36967f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:47.338703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c2da6c25-b6cb-42aa-b056-c2a87b44fa88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:47.346872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c2da6c25-b6cb-42aa-b056-c2a87b44fa88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.156729 Oct 28 20:08:47.347435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 241/489] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:47 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:47.357464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0754c23-0304-4711-83f7-5298cd36967f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:47.365178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d0754c23-0304-4711-83f7-5298cd36967f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.096505 Oct 28 20:08:47.365759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 249/490] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:47 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:47.383761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32dc95a4-4090-46a0-b94a-78c49b183c7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:47.384377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-32dc95a4-4090-46a0-b94a-78c49b183c7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:47.390275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32dc95a4-4090-46a0-b94a-78c49b183c7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:47.390762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32dc95a4-4090-46a0-b94a-78c49b183c7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:47.391198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32dc95a4-4090-46a0-b94a-78c49b183c7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:47.392685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32dc95a4-4090-46a0-b94a-78c49b183c7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:47.393152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32dc95a4-4090-46a0-b94a-78c49b183c7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:47.393609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32dc95a4-4090-46a0-b94a-78c49b183c7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:47.452627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-32dc95a4-4090-46a0-b94a-78c49b183c7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:47.460690 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-32dc95a4-4090-46a0-b94a-78c49b183c7d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.080730 Oct 28 20:08:47.461536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 242/491] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:47 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:47.919885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c1436c7d-619e-4660-8f4e-e0d7c90cd667 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:47.920493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c1436c7d-619e-4660-8f4e-e0d7c90cd667 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:47.927079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1436c7d-619e-4660-8f4e-e0d7c90cd667 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:47.927564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1436c7d-619e-4660-8f4e-e0d7c90cd667 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:47.928000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1436c7d-619e-4660-8f4e-e0d7c90cd667 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:47.928686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1436c7d-619e-4660-8f4e-e0d7c90cd667 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:47.929140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1436c7d-619e-4660-8f4e-e0d7c90cd667 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:47.929588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1436c7d-619e-4660-8f4e-e0d7c90cd667 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:48.059336 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c1436c7d-619e-4660-8f4e-e0d7c90cd667 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:48.068012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c1436c7d-619e-4660-8f4e-e0d7c90cd667 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:48.069544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c1436c7d-619e-4660-8f4e-e0d7c90cd667 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:48.070699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c1436c7d-619e-4660-8f4e-e0d7c90cd667 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.154668 Oct 28 20:08:48.071255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 250/492] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:47 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:48.369788 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-22f68c35-3bb7-4378-96f6-143417a40039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:48.370435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22f68c35-3bb7-4378-96f6-143417a40039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:48.376821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22f68c35-3bb7-4378-96f6-143417a40039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:48.377306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22f68c35-3bb7-4378-96f6-143417a40039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:48.377777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22f68c35-3bb7-4378-96f6-143417a40039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:48.378467 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22f68c35-3bb7-4378-96f6-143417a40039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:48.378927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22f68c35-3bb7-4378-96f6-143417a40039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:48.379357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22f68c35-3bb7-4378-96f6-143417a40039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:48.386814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4231b6c4-f4a9-4015-b3c6-27b9fb2f0155 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:48.387428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4231b6c4-f4a9-4015-b3c6-27b9fb2f0155 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:48.393950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4231b6c4-f4a9-4015-b3c6-27b9fb2f0155 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:48.394440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4231b6c4-f4a9-4015-b3c6-27b9fb2f0155 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:48.394882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4231b6c4-f4a9-4015-b3c6-27b9fb2f0155 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:48.395585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4231b6c4-f4a9-4015-b3c6-27b9fb2f0155 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:48.396046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4231b6c4-f4a9-4015-b3c6-27b9fb2f0155 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:48.396475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4231b6c4-f4a9-4015-b3c6-27b9fb2f0155 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:48.479039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4231b6c4-f4a9-4015-b3c6-27b9fb2f0155 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:48.496584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4231b6c4-f4a9-4015-b3c6-27b9fb2f0155 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.104219 Oct 28 20:08:48.496584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 251/493] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:48 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:48.496584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9dd1c366-97e1-4758-bdb5-b495a2d62e2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:48.496584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9dd1c366-97e1-4758-bdb5-b495a2d62e2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:48.498697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd1c366-97e1-4758-bdb5-b495a2d62e2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:48.499278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd1c366-97e1-4758-bdb5-b495a2d62e2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:48.499621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd1c366-97e1-4758-bdb5-b495a2d62e2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:48.500433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd1c366-97e1-4758-bdb5-b495a2d62e2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:48.501059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd1c366-97e1-4758-bdb5-b495a2d62e2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:48.501516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd1c366-97e1-4758-bdb5-b495a2d62e2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:48.550147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-22f68c35-3bb7-4378-96f6-143417a40039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:48.557813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-22f68c35-3bb7-4378-96f6-143417a40039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.191947 Oct 28 20:08:48.558379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 243/494] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:48 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:48.565354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9dd1c366-97e1-4758-bdb5-b495a2d62e2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:48.572771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9dd1c366-97e1-4758-bdb5-b495a2d62e2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.083974 Oct 28 20:08:48.573354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 252/495] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:48 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:49.096127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c6ce5423-a8fb-40e9-a428-65dd8ddfdbb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:49.096737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c6ce5423-a8fb-40e9-a428-65dd8ddfdbb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:49.102798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6ce5423-a8fb-40e9-a428-65dd8ddfdbb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:49.103323 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6ce5423-a8fb-40e9-a428-65dd8ddfdbb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:49.103760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6ce5423-a8fb-40e9-a428-65dd8ddfdbb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:49.104445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6ce5423-a8fb-40e9-a428-65dd8ddfdbb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:49.104900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6ce5423-a8fb-40e9-a428-65dd8ddfdbb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:49.105344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6ce5423-a8fb-40e9-a428-65dd8ddfdbb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:49.232666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c6ce5423-a8fb-40e9-a428-65dd8ddfdbb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:49.240614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c6ce5423-a8fb-40e9-a428-65dd8ddfdbb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:49.242088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c6ce5423-a8fb-40e9-a428-65dd8ddfdbb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:49.243224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c6ce5423-a8fb-40e9-a428-65dd8ddfdbb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.151169 Oct 28 20:08:49.243777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 244/496] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:49 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:49.517083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36501482-22dc-404a-b579-0d64cb279888 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:49.517653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36501482-22dc-404a-b579-0d64cb279888 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:49.523984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36501482-22dc-404a-b579-0d64cb279888 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:49.524467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36501482-22dc-404a-b579-0d64cb279888 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:49.524905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36501482-22dc-404a-b579-0d64cb279888 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:49.525621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36501482-22dc-404a-b579-0d64cb279888 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:49.526084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36501482-22dc-404a-b579-0d64cb279888 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:49.526510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36501482-22dc-404a-b579-0d64cb279888 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:49.580758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6e649c5c-4f65-4e9e-a95c-0eb2d88315b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:49.581397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6e649c5c-4f65-4e9e-a95c-0eb2d88315b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:49.586509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-36501482-22dc-404a-b579-0d64cb279888 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:49.588284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e649c5c-4f65-4e9e-a95c-0eb2d88315b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:49.588778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e649c5c-4f65-4e9e-a95c-0eb2d88315b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:49.589215 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e649c5c-4f65-4e9e-a95c-0eb2d88315b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:49.590032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e649c5c-4f65-4e9e-a95c-0eb2d88315b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:49.590499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e649c5c-4f65-4e9e-a95c-0eb2d88315b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:49.590927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e649c5c-4f65-4e9e-a95c-0eb2d88315b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:49.594077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36501482-22dc-404a-b579-0d64cb279888 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.080956 Oct 28 20:08:49.594656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 253/497] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:49 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:49.599071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ebb1de29-60e8-4dc2-9043-757c428d8dcf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:49.599673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ebb1de29-60e8-4dc2-9043-757c428d8dcf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:49.605149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb1de29-60e8-4dc2-9043-757c428d8dcf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:49.605730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb1de29-60e8-4dc2-9043-757c428d8dcf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:49.606164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb1de29-60e8-4dc2-9043-757c428d8dcf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:49.606842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb1de29-60e8-4dc2-9043-757c428d8dcf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:49.607292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb1de29-60e8-4dc2-9043-757c428d8dcf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:49.607711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb1de29-60e8-4dc2-9043-757c428d8dcf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:49.691572 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ebb1de29-60e8-4dc2-9043-757c428d8dcf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:49.699047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ebb1de29-60e8-4dc2-9043-757c428d8dcf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.103439 Oct 28 20:08:49.699595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 254/498] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:49 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:49.754260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6e649c5c-4f65-4e9e-a95c-0eb2d88315b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:49.761735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6e649c5c-4f65-4e9e-a95c-0eb2d88315b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.185111 Oct 28 20:08:49.767333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 245/499] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:49 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:50.268733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-07b509c9-3839-4526-8e50-882657cd5283 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:50.269360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-07b509c9-3839-4526-8e50-882657cd5283 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:50.271212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:50.275876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b509c9-3839-4526-8e50-882657cd5283 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:50.276357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b509c9-3839-4526-8e50-882657cd5283 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:50.276790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b509c9-3839-4526-8e50-882657cd5283 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:50.277502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b509c9-3839-4526-8e50-882657cd5283 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:50.277957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b509c9-3839-4526-8e50-882657cd5283 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:50.278385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b509c9-3839-4526-8e50-882657cd5283 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:50.408454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-07b509c9-3839-4526-8e50-882657cd5283 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:50.417388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-07b509c9-3839-4526-8e50-882657cd5283 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:50.418815 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-07b509c9-3839-4526-8e50-882657cd5283 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:50.419984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-07b509c9-3839-4526-8e50-882657cd5283 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.155325 Oct 28 20:08:50.420545 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 255/500] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:50 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:50.619322 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-557f2c94-db52-4b46-a450-1f4c6d7718fa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:50.619869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-557f2c94-db52-4b46-a450-1f4c6d7718fa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:50.626837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-557f2c94-db52-4b46-a450-1f4c6d7718fa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:50.627320 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-557f2c94-db52-4b46-a450-1f4c6d7718fa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:50.627760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-557f2c94-db52-4b46-a450-1f4c6d7718fa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:50.628453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-557f2c94-db52-4b46-a450-1f4c6d7718fa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:50.628916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-557f2c94-db52-4b46-a450-1f4c6d7718fa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:50.629363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-557f2c94-db52-4b46-a450-1f4c6d7718fa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:50.689895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-557f2c94-db52-4b46-a450-1f4c6d7718fa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:50.697643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-557f2c94-db52-4b46-a450-1f4c6d7718fa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.082191 Oct 28 20:08:50.698211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 246/501] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:50 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:50.722197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-81c60cf3-389a-4f43-9e14-9f8724636444 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:50.722813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-81c60cf3-389a-4f43-9e14-9f8724636444 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:50.729055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c60cf3-389a-4f43-9e14-9f8724636444 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:50.729583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c60cf3-389a-4f43-9e14-9f8724636444 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:50.730023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c60cf3-389a-4f43-9e14-9f8724636444 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:50.730709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c60cf3-389a-4f43-9e14-9f8724636444 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:50.731167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c60cf3-389a-4f43-9e14-9f8724636444 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:50.731593 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c60cf3-389a-4f43-9e14-9f8724636444 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:50.788701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-35a4685e-a888-4e24-bb59-9f3fa1d0d91c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:50.789376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-35a4685e-a888-4e24-bb59-9f3fa1d0d91c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:50.792130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-81c60cf3-389a-4f43-9e14-9f8724636444 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:50.795421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35a4685e-a888-4e24-bb59-9f3fa1d0d91c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:50.795968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35a4685e-a888-4e24-bb59-9f3fa1d0d91c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:50.796470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35a4685e-a888-4e24-bb59-9f3fa1d0d91c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:50.797155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35a4685e-a888-4e24-bb59-9f3fa1d0d91c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:50.797641 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35a4685e-a888-4e24-bb59-9f3fa1d0d91c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:50.798119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35a4685e-a888-4e24-bb59-9f3fa1d0d91c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:50.800218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-81c60cf3-389a-4f43-9e14-9f8724636444 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.081793 Oct 28 20:08:50.800789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 256/502] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:50 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:50.928327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-35a4685e-a888-4e24-bb59-9f3fa1d0d91c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:50.935832 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-35a4685e-a888-4e24-bb59-9f3fa1d0d91c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.150945 Oct 28 20:08:50.936391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 247/503] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:50 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:51.445935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b776f6e-318e-40e2-95cc-1dd8ab6658a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:51.446540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0b776f6e-318e-40e2-95cc-1dd8ab6658a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:51.452376 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b776f6e-318e-40e2-95cc-1dd8ab6658a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:51.452854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b776f6e-318e-40e2-95cc-1dd8ab6658a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:51.453289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b776f6e-318e-40e2-95cc-1dd8ab6658a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:51.454709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b776f6e-318e-40e2-95cc-1dd8ab6658a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:51.455166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b776f6e-318e-40e2-95cc-1dd8ab6658a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:51.455611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b776f6e-318e-40e2-95cc-1dd8ab6658a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:51.595581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0b776f6e-318e-40e2-95cc-1dd8ab6658a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:51.603883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0b776f6e-318e-40e2-95cc-1dd8ab6658a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:51.605379 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0b776f6e-318e-40e2-95cc-1dd8ab6658a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:51.606536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0b776f6e-318e-40e2-95cc-1dd8ab6658a8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1724 microversion: 2.20 time: 0.164569 Oct 28 20:08:51.607094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 257/504] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:51 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:51.720876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b0becba0-8362-4f18-a716-c7cd892e67ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:51.721540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b0becba0-8362-4f18-a716-c7cd892e67ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:51.727877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0becba0-8362-4f18-a716-c7cd892e67ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:51.728356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0becba0-8362-4f18-a716-c7cd892e67ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:51.732462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0becba0-8362-4f18-a716-c7cd892e67ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:51.732462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0becba0-8362-4f18-a716-c7cd892e67ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:51.732462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0becba0-8362-4f18-a716-c7cd892e67ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:51.732462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0becba0-8362-4f18-a716-c7cd892e67ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:51.791778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b0becba0-8362-4f18-a716-c7cd892e67ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:51.800444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b0becba0-8362-4f18-a716-c7cd892e67ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1249 microversion: 2.1 time: 0.083335 Oct 28 20:08:51.801072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 248/505] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:51 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:51.823239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58f55c7f-f46f-4d9f-b689-13b5e267d48f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:51.823901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-58f55c7f-f46f-4d9f-b689-13b5e267d48f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:51.830944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58f55c7f-f46f-4d9f-b689-13b5e267d48f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:51.831429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58f55c7f-f46f-4d9f-b689-13b5e267d48f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:51.831866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58f55c7f-f46f-4d9f-b689-13b5e267d48f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:51.832552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58f55c7f-f46f-4d9f-b689-13b5e267d48f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:51.833006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58f55c7f-f46f-4d9f-b689-13b5e267d48f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:51.833456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58f55c7f-f46f-4d9f-b689-13b5e267d48f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:51.896555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-58f55c7f-f46f-4d9f-b689-13b5e267d48f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:51.904367 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-58f55c7f-f46f-4d9f-b689-13b5e267d48f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1142 microversion: 2.1 time: 0.084754 Oct 28 20:08:51.904942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 258/506] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:51 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1142 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:51.959311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-89d5f998-8476-4ad1-a77a-57b609acc72a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:51.959859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-89d5f998-8476-4ad1-a77a-57b609acc72a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:51.966038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89d5f998-8476-4ad1-a77a-57b609acc72a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:51.966521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89d5f998-8476-4ad1-a77a-57b609acc72a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:51.966962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89d5f998-8476-4ad1-a77a-57b609acc72a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:51.967652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89d5f998-8476-4ad1-a77a-57b609acc72a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:51.968105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89d5f998-8476-4ad1-a77a-57b609acc72a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:51.968531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89d5f998-8476-4ad1-a77a-57b609acc72a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:52.098920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-89d5f998-8476-4ad1-a77a-57b609acc72a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:52.106505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-89d5f998-8476-4ad1-a77a-57b609acc72a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.151182 Oct 28 20:08:52.107063 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 249/507] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:51 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:52.633195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-390dac5f-0ebc-49dd-95d1-dc2b50d8d146 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:52.633752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-390dac5f-0ebc-49dd-95d1-dc2b50d8d146 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:52.639599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-390dac5f-0ebc-49dd-95d1-dc2b50d8d146 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:52.640082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-390dac5f-0ebc-49dd-95d1-dc2b50d8d146 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:52.640518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-390dac5f-0ebc-49dd-95d1-dc2b50d8d146 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:52.641202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-390dac5f-0ebc-49dd-95d1-dc2b50d8d146 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:52.641930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-390dac5f-0ebc-49dd-95d1-dc2b50d8d146 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:52.642364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-390dac5f-0ebc-49dd-95d1-dc2b50d8d146 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:52.777152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-390dac5f-0ebc-49dd-95d1-dc2b50d8d146 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:52.785722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-390dac5f-0ebc-49dd-95d1-dc2b50d8d146 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:52.787147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-390dac5f-0ebc-49dd-95d1-dc2b50d8d146 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:52.788323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-390dac5f-0ebc-49dd-95d1-dc2b50d8d146 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1745 microversion: 2.20 time: 0.159113 Oct 28 20:08:52.788870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 259/508] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:52 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:52.822775 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca743b46-6200-4480-951b-e3b28ae42909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:52.823380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ca743b46-6200-4480-951b-e3b28ae42909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:52.825653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:52.830705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca743b46-6200-4480-951b-e3b28ae42909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:52.833480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca743b46-6200-4480-951b-e3b28ae42909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:52.833480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca743b46-6200-4480-951b-e3b28ae42909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:52.833480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca743b46-6200-4480-951b-e3b28ae42909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:52.833480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca743b46-6200-4480-951b-e3b28ae42909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:52.833877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca743b46-6200-4480-951b-e3b28ae42909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:52.897098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ca743b46-6200-4480-951b-e3b28ae42909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:52.905080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ca743b46-6200-4480-951b-e3b28ae42909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1241 microversion: 2.1 time: 0.086015 Oct 28 20:08:52.905678 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 250/509] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:52 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:52.931761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-77da4ef7-bc03-4167-a876-bdae4dc3332e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:52.939993 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-77da4ef7-bc03-4167-a876-bdae4dc3332e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:52.946581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77da4ef7-bc03-4167-a876-bdae4dc3332e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:52.947071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77da4ef7-bc03-4167-a876-bdae4dc3332e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:52.947509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77da4ef7-bc03-4167-a876-bdae4dc3332e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:52.948210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77da4ef7-bc03-4167-a876-bdae4dc3332e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:52.948665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77da4ef7-bc03-4167-a876-bdae4dc3332e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:52.950088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77da4ef7-bc03-4167-a876-bdae4dc3332e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:52.973538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:53.020055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-77da4ef7-bc03-4167-a876-bdae4dc3332e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:53.028029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-77da4ef7-bc03-4167-a876-bdae4dc3332e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1134 microversion: 2.1 time: 0.105603 Oct 28 20:08:53.035936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 260/510] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:52 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1134 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:53.129829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f05eeb40-c479-49e4-8cf1-d09bc6ec3ac8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:53.130449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f05eeb40-c479-49e4-8cf1-d09bc6ec3ac8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:53.136296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f05eeb40-c479-49e4-8cf1-d09bc6ec3ac8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:53.136777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f05eeb40-c479-49e4-8cf1-d09bc6ec3ac8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:53.137266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f05eeb40-c479-49e4-8cf1-d09bc6ec3ac8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:53.137983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f05eeb40-c479-49e4-8cf1-d09bc6ec3ac8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:53.138435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f05eeb40-c479-49e4-8cf1-d09bc6ec3ac8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:53.138858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f05eeb40-c479-49e4-8cf1-d09bc6ec3ac8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:53.277915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f05eeb40-c479-49e4-8cf1-d09bc6ec3ac8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:53.281143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f05eeb40-c479-49e4-8cf1-d09bc6ec3ac8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.155445 Oct 28 20:08:53.286730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 251/511] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:53 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:53.389182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d8d982d9-941d-41ef-855e-258a62a8f23e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:53.395983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8d982d9-941d-41ef-855e-258a62a8f23e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:53.396466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8d982d9-941d-41ef-855e-258a62a8f23e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:53.396902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8d982d9-941d-41ef-855e-258a62a8f23e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:53.455723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d8d982d9-941d-41ef-855e-258a62a8f23e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Going to try to stop instance {{(pid=119407) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 20:08:53.635261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d8d982d9-941d-41ef-855e-258a62a8f23e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "POST /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/action" status: 202 len: 0 microversion: 2.1 time: 0.249664 Oct 28 20:08:53.635872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 261/512] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Oct 28 20:08:53 2022] POST /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:08:53.645053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-58ad4b4c-2c92-40e1-8339-32873ac064ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:53.645714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-58ad4b4c-2c92-40e1-8339-32873ac064ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:53.651739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58ad4b4c-2c92-40e1-8339-32873ac064ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:53.652229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58ad4b4c-2c92-40e1-8339-32873ac064ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:53.652669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58ad4b4c-2c92-40e1-8339-32873ac064ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:53.653389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58ad4b4c-2c92-40e1-8339-32873ac064ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:53.653852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58ad4b4c-2c92-40e1-8339-32873ac064ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:53.654284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58ad4b4c-2c92-40e1-8339-32873ac064ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:53.784901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-58ad4b4c-2c92-40e1-8339-32873ac064ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:53.793197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-58ad4b4c-2c92-40e1-8339-32873ac064ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1724 microversion: 2.1 time: 0.153055 Oct 28 20:08:53.793804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 252/513] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:53 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:53.815317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ff43b20c-b556-4698-9724-e522db2f14bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:53.816004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ff43b20c-b556-4698-9724-e522db2f14bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:53.822086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff43b20c-b556-4698-9724-e522db2f14bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:53.822566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff43b20c-b556-4698-9724-e522db2f14bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:53.822996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff43b20c-b556-4698-9724-e522db2f14bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:53.823679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff43b20c-b556-4698-9724-e522db2f14bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:53.824128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff43b20c-b556-4698-9724-e522db2f14bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:53.824582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff43b20c-b556-4698-9724-e522db2f14bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:53.935845 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3c33065a-3620-483b-b9ec-a2269d73a0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:53.936580 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3c33065a-3620-483b-b9ec-a2269d73a0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:53.943818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c33065a-3620-483b-b9ec-a2269d73a0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:53.944304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c33065a-3620-483b-b9ec-a2269d73a0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:53.944981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c33065a-3620-483b-b9ec-a2269d73a0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:53.945700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c33065a-3620-483b-b9ec-a2269d73a0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:53.946151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c33065a-3620-483b-b9ec-a2269d73a0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:53.946569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c33065a-3620-483b-b9ec-a2269d73a0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:53.955284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ff43b20c-b556-4698-9724-e522db2f14bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:53.963772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ff43b20c-b556-4698-9724-e522db2f14bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:53.965211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ff43b20c-b556-4698-9724-e522db2f14bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:53.966447 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ff43b20c-b556-4698-9724-e522db2f14bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1745 microversion: 2.20 time: 0.156029 Oct 28 20:08:53.967001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 262/514] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:53 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:54.010207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3c33065a-3620-483b-b9ec-a2269d73a0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:54.018420 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3c33065a-3620-483b-b9ec-a2269d73a0c4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1241 microversion: 2.1 time: 0.086449 Oct 28 20:08:54.018978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 253/515] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:53 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:54.052392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-770a09b4-0abb-403c-b8f9-424ea1ffd909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:54.053010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-770a09b4-0abb-403c-b8f9-424ea1ffd909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:54.058956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-770a09b4-0abb-403c-b8f9-424ea1ffd909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:54.059440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-770a09b4-0abb-403c-b8f9-424ea1ffd909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:54.059879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-770a09b4-0abb-403c-b8f9-424ea1ffd909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:54.060570 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-770a09b4-0abb-403c-b8f9-424ea1ffd909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:54.061027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-770a09b4-0abb-403c-b8f9-424ea1ffd909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:54.061497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-770a09b4-0abb-403c-b8f9-424ea1ffd909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:54.122082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-770a09b4-0abb-403c-b8f9-424ea1ffd909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:54.129930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-770a09b4-0abb-403c-b8f9-424ea1ffd909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1134 microversion: 2.1 time: 0.081633 Oct 28 20:08:54.130528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 263/516] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:54 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1134 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:54.304218 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01fcedd0-57c0-4bad-9995-5f2c6b920bd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:54.306906 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-01fcedd0-57c0-4bad-9995-5f2c6b920bd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:54.311669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01fcedd0-57c0-4bad-9995-5f2c6b920bd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:54.312220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01fcedd0-57c0-4bad-9995-5f2c6b920bd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:54.312764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01fcedd0-57c0-4bad-9995-5f2c6b920bd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:54.313844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01fcedd0-57c0-4bad-9995-5f2c6b920bd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:54.314376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01fcedd0-57c0-4bad-9995-5f2c6b920bd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:54.314910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01fcedd0-57c0-4bad-9995-5f2c6b920bd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:54.470912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-01fcedd0-57c0-4bad-9995-5f2c6b920bd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:54.478783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-01fcedd0-57c0-4bad-9995-5f2c6b920bd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.178667 Oct 28 20:08:54.479341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 254/517] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:54 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:54.816655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-347b4b65-92c0-407b-a2da-1ffcd95ca2f9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:54.817195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-347b4b65-92c0-407b-a2da-1ffcd95ca2f9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:54.823204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347b4b65-92c0-407b-a2da-1ffcd95ca2f9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:54.823689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347b4b65-92c0-407b-a2da-1ffcd95ca2f9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:54.824144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347b4b65-92c0-407b-a2da-1ffcd95ca2f9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:54.824816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347b4b65-92c0-407b-a2da-1ffcd95ca2f9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:54.825275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347b4b65-92c0-407b-a2da-1ffcd95ca2f9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:54.825725 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347b4b65-92c0-407b-a2da-1ffcd95ca2f9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:54.957920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-347b4b65-92c0-407b-a2da-1ffcd95ca2f9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:54.966269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-347b4b65-92c0-407b-a2da-1ffcd95ca2f9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1724 microversion: 2.1 time: 0.153819 Oct 28 20:08:54.966831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 264/518] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:54 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:54.993885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-02aa5dc5-9d98-4fed-b225-324fc189a0af tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:54.994535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-02aa5dc5-9d98-4fed-b225-324fc189a0af tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:55.000589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa5dc5-9d98-4fed-b225-324fc189a0af tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:55.001689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa5dc5-9d98-4fed-b225-324fc189a0af tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:55.002131 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa5dc5-9d98-4fed-b225-324fc189a0af tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:55.002825 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa5dc5-9d98-4fed-b225-324fc189a0af tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:55.003285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa5dc5-9d98-4fed-b225-324fc189a0af tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:55.003714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa5dc5-9d98-4fed-b225-324fc189a0af tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:55.041362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-852fa2b6-6da3-4937-bd72-06060c855a8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:55.041985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-852fa2b6-6da3-4937-bd72-06060c855a8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:55.048123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-852fa2b6-6da3-4937-bd72-06060c855a8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:55.048723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-852fa2b6-6da3-4937-bd72-06060c855a8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:55.049172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-852fa2b6-6da3-4937-bd72-06060c855a8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:55.049910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-852fa2b6-6da3-4937-bd72-06060c855a8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:55.050372 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-852fa2b6-6da3-4937-bd72-06060c855a8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:55.050802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-852fa2b6-6da3-4937-bd72-06060c855a8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:55.121311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-852fa2b6-6da3-4937-bd72-06060c855a8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:55.129531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-852fa2b6-6da3-4937-bd72-06060c855a8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1241 microversion: 2.1 time: 0.091891 Oct 28 20:08:55.130104 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 265/519] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:55 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:55.151289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-02aa5dc5-9d98-4fed-b225-324fc189a0af tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:55.153234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-abbe4faa-ec5b-4e55-a0cf-293b03e43b04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:55.153926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-abbe4faa-ec5b-4e55-a0cf-293b03e43b04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:55.160014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-02aa5dc5-9d98-4fed-b225-324fc189a0af tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:55.160467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abbe4faa-ec5b-4e55-a0cf-293b03e43b04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:55.161076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abbe4faa-ec5b-4e55-a0cf-293b03e43b04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:55.161483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-02aa5dc5-9d98-4fed-b225-324fc189a0af tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:55.161728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abbe4faa-ec5b-4e55-a0cf-293b03e43b04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:55.162438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abbe4faa-ec5b-4e55-a0cf-293b03e43b04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:55.162647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-02aa5dc5-9d98-4fed-b225-324fc189a0af tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1745 microversion: 2.20 time: 0.172982 Oct 28 20:08:55.162895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abbe4faa-ec5b-4e55-a0cf-293b03e43b04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:55.163182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 255/520] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:54 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:55.163326 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abbe4faa-ec5b-4e55-a0cf-293b03e43b04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:55.225345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-abbe4faa-ec5b-4e55-a0cf-293b03e43b04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:55.233973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-abbe4faa-ec5b-4e55-a0cf-293b03e43b04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1134 microversion: 2.1 time: 0.084605 Oct 28 20:08:55.234555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 266/521] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:55 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1134 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:55.503590 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a6cce0b-fbba-49ad-a33e-8795ef89fbee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:55.504304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3a6cce0b-fbba-49ad-a33e-8795ef89fbee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:55.510463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6cce0b-fbba-49ad-a33e-8795ef89fbee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:55.511356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6cce0b-fbba-49ad-a33e-8795ef89fbee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:55.511827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6cce0b-fbba-49ad-a33e-8795ef89fbee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:55.512521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6cce0b-fbba-49ad-a33e-8795ef89fbee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:55.513071 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6cce0b-fbba-49ad-a33e-8795ef89fbee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:55.513527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6cce0b-fbba-49ad-a33e-8795ef89fbee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:55.652915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a6cce0b-fbba-49ad-a33e-8795ef89fbee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:55.661405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a6cce0b-fbba-49ad-a33e-8795ef89fbee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.162367 Oct 28 20:08:55.661986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 256/522] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:55 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:55.991064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-abf59362-016c-417b-a920-fb538240f67c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:55.992078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-abf59362-016c-417b-a920-fb538240f67c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:55.998449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abf59362-016c-417b-a920-fb538240f67c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:55.999251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abf59362-016c-417b-a920-fb538240f67c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:55.999735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abf59362-016c-417b-a920-fb538240f67c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:56.001456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abf59362-016c-417b-a920-fb538240f67c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:56.001591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abf59362-016c-417b-a920-fb538240f67c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:56.002072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abf59362-016c-417b-a920-fb538240f67c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:56.148511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-abf59362-016c-417b-a920-fb538240f67c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:56.152866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b0bbf07-6a9f-4b30-87aa-0d72ec17b3e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:56.158215 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6b0bbf07-6a9f-4b30-87aa-0d72ec17b3e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:56.173891 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-abf59362-016c-417b-a920-fb538240f67c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1724 microversion: 2.1 time: 0.185321 Oct 28 20:08:56.175219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b0bbf07-6a9f-4b30-87aa-0d72ec17b3e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:56.175731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b0bbf07-6a9f-4b30-87aa-0d72ec17b3e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:56.176983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b0bbf07-6a9f-4b30-87aa-0d72ec17b3e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:56.176983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b0bbf07-6a9f-4b30-87aa-0d72ec17b3e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:56.177829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b0bbf07-6a9f-4b30-87aa-0d72ec17b3e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:56.177961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b0bbf07-6a9f-4b30-87aa-0d72ec17b3e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:56.180953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:56.183563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 267/523] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:55 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:56.189401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-775037e0-c76f-4e6a-9e92-8c4966661df9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:56.190204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-775037e0-c76f-4e6a-9e92-8c4966661df9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:56.203010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-775037e0-c76f-4e6a-9e92-8c4966661df9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:56.203751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-775037e0-c76f-4e6a-9e92-8c4966661df9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:56.205022 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-775037e0-c76f-4e6a-9e92-8c4966661df9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:56.207621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-775037e0-c76f-4e6a-9e92-8c4966661df9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:56.208155 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-775037e0-c76f-4e6a-9e92-8c4966661df9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:56.208593 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-775037e0-c76f-4e6a-9e92-8c4966661df9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:56.272029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6b0bbf07-6a9f-4b30-87aa-0d72ec17b3e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:56.293930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6b0bbf07-6a9f-4b30-87aa-0d72ec17b3e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1297 microversion: 2.1 time: 0.144870 Oct 28 20:08:56.294834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 257/524] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:56 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1297 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:56.304354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-27b66af5-4c84-4440-a3bc-8663a8237a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:56.305361 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-27b66af5-4c84-4440-a3bc-8663a8237a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:56.319663 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27b66af5-4c84-4440-a3bc-8663a8237a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:56.326488 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27b66af5-4c84-4440-a3bc-8663a8237a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:56.327535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27b66af5-4c84-4440-a3bc-8663a8237a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:56.328516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27b66af5-4c84-4440-a3bc-8663a8237a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:56.329827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27b66af5-4c84-4440-a3bc-8663a8237a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:56.330588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27b66af5-4c84-4440-a3bc-8663a8237a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:56.443769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-27b66af5-4c84-4440-a3bc-8663a8237a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:56.452363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-27b66af5-4c84-4440-a3bc-8663a8237a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1190 microversion: 2.1 time: 0.156229 Oct 28 20:08:56.457241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 258/525] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:56 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1190 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:56.561512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-775037e0-c76f-4e6a-9e92-8c4966661df9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:56.604197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-775037e0-c76f-4e6a-9e92-8c4966661df9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:56.606326 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-775037e0-c76f-4e6a-9e92-8c4966661df9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:56.609921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-775037e0-c76f-4e6a-9e92-8c4966661df9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1740 microversion: 2.20 time: 0.423049 Oct 28 20:08:56.611044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 268/526] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:56 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1740 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:56.686251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b217b749-3c61-4729-a040-4fa713a27046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:56.695991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b217b749-3c61-4729-a040-4fa713a27046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:56.705032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b217b749-3c61-4729-a040-4fa713a27046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:56.707333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b217b749-3c61-4729-a040-4fa713a27046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:56.708088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b217b749-3c61-4729-a040-4fa713a27046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:56.709203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b217b749-3c61-4729-a040-4fa713a27046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:56.710418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b217b749-3c61-4729-a040-4fa713a27046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:56.711226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b217b749-3c61-4729-a040-4fa713a27046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:56.878789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-a27d4bce-d525-48f1-832c-847b4051008e req-f3f4c880-2e44-425b-a0b9-491cf6e23a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7582188f-bfab-4218-9104-9fb384141c57", "name": "network-vif-plugged", "status": "completed", "tag": "ade7b021-b99e-4c55-93bb-537d28c2a53d"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:56.908162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a27d4bce-d525-48f1-832c-847b4051008e req-f3f4c880-2e44-425b-a0b9-491cf6e23a27 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:56.908651 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a27d4bce-d525-48f1-832c-847b4051008e req-f3f4c880-2e44-425b-a0b9-491cf6e23a27 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:56.909187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a27d4bce-d525-48f1-832c-847b4051008e req-f3f4c880-2e44-425b-a0b9-491cf6e23a27 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:56.934221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-a27d4bce-d525-48f1-832c-847b4051008e req-f3f4c880-2e44-425b-a0b9-491cf6e23a27 service nova] Creating event network-vif-plugged:ade7b021-b99e-4c55-93bb-537d28c2a53d for instance 7582188f-bfab-4218-9104-9fb384141c57 on hv-cinder-86236 Oct 28 20:08:56.942749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-a27d4bce-d525-48f1-832c-847b4051008e req-f3f4c880-2e44-425b-a0b9-491cf6e23a27 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069186 Oct 28 20:08:56.947096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 269/527] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:08:56.959655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b217b749-3c61-4729-a040-4fa713a27046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:56.973971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b217b749-3c61-4729-a040-4fa713a27046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.292035 Oct 28 20:08:56.974896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 259/528] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:56 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:57.208267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cec0da65-f01b-45bf-836f-329574a159fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:57.210184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cec0da65-f01b-45bf-836f-329574a159fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:57.218189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec0da65-f01b-45bf-836f-329574a159fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:57.218769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec0da65-f01b-45bf-836f-329574a159fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:57.220100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec0da65-f01b-45bf-836f-329574a159fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:57.221042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec0da65-f01b-45bf-836f-329574a159fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:57.222117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec0da65-f01b-45bf-836f-329574a159fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:57.222716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec0da65-f01b-45bf-836f-329574a159fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:57.327094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fcfd85f5-9958-4129-8cb3-3a18b103c310 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:57.328384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fcfd85f5-9958-4129-8cb3-3a18b103c310 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:57.336118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcfd85f5-9958-4129-8cb3-3a18b103c310 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:57.337063 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcfd85f5-9958-4129-8cb3-3a18b103c310 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:57.337707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcfd85f5-9958-4129-8cb3-3a18b103c310 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:57.338655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcfd85f5-9958-4129-8cb3-3a18b103c310 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:57.339267 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcfd85f5-9958-4129-8cb3-3a18b103c310 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:57.339938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcfd85f5-9958-4129-8cb3-3a18b103c310 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:57.425168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fcfd85f5-9958-4129-8cb3-3a18b103c310 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:57.440842 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fcfd85f5-9958-4129-8cb3-3a18b103c310 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1303 microversion: 2.1 time: 0.120257 Oct 28 20:08:57.457644 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 260/529] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:57 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1303 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:57.483726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-354015d3-dc07-4ce8-84de-0ef59be62813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:57.483726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-354015d3-dc07-4ce8-84de-0ef59be62813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:57.489480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cec0da65-f01b-45bf-836f-329574a159fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:57.490057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-354015d3-dc07-4ce8-84de-0ef59be62813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:57.490542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-354015d3-dc07-4ce8-84de-0ef59be62813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:57.490978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-354015d3-dc07-4ce8-84de-0ef59be62813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:57.491672 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-354015d3-dc07-4ce8-84de-0ef59be62813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:57.494296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-354015d3-dc07-4ce8-84de-0ef59be62813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:57.494296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-354015d3-dc07-4ce8-84de-0ef59be62813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:57.517477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cec0da65-f01b-45bf-836f-329574a159fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1724 microversion: 2.1 time: 0.311807 Oct 28 20:08:57.518101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 270/530] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:57 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1724 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:57.644550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e943e36d-0c4d-4c4b-911d-5aba390a518c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:57.645486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e943e36d-0c4d-4c4b-911d-5aba390a518c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:57.673835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e943e36d-0c4d-4c4b-911d-5aba390a518c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:57.682788 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-354015d3-dc07-4ce8-84de-0ef59be62813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:57.685977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e943e36d-0c4d-4c4b-911d-5aba390a518c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:57.689208 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e943e36d-0c4d-4c4b-911d-5aba390a518c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:57.692542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e943e36d-0c4d-4c4b-911d-5aba390a518c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:57.694139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e943e36d-0c4d-4c4b-911d-5aba390a518c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:57.694825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e943e36d-0c4d-4c4b-911d-5aba390a518c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:57.707093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-354015d3-dc07-4ce8-84de-0ef59be62813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1190 microversion: 2.1 time: 0.227983 Oct 28 20:08:57.708783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 261/531] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:57 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1190 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:57.933075 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e943e36d-0c4d-4c4b-911d-5aba390a518c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:57.943418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e943e36d-0c4d-4c4b-911d-5aba390a518c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:57.945846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e943e36d-0c4d-4c4b-911d-5aba390a518c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:57.948903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e943e36d-0c4d-4c4b-911d-5aba390a518c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1740 microversion: 2.20 time: 0.308784 Oct 28 20:08:57.949875 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 271/532] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:57 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1740 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:57.998190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d960c2c8-ea87-42e9-8a9f-03ece59f4707 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:58.001585 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d960c2c8-ea87-42e9-8a9f-03ece59f4707 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:58.007846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d960c2c8-ea87-42e9-8a9f-03ece59f4707 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:58.008683 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d960c2c8-ea87-42e9-8a9f-03ece59f4707 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:58.009242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d960c2c8-ea87-42e9-8a9f-03ece59f4707 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:58.015697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d960c2c8-ea87-42e9-8a9f-03ece59f4707 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:58.017010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d960c2c8-ea87-42e9-8a9f-03ece59f4707 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:58.017842 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d960c2c8-ea87-42e9-8a9f-03ece59f4707 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:58.206278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d960c2c8-ea87-42e9-8a9f-03ece59f4707 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:58.215534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d960c2c8-ea87-42e9-8a9f-03ece59f4707 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.221248 Oct 28 20:08:58.232713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 262/533] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:57 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:08:58.469254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b7fc394d-4aa2-4b32-9199-256a9ccf6be3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:58.471561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b7fc394d-4aa2-4b32-9199-256a9ccf6be3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:58.483601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7fc394d-4aa2-4b32-9199-256a9ccf6be3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:58.494763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7fc394d-4aa2-4b32-9199-256a9ccf6be3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:58.494763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7fc394d-4aa2-4b32-9199-256a9ccf6be3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:58.494763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7fc394d-4aa2-4b32-9199-256a9ccf6be3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:58.494763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7fc394d-4aa2-4b32-9199-256a9ccf6be3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:58.495200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7fc394d-4aa2-4b32-9199-256a9ccf6be3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:58.540569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-68c92cbf-2258-44aa-82ae-20d03cfe33f0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:58.542512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-68c92cbf-2258-44aa-82ae-20d03cfe33f0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:58.550681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68c92cbf-2258-44aa-82ae-20d03cfe33f0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:58.552126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68c92cbf-2258-44aa-82ae-20d03cfe33f0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:58.552126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68c92cbf-2258-44aa-82ae-20d03cfe33f0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:58.553639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68c92cbf-2258-44aa-82ae-20d03cfe33f0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:58.554360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68c92cbf-2258-44aa-82ae-20d03cfe33f0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:58.555032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68c92cbf-2258-44aa-82ae-20d03cfe33f0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:58.739347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b7fc394d-4aa2-4b32-9199-256a9ccf6be3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:58.749121 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b7fc394d-4aa2-4b32-9199-256a9ccf6be3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1371 microversion: 2.1 time: 0.284498 Oct 28 20:08:58.762837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 272/534] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:58 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1371 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:58.777454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b623bf9c-4b9a-4ee8-b6fa-c242c46acb2b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:58.781045 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b623bf9c-4b9a-4ee8-b6fa-c242c46acb2b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:58.794610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b623bf9c-4b9a-4ee8-b6fa-c242c46acb2b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:58.796998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b623bf9c-4b9a-4ee8-b6fa-c242c46acb2b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:58.799681 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b623bf9c-4b9a-4ee8-b6fa-c242c46acb2b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:58.800696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b623bf9c-4b9a-4ee8-b6fa-c242c46acb2b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:58.801335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b623bf9c-4b9a-4ee8-b6fa-c242c46acb2b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:58.801963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b623bf9c-4b9a-4ee8-b6fa-c242c46acb2b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:58.868734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-68c92cbf-2258-44aa-82ae-20d03cfe33f0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:58.883482 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-68c92cbf-2258-44aa-82ae-20d03cfe33f0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1724 microversion: 2.1 time: 0.347105 Oct 28 20:08:58.884938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 263/535] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:58 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:58.945225 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b623bf9c-4b9a-4ee8-b6fa-c242c46acb2b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:58.955409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b623bf9c-4b9a-4ee8-b6fa-c242c46acb2b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1208 microversion: 2.1 time: 0.190889 Oct 28 20:08:58.967518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 273/536] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:58 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1208 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:58.978550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3cba2a28-d0e5-4834-848e-1522c8de3fad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:58.979271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3cba2a28-d0e5-4834-848e-1522c8de3fad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:58.985814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cba2a28-d0e5-4834-848e-1522c8de3fad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:58.986669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cba2a28-d0e5-4834-848e-1522c8de3fad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:58.991894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cba2a28-d0e5-4834-848e-1522c8de3fad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:58.992827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cba2a28-d0e5-4834-848e-1522c8de3fad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:58.994323 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cba2a28-d0e5-4834-848e-1522c8de3fad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:58.996143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cba2a28-d0e5-4834-848e-1522c8de3fad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:58.997482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-4b636e98-23d0-4798-bc02-9984bc1d2593 req-9b8964fa-7015-46ee-bc9a-7e965b7abcf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2", "name": "network-vif-plugged", "status": "completed", "tag": "85e3fd0b-83fb-48bf-8cd7-071823c4c38c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:59.020989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4b636e98-23d0-4798-bc02-9984bc1d2593 req-9b8964fa-7015-46ee-bc9a-7e965b7abcf4 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:59.021509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4b636e98-23d0-4798-bc02-9984bc1d2593 req-9b8964fa-7015-46ee-bc9a-7e965b7abcf4 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:59.025730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4b636e98-23d0-4798-bc02-9984bc1d2593 req-9b8964fa-7015-46ee-bc9a-7e965b7abcf4 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:59.050553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-4b636e98-23d0-4798-bc02-9984bc1d2593 req-9b8964fa-7015-46ee-bc9a-7e965b7abcf4 service nova] Creating event network-vif-plugged:85e3fd0b-83fb-48bf-8cd7-071823c4c38c for instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 on hv-cinder-86236 Oct 28 20:08:59.060217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-4b636e98-23d0-4798-bc02-9984bc1d2593 req-9b8964fa-7015-46ee-bc9a-7e965b7abcf4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071554 Oct 28 20:08:59.066675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 274/537] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:08:59.202126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3cba2a28-d0e5-4834-848e-1522c8de3fad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:59.214454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3cba2a28-d0e5-4834-848e-1522c8de3fad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:59.216480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3cba2a28-d0e5-4834-848e-1522c8de3fad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:59.218078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3cba2a28-d0e5-4834-848e-1522c8de3fad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1740 microversion: 2.20 time: 0.245487 Oct 28 20:08:59.230034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 264/538] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:08:58 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:08:59.241674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-06fe7e48-6223-4a72-8a14-4d4b9b3b7d3d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:59.242507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-06fe7e48-6223-4a72-8a14-4d4b9b3b7d3d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:59.250137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06fe7e48-6223-4a72-8a14-4d4b9b3b7d3d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:59.251728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06fe7e48-6223-4a72-8a14-4d4b9b3b7d3d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:59.252393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06fe7e48-6223-4a72-8a14-4d4b9b3b7d3d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:59.253428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06fe7e48-6223-4a72-8a14-4d4b9b3b7d3d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:59.254124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06fe7e48-6223-4a72-8a14-4d4b9b3b7d3d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:59.267757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06fe7e48-6223-4a72-8a14-4d4b9b3b7d3d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:59.488619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-06fe7e48-6223-4a72-8a14-4d4b9b3b7d3d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:59.497748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-06fe7e48-6223-4a72-8a14-4d4b9b3b7d3d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.262817 Oct 28 20:08:59.498995 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 275/539] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:59 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:59.777339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1153d46d-08df-4df0-a90a-179f92095add tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:59.778400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1153d46d-08df-4df0-a90a-179f92095add tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:59.786427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1153d46d-08df-4df0-a90a-179f92095add tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:59.787306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1153d46d-08df-4df0-a90a-179f92095add tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:59.787981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1153d46d-08df-4df0-a90a-179f92095add tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:59.788920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1153d46d-08df-4df0-a90a-179f92095add tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:59.789484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1153d46d-08df-4df0-a90a-179f92095add tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:59.789979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1153d46d-08df-4df0-a90a-179f92095add tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:59.876473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ed840708-6b8b-4fc3-9ffc-bd7d32addd08 req-3242efe7-7464-4d99-904b-cc4a91e5b4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf57f68e-5160-4fec-98e7-a8f9f9480b72", "tag": "eb535d9c-e24b-43d0-b8b6-bf1d7e7de721"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:59.893582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ed840708-6b8b-4fc3-9ffc-bd7d32addd08 req-3242efe7-7464-4d99-904b-cc4a91e5b4e3 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:59.894466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ed840708-6b8b-4fc3-9ffc-bd7d32addd08 req-3242efe7-7464-4d99-904b-cc4a91e5b4e3 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:59.895048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ed840708-6b8b-4fc3-9ffc-bd7d32addd08 req-3242efe7-7464-4d99-904b-cc4a91e5b4e3 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:59.911809 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ed840708-6b8b-4fc3-9ffc-bd7d32addd08 req-3242efe7-7464-4d99-904b-cc4a91e5b4e3 service nova] Creating event network-changed:eb535d9c-e24b-43d0-b8b6-bf1d7e7de721 for instance cf57f68e-5160-4fec-98e7-a8f9f9480b72 on hv-cinder-86236 Oct 28 20:08:59.918140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ed840708-6b8b-4fc3-9ffc-bd7d32addd08 req-3242efe7-7464-4d99-904b-cc4a91e5b4e3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047082 Oct 28 20:08:59.920692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 276/540] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:08:59.939777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe9a9f0f-668e-4421-b012-b4a471498b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:59.941624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fe9a9f0f-668e-4421-b012-b4a471498b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:59.955689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe9a9f0f-668e-4421-b012-b4a471498b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:59.956423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe9a9f0f-668e-4421-b012-b4a471498b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:59.957020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe9a9f0f-668e-4421-b012-b4a471498b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:59.958889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe9a9f0f-668e-4421-b012-b4a471498b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:59.959489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe9a9f0f-668e-4421-b012-b4a471498b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:59.960559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe9a9f0f-668e-4421-b012-b4a471498b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:00.070318 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1153d46d-08df-4df0-a90a-179f92095add tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:00.091478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1153d46d-08df-4df0-a90a-179f92095add tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1371 microversion: 2.1 time: 0.317984 Oct 28 20:09:00.093536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 265/541] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:59 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:00.109281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eb0dba2c-5098-413a-94c2-2338a318ed9a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:00.109953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eb0dba2c-5098-413a-94c2-2338a318ed9a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:00.122397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0dba2c-5098-413a-94c2-2338a318ed9a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:00.122874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0dba2c-5098-413a-94c2-2338a318ed9a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:00.127015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0dba2c-5098-413a-94c2-2338a318ed9a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:00.127771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0dba2c-5098-413a-94c2-2338a318ed9a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:00.128235 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0dba2c-5098-413a-94c2-2338a318ed9a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:00.129990 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0dba2c-5098-413a-94c2-2338a318ed9a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:00.273945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fe9a9f0f-668e-4421-b012-b4a471498b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:00.285063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fe9a9f0f-668e-4421-b012-b4a471498b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1724 microversion: 2.1 time: 0.363145 Oct 28 20:09:00.286235 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 277/542] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:59 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1724 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:00.294501 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5e4f869e-23ec-4c57-ab11-3eb85141c4be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:00.295352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5e4f869e-23ec-4c57-ab11-3eb85141c4be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:00.312585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e4f869e-23ec-4c57-ab11-3eb85141c4be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:00.314534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e4f869e-23ec-4c57-ab11-3eb85141c4be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:00.315243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e4f869e-23ec-4c57-ab11-3eb85141c4be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:00.316229 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e4f869e-23ec-4c57-ab11-3eb85141c4be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:00.316880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e4f869e-23ec-4c57-ab11-3eb85141c4be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:00.317506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e4f869e-23ec-4c57-ab11-3eb85141c4be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:00.324536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:00.359373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-eb0dba2c-5098-413a-94c2-2338a318ed9a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:00.368613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eb0dba2c-5098-413a-94c2-2338a318ed9a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.273486 Oct 28 20:09:00.373962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 266/543] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:00 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:00.483613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5e4f869e-23ec-4c57-ab11-3eb85141c4be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:00.492460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5e4f869e-23ec-4c57-ab11-3eb85141c4be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:00.493953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5e4f869e-23ec-4c57-ab11-3eb85141c4be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:00.497161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5e4f869e-23ec-4c57-ab11-3eb85141c4be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1740 microversion: 2.20 time: 0.208646 Oct 28 20:09:00.497963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 278/544] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:00 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:00.532143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0546bbbc-4099-4932-ba14-7d115b8e1553 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:00.533020 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0546bbbc-4099-4932-ba14-7d115b8e1553 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:00.541225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0546bbbc-4099-4932-ba14-7d115b8e1553 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:00.543722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0546bbbc-4099-4932-ba14-7d115b8e1553 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:00.543722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0546bbbc-4099-4932-ba14-7d115b8e1553 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:00.543722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0546bbbc-4099-4932-ba14-7d115b8e1553 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:00.543722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0546bbbc-4099-4932-ba14-7d115b8e1553 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:00.544028 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0546bbbc-4099-4932-ba14-7d115b8e1553 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:00.718613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0546bbbc-4099-4932-ba14-7d115b8e1553 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:00.730894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0546bbbc-4099-4932-ba14-7d115b8e1553 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1367 microversion: 2.1 time: 0.210803 Oct 28 20:09:00.731490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 267/545] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:00 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:01.122663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3653b5d8-e7c2-4a98-8b24-30e145eebfc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:01.123272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3653b5d8-e7c2-4a98-8b24-30e145eebfc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:01.129773 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3653b5d8-e7c2-4a98-8b24-30e145eebfc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:01.130250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3653b5d8-e7c2-4a98-8b24-30e145eebfc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:01.130683 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3653b5d8-e7c2-4a98-8b24-30e145eebfc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:01.131367 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3653b5d8-e7c2-4a98-8b24-30e145eebfc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:01.131826 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3653b5d8-e7c2-4a98-8b24-30e145eebfc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:01.132245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3653b5d8-e7c2-4a98-8b24-30e145eebfc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:01.276958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3653b5d8-e7c2-4a98-8b24-30e145eebfc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:01.286047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3653b5d8-e7c2-4a98-8b24-30e145eebfc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1371 microversion: 2.1 time: 0.167478 Oct 28 20:09:01.286979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 279/546] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:01 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:01.318308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e8fde20c-396f-4920-a879-ee9a3dbaa561 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:01.319750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e8fde20c-396f-4920-a879-ee9a3dbaa561 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:01.326797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8fde20c-396f-4920-a879-ee9a3dbaa561 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:01.332769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8fde20c-396f-4920-a879-ee9a3dbaa561 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:01.332769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8fde20c-396f-4920-a879-ee9a3dbaa561 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:01.332769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8fde20c-396f-4920-a879-ee9a3dbaa561 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:01.332769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8fde20c-396f-4920-a879-ee9a3dbaa561 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:01.333224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8fde20c-396f-4920-a879-ee9a3dbaa561 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:01.396664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d571606c-c09b-4d93-8e3e-e52f57987b91 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:01.400568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d571606c-c09b-4d93-8e3e-e52f57987b91 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:01.404071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d571606c-c09b-4d93-8e3e-e52f57987b91 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:01.405358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d571606c-c09b-4d93-8e3e-e52f57987b91 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:01.405358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d571606c-c09b-4d93-8e3e-e52f57987b91 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:01.405971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d571606c-c09b-4d93-8e3e-e52f57987b91 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:01.406587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d571606c-c09b-4d93-8e3e-e52f57987b91 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:01.407820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d571606c-c09b-4d93-8e3e-e52f57987b91 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:01.624467 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e8fde20c-396f-4920-a879-ee9a3dbaa561 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:01.635951 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e8fde20c-396f-4920-a879-ee9a3dbaa561 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1724 microversion: 2.1 time: 0.327827 Oct 28 20:09:01.636528 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 268/547] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:01 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:01.656199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b829f068-1900-4f01-a5fd-b0b5233f9e98 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:01.656199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b829f068-1900-4f01-a5fd-b0b5233f9e98 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:01.662586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b829f068-1900-4f01-a5fd-b0b5233f9e98 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:01.665967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b829f068-1900-4f01-a5fd-b0b5233f9e98 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:01.666611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b829f068-1900-4f01-a5fd-b0b5233f9e98 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:01.667491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b829f068-1900-4f01-a5fd-b0b5233f9e98 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:01.667963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b829f068-1900-4f01-a5fd-b0b5233f9e98 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:01.668368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b829f068-1900-4f01-a5fd-b0b5233f9e98 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:01.686961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d571606c-c09b-4d93-8e3e-e52f57987b91 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:01.697298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d571606c-c09b-4d93-8e3e-e52f57987b91 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.309385 Oct 28 20:09:01.698510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 280/548] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:01 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:01.756046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c9e25c8b-85dc-4f41-ab69-0b26affc9918 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:01.762308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c9e25c8b-85dc-4f41-ab69-0b26affc9918 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:01.779997 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9e25c8b-85dc-4f41-ab69-0b26affc9918 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:01.785303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9e25c8b-85dc-4f41-ab69-0b26affc9918 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:01.792703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9e25c8b-85dc-4f41-ab69-0b26affc9918 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:01.794743 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9e25c8b-85dc-4f41-ab69-0b26affc9918 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:01.796314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9e25c8b-85dc-4f41-ab69-0b26affc9918 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:01.797809 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9e25c8b-85dc-4f41-ab69-0b26affc9918 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:01.894830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b829f068-1900-4f01-a5fd-b0b5233f9e98 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:01.904506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b829f068-1900-4f01-a5fd-b0b5233f9e98 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:01.911233 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b829f068-1900-4f01-a5fd-b0b5233f9e98 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:01.913127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b829f068-1900-4f01-a5fd-b0b5233f9e98 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1740 microversion: 2.20 time: 0.273883 Oct 28 20:09:01.914223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 269/549] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:01 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:01.963675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-53ea173b-1416-47c7-8dce-d221c4ab40b4 req-6acde29c-52f1-4124-907c-15627f15f985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e001ad32-8419-44e8-a8dd-a05eb16202b4", "tag": "63c31b66-9fda-4d9a-bf7c-8d8c402bc47a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:01.973137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c9e25c8b-85dc-4f41-ab69-0b26affc9918 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:01.979556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-53ea173b-1416-47c7-8dce-d221c4ab40b4 req-6acde29c-52f1-4124-907c-15627f15f985 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:01.980119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-53ea173b-1416-47c7-8dce-d221c4ab40b4 req-6acde29c-52f1-4124-907c-15627f15f985 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:01.980464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-53ea173b-1416-47c7-8dce-d221c4ab40b4 req-6acde29c-52f1-4124-907c-15627f15f985 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:01.982339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c9e25c8b-85dc-4f41-ab69-0b26affc9918 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1557 microversion: 2.1 time: 0.230485 Oct 28 20:09:01.983338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 281/550] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:01 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1557 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:02.004496 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-53ea173b-1416-47c7-8dce-d221c4ab40b4 req-6acde29c-52f1-4124-907c-15627f15f985 service nova] Creating event network-changed:63c31b66-9fda-4d9a-bf7c-8d8c402bc47a for instance e001ad32-8419-44e8-a8dd-a05eb16202b4 on hv-cinder-86236 Oct 28 20:09:02.008413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a9176b86-0768-425d-9f9d-84d0b57c5420 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:02.010012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a9176b86-0768-425d-9f9d-84d0b57c5420 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:02.018460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-53ea173b-1416-47c7-8dce-d221c4ab40b4 req-6acde29c-52f1-4124-907c-15627f15f985 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058574 Oct 28 20:09:02.019369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 270/551] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:09:02.021382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9176b86-0768-425d-9f9d-84d0b57c5420 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:02.022078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9176b86-0768-425d-9f9d-84d0b57c5420 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:02.022945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9176b86-0768-425d-9f9d-84d0b57c5420 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:02.024163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9176b86-0768-425d-9f9d-84d0b57c5420 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:02.024909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9176b86-0768-425d-9f9d-84d0b57c5420 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:02.025615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9176b86-0768-425d-9f9d-84d0b57c5420 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:02.142782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a9176b86-0768-425d-9f9d-84d0b57c5420 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137446 Oct 28 20:09:02.143881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 282/552] 10.222.0.66 () {58 vars in 1275 bytes} [Fri Oct 28 20:09:02 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:09:02.310805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a612cbe7-8497-47b0-9ae0-8d12e507b293 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:02.310919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a612cbe7-8497-47b0-9ae0-8d12e507b293 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:02.317910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a612cbe7-8497-47b0-9ae0-8d12e507b293 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:02.318765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a612cbe7-8497-47b0-9ae0-8d12e507b293 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:02.319879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a612cbe7-8497-47b0-9ae0-8d12e507b293 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:02.320669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a612cbe7-8497-47b0-9ae0-8d12e507b293 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:02.321240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a612cbe7-8497-47b0-9ae0-8d12e507b293 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:02.321720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a612cbe7-8497-47b0-9ae0-8d12e507b293 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:02.488773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a612cbe7-8497-47b0-9ae0-8d12e507b293 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:02.498145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a612cbe7-8497-47b0-9ae0-8d12e507b293 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1371 microversion: 2.1 time: 0.191971 Oct 28 20:09:02.499452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 271/553] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:02 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:02.662230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-01a58463-8f26-4878-a191-e9457b252d93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:02.663120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-01a58463-8f26-4878-a191-e9457b252d93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:02.670444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01a58463-8f26-4878-a191-e9457b252d93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:02.671142 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01a58463-8f26-4878-a191-e9457b252d93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:02.671841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01a58463-8f26-4878-a191-e9457b252d93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:02.672782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01a58463-8f26-4878-a191-e9457b252d93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:02.673557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01a58463-8f26-4878-a191-e9457b252d93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:02.674152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01a58463-8f26-4878-a191-e9457b252d93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:02.721648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2fceb2f8-9fd4-4936-8228-673ba7a23376 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:02.722868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2fceb2f8-9fd4-4936-8228-673ba7a23376 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:02.729215 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fceb2f8-9fd4-4936-8228-673ba7a23376 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:02.730111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fceb2f8-9fd4-4936-8228-673ba7a23376 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:02.730731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fceb2f8-9fd4-4936-8228-673ba7a23376 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:02.731633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fceb2f8-9fd4-4936-8228-673ba7a23376 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:02.732092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fceb2f8-9fd4-4936-8228-673ba7a23376 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:02.732656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fceb2f8-9fd4-4936-8228-673ba7a23376 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:02.915639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-01a58463-8f26-4878-a191-e9457b252d93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:02.926732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-01a58463-8f26-4878-a191-e9457b252d93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1724 microversion: 2.1 time: 0.270278 Oct 28 20:09:02.926732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 283/554] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:02 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:02.942687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cd8bf70c-a8c9-46e7-a5c3-c4b444c5e1aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:02.945222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cd8bf70c-a8c9-46e7-a5c3-c4b444c5e1aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:02.954237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd8bf70c-a8c9-46e7-a5c3-c4b444c5e1aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:02.955203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd8bf70c-a8c9-46e7-a5c3-c4b444c5e1aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:02.955954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd8bf70c-a8c9-46e7-a5c3-c4b444c5e1aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:02.956893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd8bf70c-a8c9-46e7-a5c3-c4b444c5e1aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:02.957556 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd8bf70c-a8c9-46e7-a5c3-c4b444c5e1aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:02.958391 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd8bf70c-a8c9-46e7-a5c3-c4b444c5e1aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:02.963036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2fceb2f8-9fd4-4936-8228-673ba7a23376 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:02.973950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2fceb2f8-9fd4-4936-8228-673ba7a23376 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.255956 Oct 28 20:09:02.974549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 272/555] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:02 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:03.123659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cd8bf70c-a8c9-46e7-a5c3-c4b444c5e1aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:03.137070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cd8bf70c-a8c9-46e7-a5c3-c4b444c5e1aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:03.139149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cd8bf70c-a8c9-46e7-a5c3-c4b444c5e1aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:03.140700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cd8bf70c-a8c9-46e7-a5c3-c4b444c5e1aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1740 microversion: 2.20 time: 0.205314 Oct 28 20:09:03.142495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 284/556] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:02 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:03.526965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0b4e741c-bfc4-445b-b839-0540c63e1d70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:03.528462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0b4e741c-bfc4-445b-b839-0540c63e1d70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:03.538273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b4e741c-bfc4-445b-b839-0540c63e1d70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:03.538763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b4e741c-bfc4-445b-b839-0540c63e1d70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:03.539353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b4e741c-bfc4-445b-b839-0540c63e1d70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:03.540180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b4e741c-bfc4-445b-b839-0540c63e1d70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:03.541059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b4e741c-bfc4-445b-b839-0540c63e1d70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:03.541696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b4e741c-bfc4-445b-b839-0540c63e1d70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:03.714237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0b4e741c-bfc4-445b-b839-0540c63e1d70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:03.729026 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0b4e741c-bfc4-445b-b839-0540c63e1d70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1371 microversion: 2.1 time: 0.206797 Oct 28 20:09:03.741481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 273/557] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:03 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:03.951881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c9c6b72e-4410-4c86-99bf-65bcf93fb2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:03.953298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c9c6b72e-4410-4c86-99bf-65bcf93fb2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:03.963078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9c6b72e-4410-4c86-99bf-65bcf93fb2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:03.963577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9c6b72e-4410-4c86-99bf-65bcf93fb2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:03.964012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9c6b72e-4410-4c86-99bf-65bcf93fb2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:03.964736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9c6b72e-4410-4c86-99bf-65bcf93fb2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:03.965180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9c6b72e-4410-4c86-99bf-65bcf93fb2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:03.965617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9c6b72e-4410-4c86-99bf-65bcf93fb2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:03.999065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c3becc2d-46c1-419f-b860-d43664862b62 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:03.999625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c3becc2d-46c1-419f-b860-d43664862b62 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:04.014670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3becc2d-46c1-419f-b860-d43664862b62 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:04.014670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3becc2d-46c1-419f-b860-d43664862b62 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:04.014670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3becc2d-46c1-419f-b860-d43664862b62 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:04.014670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3becc2d-46c1-419f-b860-d43664862b62 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:04.015140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3becc2d-46c1-419f-b860-d43664862b62 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:04.015140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3becc2d-46c1-419f-b860-d43664862b62 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:04.035083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:04.228925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c9c6b72e-4410-4c86-99bf-65bcf93fb2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:04.240875 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c9c6b72e-4410-4c86-99bf-65bcf93fb2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1724 microversion: 2.1 time: 0.292706 Oct 28 20:09:04.260022 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 285/558] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:03 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:04.266027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-d2ce0197-c2a7-4bb0-973f-d51b3b4efbfd req-f209e764-67da-4e5f-919a-e0c3dfec26fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2", "tag": "85e3fd0b-83fb-48bf-8cd7-071823c4c38c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:04.280833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c3becc2d-46c1-419f-b860-d43664862b62 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:04.288684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c3becc2d-46c1-419f-b860-d43664862b62 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.296342 Oct 28 20:09:04.289382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 274/559] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:03 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:04.293424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d2ce0197-c2a7-4bb0-973f-d51b3b4efbfd req-f209e764-67da-4e5f-919a-e0c3dfec26fa service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:04.296567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d2ce0197-c2a7-4bb0-973f-d51b3b4efbfd req-f209e764-67da-4e5f-919a-e0c3dfec26fa service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:04.297142 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d2ce0197-c2a7-4bb0-973f-d51b3b4efbfd req-f209e764-67da-4e5f-919a-e0c3dfec26fa service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:04.307901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-436172be-e113-4ede-b382-9286c65af25f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:04.308515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-436172be-e113-4ede-b382-9286c65af25f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:04.315379 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-d2ce0197-c2a7-4bb0-973f-d51b3b4efbfd req-f209e764-67da-4e5f-919a-e0c3dfec26fa service nova] Creating event network-changed:85e3fd0b-83fb-48bf-8cd7-071823c4c38c for instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 on hv-cinder-86236 Oct 28 20:09:04.315555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436172be-e113-4ede-b382-9286c65af25f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:04.315908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436172be-e113-4ede-b382-9286c65af25f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:04.316356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436172be-e113-4ede-b382-9286c65af25f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:04.317055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436172be-e113-4ede-b382-9286c65af25f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:04.318253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436172be-e113-4ede-b382-9286c65af25f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:04.318864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436172be-e113-4ede-b382-9286c65af25f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:04.322486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-d2ce0197-c2a7-4bb0-973f-d51b3b4efbfd req-f209e764-67da-4e5f-919a-e0c3dfec26fa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060585 Oct 28 20:09:04.324455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 286/560] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:04.565460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-436172be-e113-4ede-b382-9286c65af25f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:04.575728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-436172be-e113-4ede-b382-9286c65af25f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:04.577521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-436172be-e113-4ede-b382-9286c65af25f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:04.580170 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-436172be-e113-4ede-b382-9286c65af25f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1740 microversion: 2.20 time: 0.275942 Oct 28 20:09:04.580969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 275/561] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:04 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:04.753308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e335cb18-a874-4a02-b002-3286ba1f2fa2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:04.754026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e335cb18-a874-4a02-b002-3286ba1f2fa2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:04.766122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e335cb18-a874-4a02-b002-3286ba1f2fa2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:04.766122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e335cb18-a874-4a02-b002-3286ba1f2fa2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:04.766122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e335cb18-a874-4a02-b002-3286ba1f2fa2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:04.766122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e335cb18-a874-4a02-b002-3286ba1f2fa2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:04.766684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e335cb18-a874-4a02-b002-3286ba1f2fa2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:04.766684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e335cb18-a874-4a02-b002-3286ba1f2fa2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:04.952388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e335cb18-a874-4a02-b002-3286ba1f2fa2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:04.963431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e335cb18-a874-4a02-b002-3286ba1f2fa2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1371 microversion: 2.1 time: 0.213714 Oct 28 20:09:04.977980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 287/562] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:04 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:05.270669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a3997ca-eac9-4bc1-b975-5d72924a21fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:05.271302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3a3997ca-eac9-4bc1-b975-5d72924a21fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:05.277639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a3997ca-eac9-4bc1-b975-5d72924a21fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:05.278141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a3997ca-eac9-4bc1-b975-5d72924a21fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:05.278583 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a3997ca-eac9-4bc1-b975-5d72924a21fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:05.279285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a3997ca-eac9-4bc1-b975-5d72924a21fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:05.279742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a3997ca-eac9-4bc1-b975-5d72924a21fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:05.280331 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a3997ca-eac9-4bc1-b975-5d72924a21fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:05.311260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9b607f08-ce48-499d-8ffd-934379adf03c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:05.311883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9b607f08-ce48-499d-8ffd-934379adf03c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:05.320148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b607f08-ce48-499d-8ffd-934379adf03c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:05.320645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b607f08-ce48-499d-8ffd-934379adf03c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:05.321202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b607f08-ce48-499d-8ffd-934379adf03c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:05.321941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b607f08-ce48-499d-8ffd-934379adf03c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:05.322388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b607f08-ce48-499d-8ffd-934379adf03c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:05.322810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b607f08-ce48-499d-8ffd-934379adf03c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:05.509725 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a3997ca-eac9-4bc1-b975-5d72924a21fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:05.515330 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a3997ca-eac9-4bc1-b975-5d72924a21fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1724 microversion: 2.1 time: 0.248880 Oct 28 20:09:05.525583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9b607f08-ce48-499d-8ffd-934379adf03c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:05.530544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 276/563] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:05 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:05.541733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9b607f08-ce48-499d-8ffd-934379adf03c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.234196 Oct 28 20:09:05.545835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 288/564] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:05 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:05.610641 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d701db2-71a4-4057-8492-801e6018d83d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:05.611922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6d701db2-71a4-4057-8492-801e6018d83d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:05.620943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d701db2-71a4-4057-8492-801e6018d83d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:05.621662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d701db2-71a4-4057-8492-801e6018d83d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:05.622523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d701db2-71a4-4057-8492-801e6018d83d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:05.630277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d701db2-71a4-4057-8492-801e6018d83d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:05.631933 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d701db2-71a4-4057-8492-801e6018d83d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:05.632603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d701db2-71a4-4057-8492-801e6018d83d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:05.796578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6d701db2-71a4-4057-8492-801e6018d83d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:05.805858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6d701db2-71a4-4057-8492-801e6018d83d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:05.807314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6d701db2-71a4-4057-8492-801e6018d83d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:05.808693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6d701db2-71a4-4057-8492-801e6018d83d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1740 microversion: 2.20 time: 0.203360 Oct 28 20:09:05.809246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 277/565] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:05 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:05.988264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-484aabb9-d44e-4380-9d23-205759cbe8ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:05.989638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-484aabb9-d44e-4380-9d23-205759cbe8ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:05.996395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484aabb9-d44e-4380-9d23-205759cbe8ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:05.996963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484aabb9-d44e-4380-9d23-205759cbe8ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:05.997436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484aabb9-d44e-4380-9d23-205759cbe8ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:05.998146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484aabb9-d44e-4380-9d23-205759cbe8ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:05.998679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484aabb9-d44e-4380-9d23-205759cbe8ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:05.999106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484aabb9-d44e-4380-9d23-205759cbe8ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:06.143424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-484aabb9-d44e-4380-9d23-205759cbe8ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:06.155172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-484aabb9-d44e-4380-9d23-205759cbe8ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1371 microversion: 2.1 time: 0.171515 Oct 28 20:09:06.156395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 289/566] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:05 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:06.543625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a2cefd5-177c-4623-8944-6d6c2f382b73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:06.544620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a2cefd5-177c-4623-8944-6d6c2f382b73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:06.551061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a2cefd5-177c-4623-8944-6d6c2f382b73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:06.551890 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a2cefd5-177c-4623-8944-6d6c2f382b73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:06.552545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a2cefd5-177c-4623-8944-6d6c2f382b73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:06.553728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a2cefd5-177c-4623-8944-6d6c2f382b73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:06.554390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a2cefd5-177c-4623-8944-6d6c2f382b73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:06.555325 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a2cefd5-177c-4623-8944-6d6c2f382b73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:06.570507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f2270a4e-dc88-4064-96ff-12228d7f74f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:06.571411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f2270a4e-dc88-4064-96ff-12228d7f74f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:06.580546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2270a4e-dc88-4064-96ff-12228d7f74f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:06.589738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2270a4e-dc88-4064-96ff-12228d7f74f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:06.590618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2270a4e-dc88-4064-96ff-12228d7f74f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:06.591378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2270a4e-dc88-4064-96ff-12228d7f74f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:06.591853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2270a4e-dc88-4064-96ff-12228d7f74f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:06.592289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2270a4e-dc88-4064-96ff-12228d7f74f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:06.829575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1a2cefd5-177c-4623-8944-6d6c2f382b73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:06.838912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a2cefd5-177c-4623-8944-6d6c2f382b73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1724 microversion: 2.1 time: 0.299294 Oct 28 20:09:06.839992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 278/567] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:06 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:06.845975 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1b56d0f1-a54d-4862-8ac0-23fe32c8aa88 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:06.847400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1b56d0f1-a54d-4862-8ac0-23fe32c8aa88 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:06.854610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b56d0f1-a54d-4862-8ac0-23fe32c8aa88 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:06.859078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b56d0f1-a54d-4862-8ac0-23fe32c8aa88 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:06.859078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b56d0f1-a54d-4862-8ac0-23fe32c8aa88 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:06.859078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b56d0f1-a54d-4862-8ac0-23fe32c8aa88 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:06.859078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b56d0f1-a54d-4862-8ac0-23fe32c8aa88 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:06.859410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b56d0f1-a54d-4862-8ac0-23fe32c8aa88 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:06.859483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f2270a4e-dc88-4064-96ff-12228d7f74f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:06.869012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f2270a4e-dc88-4064-96ff-12228d7f74f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.302263 Oct 28 20:09:06.869986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 290/568] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:06 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:07.013575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1b56d0f1-a54d-4862-8ac0-23fe32c8aa88 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:07.020584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1b56d0f1-a54d-4862-8ac0-23fe32c8aa88 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:07.022487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1b56d0f1-a54d-4862-8ac0-23fe32c8aa88 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:07.025026 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1b56d0f1-a54d-4862-8ac0-23fe32c8aa88 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1740 microversion: 2.20 time: 0.182661 Oct 28 20:09:07.038414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 279/569] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:06 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:07.180396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a6551d44-21b8-4ac1-8f1c-544436568bb5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:07.181894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a6551d44-21b8-4ac1-8f1c-544436568bb5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:07.189238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6551d44-21b8-4ac1-8f1c-544436568bb5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:07.190058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6551d44-21b8-4ac1-8f1c-544436568bb5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:07.190740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6551d44-21b8-4ac1-8f1c-544436568bb5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:07.191566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6551d44-21b8-4ac1-8f1c-544436568bb5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:07.192098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6551d44-21b8-4ac1-8f1c-544436568bb5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:07.192600 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6551d44-21b8-4ac1-8f1c-544436568bb5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:07.341618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a6551d44-21b8-4ac1-8f1c-544436568bb5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:07.350675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a6551d44-21b8-4ac1-8f1c-544436568bb5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1371 microversion: 2.1 time: 0.175179 Oct 28 20:09:07.351676 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 291/570] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:07 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:07.868136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f7c92796-d79a-45fc-89be-b34ff2a14bce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:07.868757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f7c92796-d79a-45fc-89be-b34ff2a14bce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:07.876538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7c92796-d79a-45fc-89be-b34ff2a14bce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:07.877025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7c92796-d79a-45fc-89be-b34ff2a14bce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:07.877512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7c92796-d79a-45fc-89be-b34ff2a14bce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:07.878207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7c92796-d79a-45fc-89be-b34ff2a14bce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:07.878836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7c92796-d79a-45fc-89be-b34ff2a14bce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:07.879262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7c92796-d79a-45fc-89be-b34ff2a14bce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:07.891711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-09034d66-135c-48c9-ae62-25c28ea55274 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:07.892321 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-09034d66-135c-48c9-ae62-25c28ea55274 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:07.898994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09034d66-135c-48c9-ae62-25c28ea55274 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:07.899740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09034d66-135c-48c9-ae62-25c28ea55274 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:07.900380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09034d66-135c-48c9-ae62-25c28ea55274 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:07.901381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09034d66-135c-48c9-ae62-25c28ea55274 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:07.902042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09034d66-135c-48c9-ae62-25c28ea55274 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:07.902886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09034d66-135c-48c9-ae62-25c28ea55274 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:08.105421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f7c92796-d79a-45fc-89be-b34ff2a14bce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:08.114577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-09034d66-135c-48c9-ae62-25c28ea55274 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:08.120251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f7c92796-d79a-45fc-89be-b34ff2a14bce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1724 microversion: 2.1 time: 0.256018 Oct 28 20:09:08.126221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-09034d66-135c-48c9-ae62-25c28ea55274 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.237677 Oct 28 20:09:08.127248 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 292/571] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:07 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:08.133953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 280/572] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:07 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:08.137347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6e764fc0-a533-4fc7-b6ba-e5e1a1b3eaaf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:08.138210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6e764fc0-a533-4fc7-b6ba-e5e1a1b3eaaf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:08.147402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e764fc0-a533-4fc7-b6ba-e5e1a1b3eaaf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:08.148172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e764fc0-a533-4fc7-b6ba-e5e1a1b3eaaf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:08.148617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e764fc0-a533-4fc7-b6ba-e5e1a1b3eaaf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:08.149351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e764fc0-a533-4fc7-b6ba-e5e1a1b3eaaf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:08.149808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e764fc0-a533-4fc7-b6ba-e5e1a1b3eaaf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:08.150238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e764fc0-a533-4fc7-b6ba-e5e1a1b3eaaf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:08.293793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6e764fc0-a533-4fc7-b6ba-e5e1a1b3eaaf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:08.303848 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6e764fc0-a533-4fc7-b6ba-e5e1a1b3eaaf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:08.305299 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6e764fc0-a533-4fc7-b6ba-e5e1a1b3eaaf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:08.306554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6e764fc0-a533-4fc7-b6ba-e5e1a1b3eaaf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1740 microversion: 2.20 time: 0.176155 Oct 28 20:09:08.307127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 293/573] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:08 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:08.377237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aecf934b-e3a7-4251-99ca-b3d8f4b4d32d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:08.377928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aecf934b-e3a7-4251-99ca-b3d8f4b4d32d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:08.384442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aecf934b-e3a7-4251-99ca-b3d8f4b4d32d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:08.384935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aecf934b-e3a7-4251-99ca-b3d8f4b4d32d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:08.385394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aecf934b-e3a7-4251-99ca-b3d8f4b4d32d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:08.386094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aecf934b-e3a7-4251-99ca-b3d8f4b4d32d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:08.386546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aecf934b-e3a7-4251-99ca-b3d8f4b4d32d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:08.386967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aecf934b-e3a7-4251-99ca-b3d8f4b4d32d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:08.529964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-aecf934b-e3a7-4251-99ca-b3d8f4b4d32d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:08.539097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aecf934b-e3a7-4251-99ca-b3d8f4b4d32d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1371 microversion: 2.1 time: 0.165752 Oct 28 20:09:08.539654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 281/574] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:08 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:08.774119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-f813e2af-ccb2-4259-86a1-821615be3ca3 req-e4a0f024-c668-434c-87ca-7b9d3086ba4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf57f68e-5160-4fec-98e7-a8f9f9480b72", "name": "network-vif-plugged", "status": "completed", "tag": "eb535d9c-e24b-43d0-b8b6-bf1d7e7de721"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:08.784215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f813e2af-ccb2-4259-86a1-821615be3ca3 req-e4a0f024-c668-434c-87ca-7b9d3086ba4a service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:08.784694 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f813e2af-ccb2-4259-86a1-821615be3ca3 req-e4a0f024-c668-434c-87ca-7b9d3086ba4a service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:08.785131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f813e2af-ccb2-4259-86a1-821615be3ca3 req-e4a0f024-c668-434c-87ca-7b9d3086ba4a service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:08.798096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-f813e2af-ccb2-4259-86a1-821615be3ca3 req-e4a0f024-c668-434c-87ca-7b9d3086ba4a service nova] Creating event network-vif-plugged:eb535d9c-e24b-43d0-b8b6-bf1d7e7de721 for instance cf57f68e-5160-4fec-98e7-a8f9f9480b72 on hv-cinder-86236 Oct 28 20:09:08.803017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-f813e2af-ccb2-4259-86a1-821615be3ca3 req-e4a0f024-c668-434c-87ca-7b9d3086ba4a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033209 Oct 28 20:09:08.803603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 294/575] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:09.144859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f214da27-5002-4119-9919-f41b64fad889 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:09.145669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f214da27-5002-4119-9919-f41b64fad889 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:09.151679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0e6841d6-d80b-4381-b442-6bad755a11ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:09.152380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0e6841d6-d80b-4381-b442-6bad755a11ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:09.152863 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f214da27-5002-4119-9919-f41b64fad889 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:09.153879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f214da27-5002-4119-9919-f41b64fad889 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:09.154550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f214da27-5002-4119-9919-f41b64fad889 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:09.155465 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f214da27-5002-4119-9919-f41b64fad889 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:09.156134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f214da27-5002-4119-9919-f41b64fad889 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:09.157300 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f214da27-5002-4119-9919-f41b64fad889 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:09.159745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e6841d6-d80b-4381-b442-6bad755a11ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:09.160268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e6841d6-d80b-4381-b442-6bad755a11ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:09.160715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e6841d6-d80b-4381-b442-6bad755a11ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:09.161509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e6841d6-d80b-4381-b442-6bad755a11ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:09.162099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e6841d6-d80b-4381-b442-6bad755a11ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:09.162381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e6841d6-d80b-4381-b442-6bad755a11ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:09.371973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f214da27-5002-4119-9919-f41b64fad889 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:09.381264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f214da27-5002-4119-9919-f41b64fad889 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1724 microversion: 2.1 time: 0.240900 Oct 28 20:09:09.386525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 282/576] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:09 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:09.399330 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a9bf2d13-0926-4388-9535-9c833777732d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:09.401663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0e6841d6-d80b-4381-b442-6bad755a11ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:09.406478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a9bf2d13-0926-4388-9535-9c833777732d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:09.409578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0e6841d6-d80b-4381-b442-6bad755a11ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.262962 Oct 28 20:09:09.411197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 295/577] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:09 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:09.416530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9bf2d13-0926-4388-9535-9c833777732d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:09.417029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9bf2d13-0926-4388-9535-9c833777732d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:09.417680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9bf2d13-0926-4388-9535-9c833777732d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:09.418437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9bf2d13-0926-4388-9535-9c833777732d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:09.418901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9bf2d13-0926-4388-9535-9c833777732d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:09.419331 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9bf2d13-0926-4388-9535-9c833777732d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:09.562458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a5bf59b1-130b-4e1c-b4d8-f37bfb363e68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:09.563949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a5bf59b1-130b-4e1c-b4d8-f37bfb363e68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:09.571965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5bf59b1-130b-4e1c-b4d8-f37bfb363e68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:09.572831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5bf59b1-130b-4e1c-b4d8-f37bfb363e68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:09.573364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5bf59b1-130b-4e1c-b4d8-f37bfb363e68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:09.574136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5bf59b1-130b-4e1c-b4d8-f37bfb363e68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:09.574813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5bf59b1-130b-4e1c-b4d8-f37bfb363e68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:09.575472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5bf59b1-130b-4e1c-b4d8-f37bfb363e68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:09.591229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a9bf2d13-0926-4388-9535-9c833777732d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:09.599495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:09.603688 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a9bf2d13-0926-4388-9535-9c833777732d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:09.605134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a9bf2d13-0926-4388-9535-9c833777732d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:09.606385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a9bf2d13-0926-4388-9535-9c833777732d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1740 microversion: 2.20 time: 0.215832 Oct 28 20:09:09.612880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 283/578] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:09 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:09.729143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a5bf59b1-130b-4e1c-b4d8-f37bfb363e68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:09.737749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a5bf59b1-130b-4e1c-b4d8-f37bfb363e68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1371 microversion: 2.1 time: 0.179199 Oct 28 20:09:09.739299 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 296/579] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:09 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:10.410857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-573c22e2-1d81-4a33-9343-7bf9b03dbaab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:10.411347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-573c22e2-1d81-4a33-9343-7bf9b03dbaab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:10.417913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-573c22e2-1d81-4a33-9343-7bf9b03dbaab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:10.418394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-573c22e2-1d81-4a33-9343-7bf9b03dbaab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:10.418833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-573c22e2-1d81-4a33-9343-7bf9b03dbaab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:10.419527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-573c22e2-1d81-4a33-9343-7bf9b03dbaab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:10.420161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-573c22e2-1d81-4a33-9343-7bf9b03dbaab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:10.420592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-573c22e2-1d81-4a33-9343-7bf9b03dbaab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:10.431920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-92ae65db-6717-449d-a028-4d2f69d3ea5f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:10.435957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-92ae65db-6717-449d-a028-4d2f69d3ea5f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:10.440143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92ae65db-6717-449d-a028-4d2f69d3ea5f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:10.440888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92ae65db-6717-449d-a028-4d2f69d3ea5f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:10.441575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92ae65db-6717-449d-a028-4d2f69d3ea5f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:10.442513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92ae65db-6717-449d-a028-4d2f69d3ea5f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:10.443542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92ae65db-6717-449d-a028-4d2f69d3ea5f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:10.444276 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92ae65db-6717-449d-a028-4d2f69d3ea5f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:10.631168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-573c22e2-1d81-4a33-9343-7bf9b03dbaab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:10.636335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-92ae65db-6717-449d-a028-4d2f69d3ea5f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:10.639665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-573c22e2-1d81-4a33-9343-7bf9b03dbaab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1701 microversion: 2.1 time: 0.233177 Oct 28 20:09:10.640443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 284/580] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:10 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1701 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:10.644309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-92ae65db-6717-449d-a028-4d2f69d3ea5f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.216007 Oct 28 20:09:10.644916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 297/581] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:10 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:10.651833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f67e7ac4-2b7d-46f9-bc32-bc670f4b15e9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:10.652518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f67e7ac4-2b7d-46f9-bc32-bc670f4b15e9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:10.659299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f67e7ac4-2b7d-46f9-bc32-bc670f4b15e9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:10.659786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f67e7ac4-2b7d-46f9-bc32-bc670f4b15e9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:10.660433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f67e7ac4-2b7d-46f9-bc32-bc670f4b15e9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:10.661130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f67e7ac4-2b7d-46f9-bc32-bc670f4b15e9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:10.661649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f67e7ac4-2b7d-46f9-bc32-bc670f4b15e9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:10.661773 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3b5c4690-7c39-4609-969b-42d3c6fb3b73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:10.662079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f67e7ac4-2b7d-46f9-bc32-bc670f4b15e9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:10.667551 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b5c4690-7c39-4609-969b-42d3c6fb3b73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:10.668042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b5c4690-7c39-4609-969b-42d3c6fb3b73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:10.668481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b5c4690-7c39-4609-969b-42d3c6fb3b73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:10.691990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3b5c4690-7c39-4609-969b-42d3c6fb3b73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Going to try to start instance {{(pid=119407) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 20:09:10.799946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f67e7ac4-2b7d-46f9-bc32-bc670f4b15e9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:10.808795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f67e7ac4-2b7d-46f9-bc32-bc670f4b15e9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:10.810290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f67e7ac4-2b7d-46f9-bc32-bc670f4b15e9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:10.811445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f67e7ac4-2b7d-46f9-bc32-bc670f4b15e9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1740 microversion: 2.20 time: 0.163433 Oct 28 20:09:10.811999 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 285/582] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:10 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:10.816788 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eb0a94f4-9232-4e87-84d4-4e94fcb27cf9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:10.817551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eb0a94f4-9232-4e87-84d4-4e94fcb27cf9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:10.823534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0a94f4-9232-4e87-84d4-4e94fcb27cf9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:10.824115 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0a94f4-9232-4e87-84d4-4e94fcb27cf9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:10.824556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0a94f4-9232-4e87-84d4-4e94fcb27cf9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:10.825245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0a94f4-9232-4e87-84d4-4e94fcb27cf9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:10.825730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0a94f4-9232-4e87-84d4-4e94fcb27cf9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:10.826161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb0a94f4-9232-4e87-84d4-4e94fcb27cf9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:10.891933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3b5c4690-7c39-4609-969b-42d3c6fb3b73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "POST /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/action" status: 202 len: 0 microversion: 2.1 time: 0.233018 Oct 28 20:09:10.892535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 298/583] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Oct 28 20:09:10 2022] POST /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 20:09:10.901206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0c44bf8-82af-451e-b54b-5af3948801bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:10.901974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0c44bf8-82af-451e-b54b-5af3948801bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:10.908247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0c44bf8-82af-451e-b54b-5af3948801bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:10.908954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0c44bf8-82af-451e-b54b-5af3948801bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:10.909545 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0c44bf8-82af-451e-b54b-5af3948801bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:10.910465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0c44bf8-82af-451e-b54b-5af3948801bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:10.910911 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0c44bf8-82af-451e-b54b-5af3948801bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:10.911492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0c44bf8-82af-451e-b54b-5af3948801bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:10.993469 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-eb0a94f4-9232-4e87-84d4-4e94fcb27cf9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:11.002557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eb0a94f4-9232-4e87-84d4-4e94fcb27cf9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1371 microversion: 2.1 time: 0.189301 Oct 28 20:09:11.003313 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 286/584] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:10 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:11.067661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0c44bf8-82af-451e-b54b-5af3948801bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:11.075956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0c44bf8-82af-451e-b54b-5af3948801bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1710 microversion: 2.1 time: 0.178905 Oct 28 20:09:11.076529 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 299/585] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:10 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1710 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:11.666874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5fbeb701-b0c0-4faa-b689-65841f56aa43 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:11.667524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5fbeb701-b0c0-4faa-b689-65841f56aa43 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:11.674820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fbeb701-b0c0-4faa-b689-65841f56aa43 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:11.675311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fbeb701-b0c0-4faa-b689-65841f56aa43 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:11.675770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fbeb701-b0c0-4faa-b689-65841f56aa43 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:11.676458 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fbeb701-b0c0-4faa-b689-65841f56aa43 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:11.676917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fbeb701-b0c0-4faa-b689-65841f56aa43 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:11.677362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fbeb701-b0c0-4faa-b689-65841f56aa43 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:11.816566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5fbeb701-b0c0-4faa-b689-65841f56aa43 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:11.824271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5fbeb701-b0c0-4faa-b689-65841f56aa43 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.161260 Oct 28 20:09:11.824843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 287/586] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:11 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:11.837649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8d9ee4b4-4cde-4c62-b8ed-aa90082c776e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:11.842566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8d9ee4b4-4cde-4c62-b8ed-aa90082c776e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:11.845782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d9ee4b4-4cde-4c62-b8ed-aa90082c776e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:11.846315 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d9ee4b4-4cde-4c62-b8ed-aa90082c776e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:11.846755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d9ee4b4-4cde-4c62-b8ed-aa90082c776e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:11.847597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d9ee4b4-4cde-4c62-b8ed-aa90082c776e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:11.848040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d9ee4b4-4cde-4c62-b8ed-aa90082c776e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:11.848463 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d9ee4b4-4cde-4c62-b8ed-aa90082c776e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:11.981010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8d9ee4b4-4cde-4c62-b8ed-aa90082c776e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:11.990282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8d9ee4b4-4cde-4c62-b8ed-aa90082c776e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:11.991770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8d9ee4b4-4cde-4c62-b8ed-aa90082c776e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:11.992928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8d9ee4b4-4cde-4c62-b8ed-aa90082c776e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1722 microversion: 2.20 time: 0.159720 Oct 28 20:09:11.993695 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 300/587] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:11 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:09:12.025949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c9084f6a-568c-4709-8907-3434d6d46e62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:12.026587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c9084f6a-568c-4709-8907-3434d6d46e62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:12.033244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9084f6a-568c-4709-8907-3434d6d46e62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:12.033437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9084f6a-568c-4709-8907-3434d6d46e62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:12.033880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9084f6a-568c-4709-8907-3434d6d46e62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:12.034592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9084f6a-568c-4709-8907-3434d6d46e62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:12.035053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9084f6a-568c-4709-8907-3434d6d46e62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:12.035483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9084f6a-568c-4709-8907-3434d6d46e62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:12.100300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a56064ef-14fa-47e5-8aeb-48457daa3459 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:12.101107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a56064ef-14fa-47e5-8aeb-48457daa3459 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:12.107858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56064ef-14fa-47e5-8aeb-48457daa3459 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:12.108731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56064ef-14fa-47e5-8aeb-48457daa3459 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:12.109472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56064ef-14fa-47e5-8aeb-48457daa3459 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:12.110365 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56064ef-14fa-47e5-8aeb-48457daa3459 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:12.111167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56064ef-14fa-47e5-8aeb-48457daa3459 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:12.111977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56064ef-14fa-47e5-8aeb-48457daa3459 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:12.216073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c9084f6a-568c-4709-8907-3434d6d46e62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:12.225125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c9084f6a-568c-4709-8907-3434d6d46e62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1565 microversion: 2.1 time: 0.203094 Oct 28 20:09:12.225843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 288/588] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:12 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1565 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:12.248822 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8b0e7bcb-f82f-41ea-9036-4c860d010909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:12.249796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8b0e7bcb-f82f-41ea-9036-4c860d010909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:12.256178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b0e7bcb-f82f-41ea-9036-4c860d010909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:12.256857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b0e7bcb-f82f-41ea-9036-4c860d010909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:12.257308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b0e7bcb-f82f-41ea-9036-4c860d010909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:12.258688 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b0e7bcb-f82f-41ea-9036-4c860d010909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:12.259167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b0e7bcb-f82f-41ea-9036-4c860d010909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:12.259601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b0e7bcb-f82f-41ea-9036-4c860d010909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:12.283742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a56064ef-14fa-47e5-8aeb-48457daa3459 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:12.292000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a56064ef-14fa-47e5-8aeb-48457daa3459 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1710 microversion: 2.1 time: 0.195649 Oct 28 20:09:12.292770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 301/589] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:12 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1710 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:12.343016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8b0e7bcb-f82f-41ea-9036-4c860d010909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097951 Oct 28 20:09:12.343655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 289/590] 10.222.0.66 () {58 vars in 1275 bytes} [Fri Oct 28 20:09:12 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:09:12.846722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dd10ab10-37b0-41eb-a178-b7163ed1cebb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:12.847339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dd10ab10-37b0-41eb-a178-b7163ed1cebb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:12.853860 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd10ab10-37b0-41eb-a178-b7163ed1cebb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:12.854346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd10ab10-37b0-41eb-a178-b7163ed1cebb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:12.854784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd10ab10-37b0-41eb-a178-b7163ed1cebb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:12.858034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd10ab10-37b0-41eb-a178-b7163ed1cebb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:12.858034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd10ab10-37b0-41eb-a178-b7163ed1cebb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:12.858034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd10ab10-37b0-41eb-a178-b7163ed1cebb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:12.989985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd10ab10-37b0-41eb-a178-b7163ed1cebb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:12.997605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dd10ab10-37b0-41eb-a178-b7163ed1cebb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.154922 Oct 28 20:09:12.998176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 302/591] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:12 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:13.019747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-788b6e3e-8722-45e6-b159-48e86977965f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:13.020359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-788b6e3e-8722-45e6-b159-48e86977965f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:13.033544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788b6e3e-8722-45e6-b159-48e86977965f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:13.034219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788b6e3e-8722-45e6-b159-48e86977965f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:13.034659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788b6e3e-8722-45e6-b159-48e86977965f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:13.035375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788b6e3e-8722-45e6-b159-48e86977965f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:13.035828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788b6e3e-8722-45e6-b159-48e86977965f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:13.036259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788b6e3e-8722-45e6-b159-48e86977965f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:13.315661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aac1bb69-3872-461a-b63b-f75258837c8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:13.316302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aac1bb69-3872-461a-b63b-f75258837c8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:13.322803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aac1bb69-3872-461a-b63b-f75258837c8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:13.323329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aac1bb69-3872-461a-b63b-f75258837c8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:13.323777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aac1bb69-3872-461a-b63b-f75258837c8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:13.324598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aac1bb69-3872-461a-b63b-f75258837c8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:13.325065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aac1bb69-3872-461a-b63b-f75258837c8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:13.325530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aac1bb69-3872-461a-b63b-f75258837c8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:13.465944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-788b6e3e-8722-45e6-b159-48e86977965f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:13.474515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-788b6e3e-8722-45e6-b159-48e86977965f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:13.475975 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-788b6e3e-8722-45e6-b159-48e86977965f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:13.477176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-788b6e3e-8722-45e6-b159-48e86977965f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1722 microversion: 2.20 time: 0.461928 Oct 28 20:09:13.485807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 290/592] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:13 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1722 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:09:13.501444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-aac1bb69-3872-461a-b63b-f75258837c8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:13.509561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aac1bb69-3872-461a-b63b-f75258837c8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1710 microversion: 2.1 time: 0.198282 Oct 28 20:09:13.510336 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 303/593] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:13 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1710 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:13.602527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-364efdcb-8139-4bad-9bc7-186bbc0df27e req-b679cd3d-29a0-4ef8-befb-32741c1523e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf57f68e-5160-4fec-98e7-a8f9f9480b72", "tag": "eb535d9c-e24b-43d0-b8b6-bf1d7e7de721"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:13.612919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-364efdcb-8139-4bad-9bc7-186bbc0df27e req-b679cd3d-29a0-4ef8-befb-32741c1523e0 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:13.613514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-364efdcb-8139-4bad-9bc7-186bbc0df27e req-b679cd3d-29a0-4ef8-befb-32741c1523e0 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:13.613949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-364efdcb-8139-4bad-9bc7-186bbc0df27e req-b679cd3d-29a0-4ef8-befb-32741c1523e0 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:13.624526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-364efdcb-8139-4bad-9bc7-186bbc0df27e req-b679cd3d-29a0-4ef8-befb-32741c1523e0 service nova] Creating event network-changed:eb535d9c-e24b-43d0-b8b6-bf1d7e7de721 for instance cf57f68e-5160-4fec-98e7-a8f9f9480b72 on hv-cinder-86236 Oct 28 20:09:13.630450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-364efdcb-8139-4bad-9bc7-186bbc0df27e req-b679cd3d-29a0-4ef8-befb-32741c1523e0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031531 Oct 28 20:09:13.633025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 291/594] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:14.020844 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4cd9004d-50ff-4150-a134-d894848a4ad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:14.021697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4cd9004d-50ff-4150-a134-d894848a4ad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:14.028305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4cd9004d-50ff-4150-a134-d894848a4ad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:14.028881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4cd9004d-50ff-4150-a134-d894848a4ad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:14.029342 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4cd9004d-50ff-4150-a134-d894848a4ad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:14.030107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4cd9004d-50ff-4150-a134-d894848a4ad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:14.030562 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4cd9004d-50ff-4150-a134-d894848a4ad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:14.030994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4cd9004d-50ff-4150-a134-d894848a4ad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:14.173731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4cd9004d-50ff-4150-a134-d894848a4ad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:14.182068 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4cd9004d-50ff-4150-a134-d894848a4ad1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.165483 Oct 28 20:09:14.186097 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 304/595] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:14 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:14.505061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37b336f4-3adf-4d1b-b128-163f55cb1dd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:14.506425 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-37b336f4-3adf-4d1b-b128-163f55cb1dd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:14.513124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37b336f4-3adf-4d1b-b128-163f55cb1dd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:14.513688 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37b336f4-3adf-4d1b-b128-163f55cb1dd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:14.514132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37b336f4-3adf-4d1b-b128-163f55cb1dd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:14.514839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37b336f4-3adf-4d1b-b128-163f55cb1dd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:14.515297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37b336f4-3adf-4d1b-b128-163f55cb1dd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:14.515786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37b336f4-3adf-4d1b-b128-163f55cb1dd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:14.522732 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:14.534735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8d7ce9ad-f7f0-4974-afc5-0bd91edb60b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:14.535700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8d7ce9ad-f7f0-4974-afc5-0bd91edb60b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:14.544370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:14.548296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d7ce9ad-f7f0-4974-afc5-0bd91edb60b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:14.549022 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d7ce9ad-f7f0-4974-afc5-0bd91edb60b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:14.550408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d7ce9ad-f7f0-4974-afc5-0bd91edb60b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:14.551361 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d7ce9ad-f7f0-4974-afc5-0bd91edb60b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:14.552049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d7ce9ad-f7f0-4974-afc5-0bd91edb60b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:14.552854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d7ce9ad-f7f0-4974-afc5-0bd91edb60b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:14.768954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-37b336f4-3adf-4d1b-b128-163f55cb1dd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:14.779535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-37b336f4-3adf-4d1b-b128-163f55cb1dd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:14.781686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-37b336f4-3adf-4d1b-b128-163f55cb1dd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:14.783478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-37b336f4-3adf-4d1b-b128-163f55cb1dd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1722 microversion: 2.20 time: 0.283496 Oct 28 20:09:14.784375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 292/596] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:14 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:14.791528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8d7ce9ad-f7f0-4974-afc5-0bd91edb60b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:14.800068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-acd28f2e-9856-4f8d-a0d0-20fb87cdb0b7 req-04357db3-2be0-4a1a-b5f5-b76e1a2fc698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7582188f-bfab-4218-9104-9fb384141c57", "name": "network-vif-unplugged", "status": "completed", "tag": "ade7b021-b99e-4c55-93bb-537d28c2a53d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:14.801099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8d7ce9ad-f7f0-4974-afc5-0bd91edb60b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1714 microversion: 2.1 time: 0.272899 Oct 28 20:09:14.802073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 305/597] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:14 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1714 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:14.826791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-acd28f2e-9856-4f8d-a0d0-20fb87cdb0b7 req-04357db3-2be0-4a1a-b5f5-b76e1a2fc698 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:14.827275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-acd28f2e-9856-4f8d-a0d0-20fb87cdb0b7 req-04357db3-2be0-4a1a-b5f5-b76e1a2fc698 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:14.827903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-acd28f2e-9856-4f8d-a0d0-20fb87cdb0b7 req-04357db3-2be0-4a1a-b5f5-b76e1a2fc698 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:14.839653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-acd28f2e-9856-4f8d-a0d0-20fb87cdb0b7 req-04357db3-2be0-4a1a-b5f5-b76e1a2fc698 service nova] Creating event network-vif-unplugged:ade7b021-b99e-4c55-93bb-537d28c2a53d for instance 7582188f-bfab-4218-9104-9fb384141c57 on hv-cinder-86236 Oct 28 20:09:14.846149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-acd28f2e-9856-4f8d-a0d0-20fb87cdb0b7 req-04357db3-2be0-4a1a-b5f5-b76e1a2fc698 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060105 Oct 28 20:09:14.846881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 293/598] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:15.204050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9ac7f7a9-abf3-487c-98c2-5665a4fe9146 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:15.204596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9ac7f7a9-abf3-487c-98c2-5665a4fe9146 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:15.210937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ac7f7a9-abf3-487c-98c2-5665a4fe9146 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:15.211689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ac7f7a9-abf3-487c-98c2-5665a4fe9146 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:15.212129 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ac7f7a9-abf3-487c-98c2-5665a4fe9146 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:15.212819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ac7f7a9-abf3-487c-98c2-5665a4fe9146 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:15.213273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ac7f7a9-abf3-487c-98c2-5665a4fe9146 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:15.213724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ac7f7a9-abf3-487c-98c2-5665a4fe9146 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:15.344834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9ac7f7a9-abf3-487c-98c2-5665a4fe9146 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:15.352418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9ac7f7a9-abf3-487c-98c2-5665a4fe9146 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.152391 Oct 28 20:09:15.352980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 306/599] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:15 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:15.820362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1531dc7c-3695-4f8a-a77e-6df263af0c9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:15.820981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1531dc7c-3695-4f8a-a77e-6df263af0c9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:15.827184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1531dc7c-3695-4f8a-a77e-6df263af0c9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:15.827672 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1531dc7c-3695-4f8a-a77e-6df263af0c9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:15.828193 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1531dc7c-3695-4f8a-a77e-6df263af0c9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:15.828846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1531dc7c-3695-4f8a-a77e-6df263af0c9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:15.829297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1531dc7c-3695-4f8a-a77e-6df263af0c9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:15.829746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1531dc7c-3695-4f8a-a77e-6df263af0c9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:15.958038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1531dc7c-3695-4f8a-a77e-6df263af0c9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:15.966158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1531dc7c-3695-4f8a-a77e-6df263af0c9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:15.967598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1531dc7c-3695-4f8a-a77e-6df263af0c9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:15.969388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1531dc7c-3695-4f8a-a77e-6df263af0c9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1665 microversion: 2.20 time: 0.153433 Oct 28 20:09:15.969944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 294/600] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:15 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:15.994029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eaf19cbc-ff35-40d0-be01-b8243c5f740d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cbc4e4c-a39f-49e5-bfe0-4d1a49eac1d2"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:15.996436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eaf19cbc-ff35-40d0-be01-b8243c5f740d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:16.002905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf19cbc-ff35-40d0-be01-b8243c5f740d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:16.003392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf19cbc-ff35-40d0-be01-b8243c5f740d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:16.003831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf19cbc-ff35-40d0-be01-b8243c5f740d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:16.004517 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf19cbc-ff35-40d0-be01-b8243c5f740d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:16.004975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf19cbc-ff35-40d0-be01-b8243c5f740d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:16.005463 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf19cbc-ff35-40d0-be01-b8243c5f740d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:16.376139 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-940d49f0-8a7a-43ff-b65c-edde28d6bdff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:16.376803 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-940d49f0-8a7a-43ff-b65c-edde28d6bdff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:16.382631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-940d49f0-8a7a-43ff-b65c-edde28d6bdff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:16.383199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-940d49f0-8a7a-43ff-b65c-edde28d6bdff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:16.383713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-940d49f0-8a7a-43ff-b65c-edde28d6bdff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:16.384386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-940d49f0-8a7a-43ff-b65c-edde28d6bdff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:16.384834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-940d49f0-8a7a-43ff-b65c-edde28d6bdff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:16.385254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-940d49f0-8a7a-43ff-b65c-edde28d6bdff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:16.526494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-940d49f0-8a7a-43ff-b65c-edde28d6bdff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:16.534705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-940d49f0-8a7a-43ff-b65c-edde28d6bdff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.162811 Oct 28 20:09:16.535256 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 295/601] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:16 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:17.002488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eaf19cbc-ff35-40d0-be01-b8243c5f740d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "POST /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.012369 Oct 28 20:09:17.003181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 307/602] 10.222.0.66 () {62 vars in 1364 bytes} [Fri Oct 28 20:09:15 2022] POST /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57/os-volume_attachments => generated 188 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:09:17.126649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-55ccaf98-868c-49ca-981d-6096376d356d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:17.127240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-55ccaf98-868c-49ca-981d-6096376d356d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:17.133617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55ccaf98-868c-49ca-981d-6096376d356d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:17.134097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55ccaf98-868c-49ca-981d-6096376d356d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:17.134529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55ccaf98-868c-49ca-981d-6096376d356d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:17.135209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55ccaf98-868c-49ca-981d-6096376d356d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:17.135656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55ccaf98-868c-49ca-981d-6096376d356d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:17.136072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55ccaf98-868c-49ca-981d-6096376d356d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:17.177223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-55ccaf98-868c-49ca-981d-6096376d356d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119406) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 20:09:17.456127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-55ccaf98-868c-49ca-981d-6096376d356d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "POST /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57/action" status: 202 len: 0 microversion: 2.20 time: 0.333848 Oct 28 20:09:17.456866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 296/603] 10.222.0.66 () {62 vars in 1319 bytes} [Fri Oct 28 20:09:17 2022] POST /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:09:17.465563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6de59fa4-c153-4638-a777-6676e68e99db tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:17.466177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6de59fa4-c153-4638-a777-6676e68e99db tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:17.474062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6de59fa4-c153-4638-a777-6676e68e99db tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:17.474672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6de59fa4-c153-4638-a777-6676e68e99db tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:17.475236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6de59fa4-c153-4638-a777-6676e68e99db tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:17.476095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6de59fa4-c153-4638-a777-6676e68e99db tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:17.476784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6de59fa4-c153-4638-a777-6676e68e99db tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:17.477373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6de59fa4-c153-4638-a777-6676e68e99db tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:17.571126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4be3126f-c980-466a-a185-ac7b84729625 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:17.571126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4be3126f-c980-466a-a185-ac7b84729625 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:17.571126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:17.571126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4be3126f-c980-466a-a185-ac7b84729625 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:17.571126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4be3126f-c980-466a-a185-ac7b84729625 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:17.571783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4be3126f-c980-466a-a185-ac7b84729625 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:17.573487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4be3126f-c980-466a-a185-ac7b84729625 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:17.574024 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4be3126f-c980-466a-a185-ac7b84729625 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:17.574470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4be3126f-c980-466a-a185-ac7b84729625 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:17.627582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6de59fa4-c153-4638-a777-6676e68e99db tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:17.640085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6de59fa4-c153-4638-a777-6676e68e99db tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:17.640085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6de59fa4-c153-4638-a777-6676e68e99db tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:17.640085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6de59fa4-c153-4638-a777-6676e68e99db tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1751 microversion: 2.20 time: 0.178310 Oct 28 20:09:17.646334 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 308/604] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:17 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:09:17.738898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4be3126f-c980-466a-a185-ac7b84729625 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:17.746765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4be3126f-c980-466a-a185-ac7b84729625 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.189107 Oct 28 20:09:17.747341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 297/605] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:17 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:18.665847 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-93a99d29-c24f-42d8-9c6a-fc9fe6b1de9e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:18.667076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-93a99d29-c24f-42d8-9c6a-fc9fe6b1de9e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:18.674172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93a99d29-c24f-42d8-9c6a-fc9fe6b1de9e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:18.674648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93a99d29-c24f-42d8-9c6a-fc9fe6b1de9e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:18.675122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93a99d29-c24f-42d8-9c6a-fc9fe6b1de9e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:18.676011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93a99d29-c24f-42d8-9c6a-fc9fe6b1de9e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:18.676408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93a99d29-c24f-42d8-9c6a-fc9fe6b1de9e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:18.676833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93a99d29-c24f-42d8-9c6a-fc9fe6b1de9e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:18.700261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:18.770750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-063afb1f-66ce-4253-98bc-da153d59c503 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:18.771492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-063afb1f-66ce-4253-98bc-da153d59c503 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:18.778060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-063afb1f-66ce-4253-98bc-da153d59c503 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:18.778626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-063afb1f-66ce-4253-98bc-da153d59c503 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:18.779141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-063afb1f-66ce-4253-98bc-da153d59c503 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:18.779848 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-063afb1f-66ce-4253-98bc-da153d59c503 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:18.780384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-063afb1f-66ce-4253-98bc-da153d59c503 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:18.780851 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-063afb1f-66ce-4253-98bc-da153d59c503 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:18.819295 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-93a99d29-c24f-42d8-9c6a-fc9fe6b1de9e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:18.834565 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-93a99d29-c24f-42d8-9c6a-fc9fe6b1de9e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:18.836707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-93a99d29-c24f-42d8-9c6a-fc9fe6b1de9e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:18.837976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-93a99d29-c24f-42d8-9c6a-fc9fe6b1de9e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1751 microversion: 2.20 time: 0.176048 Oct 28 20:09:18.849517 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 309/606] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:18 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:18.941783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-063afb1f-66ce-4253-98bc-da153d59c503 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:18.949594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-063afb1f-66ce-4253-98bc-da153d59c503 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.182590 Oct 28 20:09:18.950164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 298/607] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:18 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:19.866227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2d955984-b48c-4f46-a596-b9a1f609adb2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:19.866941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2d955984-b48c-4f46-a596-b9a1f609adb2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:19.873558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d955984-b48c-4f46-a596-b9a1f609adb2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:19.874034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d955984-b48c-4f46-a596-b9a1f609adb2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:19.874684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d955984-b48c-4f46-a596-b9a1f609adb2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:19.875377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d955984-b48c-4f46-a596-b9a1f609adb2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:19.875821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d955984-b48c-4f46-a596-b9a1f609adb2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:19.876241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d955984-b48c-4f46-a596-b9a1f609adb2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:19.972479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-29660d38-5443-471c-8480-01024865e1fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:19.973186 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-29660d38-5443-471c-8480-01024865e1fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:19.979909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29660d38-5443-471c-8480-01024865e1fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:19.980392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29660d38-5443-471c-8480-01024865e1fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:19.980829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29660d38-5443-471c-8480-01024865e1fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:19.981564 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29660d38-5443-471c-8480-01024865e1fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:19.982020 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29660d38-5443-471c-8480-01024865e1fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:19.982444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29660d38-5443-471c-8480-01024865e1fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:20.004428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2d955984-b48c-4f46-a596-b9a1f609adb2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:20.012919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2d955984-b48c-4f46-a596-b9a1f609adb2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:20.014378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2d955984-b48c-4f46-a596-b9a1f609adb2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:20.015576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2d955984-b48c-4f46-a596-b9a1f609adb2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.153513 Oct 28 20:09:20.016342 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 310/608] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:19 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:20.117311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-29660d38-5443-471c-8480-01024865e1fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:20.125586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-29660d38-5443-471c-8480-01024865e1fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.157523 Oct 28 20:09:20.126148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 299/609] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:19 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:21.041613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ec7da36b-ec47-4491-9d89-f320be68af09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:21.042332 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ec7da36b-ec47-4491-9d89-f320be68af09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:21.049007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec7da36b-ec47-4491-9d89-f320be68af09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:21.049522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec7da36b-ec47-4491-9d89-f320be68af09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:21.049959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec7da36b-ec47-4491-9d89-f320be68af09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:21.050645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec7da36b-ec47-4491-9d89-f320be68af09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:21.051118 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec7da36b-ec47-4491-9d89-f320be68af09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:21.051637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec7da36b-ec47-4491-9d89-f320be68af09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:21.147979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3c0c1d3c-3dd6-459d-9460-2be4193a4a58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:21.148751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3c0c1d3c-3dd6-459d-9460-2be4193a4a58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:21.155326 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0c1d3c-3dd6-459d-9460-2be4193a4a58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:21.156484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0c1d3c-3dd6-459d-9460-2be4193a4a58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:21.156883 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0c1d3c-3dd6-459d-9460-2be4193a4a58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:21.157617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0c1d3c-3dd6-459d-9460-2be4193a4a58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:21.158076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0c1d3c-3dd6-459d-9460-2be4193a4a58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:21.158505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0c1d3c-3dd6-459d-9460-2be4193a4a58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:21.178517 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ec7da36b-ec47-4491-9d89-f320be68af09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:21.187070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ec7da36b-ec47-4491-9d89-f320be68af09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:21.188666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ec7da36b-ec47-4491-9d89-f320be68af09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:21.189871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ec7da36b-ec47-4491-9d89-f320be68af09 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.152228 Oct 28 20:09:21.190430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 311/610] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:21 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:21.291058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3c0c1d3c-3dd6-459d-9460-2be4193a4a58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:21.299157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3c0c1d3c-3dd6-459d-9460-2be4193a4a58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.155049 Oct 28 20:09:21.299747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 300/611] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:21 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:22.215870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-debefca7-e3b0-4b52-8cff-5f30563eda69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:22.216465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-debefca7-e3b0-4b52-8cff-5f30563eda69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:22.223760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-debefca7-e3b0-4b52-8cff-5f30563eda69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:22.224282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-debefca7-e3b0-4b52-8cff-5f30563eda69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:22.224717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-debefca7-e3b0-4b52-8cff-5f30563eda69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:22.225449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-debefca7-e3b0-4b52-8cff-5f30563eda69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:22.225905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-debefca7-e3b0-4b52-8cff-5f30563eda69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:22.226332 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-debefca7-e3b0-4b52-8cff-5f30563eda69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:22.321758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-61bca9c4-5974-49f4-beb7-bf2b34c3e82d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:22.322396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-61bca9c4-5974-49f4-beb7-bf2b34c3e82d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:22.328989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61bca9c4-5974-49f4-beb7-bf2b34c3e82d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:22.329534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61bca9c4-5974-49f4-beb7-bf2b34c3e82d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:22.329971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61bca9c4-5974-49f4-beb7-bf2b34c3e82d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:22.330662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61bca9c4-5974-49f4-beb7-bf2b34c3e82d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:22.331114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61bca9c4-5974-49f4-beb7-bf2b34c3e82d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:22.331538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61bca9c4-5974-49f4-beb7-bf2b34c3e82d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:22.359882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-debefca7-e3b0-4b52-8cff-5f30563eda69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:22.368417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-debefca7-e3b0-4b52-8cff-5f30563eda69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:22.373747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-debefca7-e3b0-4b52-8cff-5f30563eda69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:22.373747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-debefca7-e3b0-4b52-8cff-5f30563eda69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.159075 Oct 28 20:09:22.373747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 312/612] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:22 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:22.461945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-61bca9c4-5974-49f4-beb7-bf2b34c3e82d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:22.470301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-61bca9c4-5974-49f4-beb7-bf2b34c3e82d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.152347 Oct 28 20:09:22.470794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 301/613] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:22 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:23.397344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7c5d85cb-5e94-4df4-9a6a-d860a0632f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:23.397961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7c5d85cb-5e94-4df4-9a6a-d860a0632f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:23.404293 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c5d85cb-5e94-4df4-9a6a-d860a0632f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:23.404767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c5d85cb-5e94-4df4-9a6a-d860a0632f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:23.405198 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c5d85cb-5e94-4df4-9a6a-d860a0632f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:23.405904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c5d85cb-5e94-4df4-9a6a-d860a0632f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:23.406350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c5d85cb-5e94-4df4-9a6a-d860a0632f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:23.406768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c5d85cb-5e94-4df4-9a6a-d860a0632f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:23.492633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f3aa75ae-9744-4df4-86e7-14070b7abea7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:23.493341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f3aa75ae-9744-4df4-86e7-14070b7abea7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:23.500071 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3aa75ae-9744-4df4-86e7-14070b7abea7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:23.500651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3aa75ae-9744-4df4-86e7-14070b7abea7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:23.501160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3aa75ae-9744-4df4-86e7-14070b7abea7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:23.501946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3aa75ae-9744-4df4-86e7-14070b7abea7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:23.502476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3aa75ae-9744-4df4-86e7-14070b7abea7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:23.502967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3aa75ae-9744-4df4-86e7-14070b7abea7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:23.551470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7c5d85cb-5e94-4df4-9a6a-d860a0632f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:23.559930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7c5d85cb-5e94-4df4-9a6a-d860a0632f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:23.561395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7c5d85cb-5e94-4df4-9a6a-d860a0632f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:23.562669 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7c5d85cb-5e94-4df4-9a6a-d860a0632f56 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.169223 Oct 28 20:09:23.563230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 313/614] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:23 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:23.643944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f3aa75ae-9744-4df4-86e7-14070b7abea7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:23.651759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f3aa75ae-9744-4df4-86e7-14070b7abea7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.162848 Oct 28 20:09:23.652342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 302/615] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:23 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:24.587971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee1d54de-8fb6-4241-92e7-270b8540fd80 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:24.588600 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee1d54de-8fb6-4241-92e7-270b8540fd80 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:24.595180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee1d54de-8fb6-4241-92e7-270b8540fd80 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:24.595660 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee1d54de-8fb6-4241-92e7-270b8540fd80 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:24.596471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee1d54de-8fb6-4241-92e7-270b8540fd80 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:24.596780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee1d54de-8fb6-4241-92e7-270b8540fd80 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:24.597258 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee1d54de-8fb6-4241-92e7-270b8540fd80 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:24.601914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee1d54de-8fb6-4241-92e7-270b8540fd80 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:24.675554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c102c64f-f24f-41d9-a3b6-6a35f01950af tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:24.676243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c102c64f-f24f-41d9-a3b6-6a35f01950af tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:24.682242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c102c64f-f24f-41d9-a3b6-6a35f01950af tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:24.682722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c102c64f-f24f-41d9-a3b6-6a35f01950af tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:24.683157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c102c64f-f24f-41d9-a3b6-6a35f01950af tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:24.687936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c102c64f-f24f-41d9-a3b6-6a35f01950af tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:24.687936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c102c64f-f24f-41d9-a3b6-6a35f01950af tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:24.687936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c102c64f-f24f-41d9-a3b6-6a35f01950af tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:24.740902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee1d54de-8fb6-4241-92e7-270b8540fd80 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:24.750862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee1d54de-8fb6-4241-92e7-270b8540fd80 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:24.752362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee1d54de-8fb6-4241-92e7-270b8540fd80 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:24.753577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee1d54de-8fb6-4241-92e7-270b8540fd80 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.169713 Oct 28 20:09:24.766311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 314/616] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:24 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:24.831127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c102c64f-f24f-41d9-a3b6-6a35f01950af tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:24.839120 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c102c64f-f24f-41d9-a3b6-6a35f01950af tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.167922 Oct 28 20:09:24.839616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 303/617] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:24 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:25.779604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-272f2105-21b2-42e5-8a77-568430370b37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:25.780205 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-272f2105-21b2-42e5-8a77-568430370b37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:25.787216 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-272f2105-21b2-42e5-8a77-568430370b37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:25.787691 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-272f2105-21b2-42e5-8a77-568430370b37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:25.788118 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-272f2105-21b2-42e5-8a77-568430370b37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:25.788796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-272f2105-21b2-42e5-8a77-568430370b37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:25.789252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-272f2105-21b2-42e5-8a77-568430370b37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:25.789693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-272f2105-21b2-42e5-8a77-568430370b37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:25.862307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a220c9ec-3b0a-4439-8c71-74ceed1208fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:25.862974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a220c9ec-3b0a-4439-8c71-74ceed1208fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:25.869440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a220c9ec-3b0a-4439-8c71-74ceed1208fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:25.870348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a220c9ec-3b0a-4439-8c71-74ceed1208fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:25.870348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a220c9ec-3b0a-4439-8c71-74ceed1208fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:25.871042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a220c9ec-3b0a-4439-8c71-74ceed1208fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:25.871499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a220c9ec-3b0a-4439-8c71-74ceed1208fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:25.871922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a220c9ec-3b0a-4439-8c71-74ceed1208fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:25.951249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-272f2105-21b2-42e5-8a77-568430370b37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:25.959977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-272f2105-21b2-42e5-8a77-568430370b37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:25.961721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-272f2105-21b2-42e5-8a77-568430370b37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:25.962865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-272f2105-21b2-42e5-8a77-568430370b37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.187226 Oct 28 20:09:25.963421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 315/618] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:25 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:26.019473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a220c9ec-3b0a-4439-8c71-74ceed1208fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:26.027124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a220c9ec-3b0a-4439-8c71-74ceed1208fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.169253 Oct 28 20:09:26.027684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 304/619] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:25 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:26.988465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ba37bcf6-a5be-4761-9e59-c80ef231a7c0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:26.989069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ba37bcf6-a5be-4761-9e59-c80ef231a7c0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:26.995531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba37bcf6-a5be-4761-9e59-c80ef231a7c0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:26.996004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba37bcf6-a5be-4761-9e59-c80ef231a7c0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:26.996437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba37bcf6-a5be-4761-9e59-c80ef231a7c0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:26.997112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba37bcf6-a5be-4761-9e59-c80ef231a7c0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:26.997595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba37bcf6-a5be-4761-9e59-c80ef231a7c0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:26.998017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba37bcf6-a5be-4761-9e59-c80ef231a7c0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:27.050582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-638501bd-6476-4f50-bbe4-ad7eaf864118 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:27.051199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-638501bd-6476-4f50-bbe4-ad7eaf864118 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:27.057629 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-638501bd-6476-4f50-bbe4-ad7eaf864118 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:27.058118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-638501bd-6476-4f50-bbe4-ad7eaf864118 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:27.058560 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-638501bd-6476-4f50-bbe4-ad7eaf864118 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:27.059255 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-638501bd-6476-4f50-bbe4-ad7eaf864118 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:27.059711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-638501bd-6476-4f50-bbe4-ad7eaf864118 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:27.060149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-638501bd-6476-4f50-bbe4-ad7eaf864118 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:27.165006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba37bcf6-a5be-4761-9e59-c80ef231a7c0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:27.173890 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba37bcf6-a5be-4761-9e59-c80ef231a7c0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:27.175327 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba37bcf6-a5be-4761-9e59-c80ef231a7c0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:27.176507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ba37bcf6-a5be-4761-9e59-c80ef231a7c0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.191865 Oct 28 20:09:27.177250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 316/620] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:26 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:09:27.215154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-638501bd-6476-4f50-bbe4-ad7eaf864118 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:27.223778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-638501bd-6476-4f50-bbe4-ad7eaf864118 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.177014 Oct 28 20:09:27.224523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 305/621] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:27 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:28.201970 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fde420e5-0dfa-4df4-96d5-d5da9246a866 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:28.202588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fde420e5-0dfa-4df4-96d5-d5da9246a866 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:28.209862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fde420e5-0dfa-4df4-96d5-d5da9246a866 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:28.210350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fde420e5-0dfa-4df4-96d5-d5da9246a866 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:28.210786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fde420e5-0dfa-4df4-96d5-d5da9246a866 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:28.211740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fde420e5-0dfa-4df4-96d5-d5da9246a866 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:28.212194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fde420e5-0dfa-4df4-96d5-d5da9246a866 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:28.212619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fde420e5-0dfa-4df4-96d5-d5da9246a866 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:28.246781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d7f02b3e-5ce5-4839-baa0-bfcae1b6b588 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:28.247758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d7f02b3e-5ce5-4839-baa0-bfcae1b6b588 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:28.255984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7f02b3e-5ce5-4839-baa0-bfcae1b6b588 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:28.256476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7f02b3e-5ce5-4839-baa0-bfcae1b6b588 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:28.256915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7f02b3e-5ce5-4839-baa0-bfcae1b6b588 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:28.257980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7f02b3e-5ce5-4839-baa0-bfcae1b6b588 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:28.258448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7f02b3e-5ce5-4839-baa0-bfcae1b6b588 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:28.258876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7f02b3e-5ce5-4839-baa0-bfcae1b6b588 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:28.395196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fde420e5-0dfa-4df4-96d5-d5da9246a866 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:28.404272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fde420e5-0dfa-4df4-96d5-d5da9246a866 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:28.405910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fde420e5-0dfa-4df4-96d5-d5da9246a866 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:28.407872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fde420e5-0dfa-4df4-96d5-d5da9246a866 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.209870 Oct 28 20:09:28.408426 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 317/622] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:28 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:28.427179 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d7f02b3e-5ce5-4839-baa0-bfcae1b6b588 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:28.434854 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d7f02b3e-5ce5-4839-baa0-bfcae1b6b588 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.191970 Oct 28 20:09:28.435418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 306/623] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:28 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:29.433615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7602c295-c4b8-4893-90de-b88b8d688582 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:29.434381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7602c295-c4b8-4893-90de-b88b8d688582 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:29.441577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7602c295-c4b8-4893-90de-b88b8d688582 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:29.442056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7602c295-c4b8-4893-90de-b88b8d688582 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:29.442494 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7602c295-c4b8-4893-90de-b88b8d688582 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:29.443175 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7602c295-c4b8-4893-90de-b88b8d688582 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:29.443739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7602c295-c4b8-4893-90de-b88b8d688582 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:29.444163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7602c295-c4b8-4893-90de-b88b8d688582 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:29.457047 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-294b1183-2e0a-4837-88dc-16a32f29cbd3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:29.457695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-294b1183-2e0a-4837-88dc-16a32f29cbd3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:29.464304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-294b1183-2e0a-4837-88dc-16a32f29cbd3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:29.464791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-294b1183-2e0a-4837-88dc-16a32f29cbd3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:29.465231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-294b1183-2e0a-4837-88dc-16a32f29cbd3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:29.465975 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-294b1183-2e0a-4837-88dc-16a32f29cbd3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:29.466429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-294b1183-2e0a-4837-88dc-16a32f29cbd3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:29.466867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-294b1183-2e0a-4837-88dc-16a32f29cbd3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:29.649932 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7602c295-c4b8-4893-90de-b88b8d688582 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:29.653212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-294b1183-2e0a-4837-88dc-16a32f29cbd3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:29.658760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7602c295-c4b8-4893-90de-b88b8d688582 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:29.660328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7602c295-c4b8-4893-90de-b88b8d688582 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:29.660900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-294b1183-2e0a-4837-88dc-16a32f29cbd3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.207603 Oct 28 20:09:29.661508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 307/624] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:29 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:29.661827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7602c295-c4b8-4893-90de-b88b8d688582 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.232030 Oct 28 20:09:29.662386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 318/625] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:29 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:30.684748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a4f55d6-92ac-429d-9063-ade3caf3248d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:30.685312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0a4f55d6-92ac-429d-9063-ade3caf3248d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:30.687015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2891f557-347a-4862-97e7-ce95c072f254 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:30.688196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2891f557-347a-4862-97e7-ce95c072f254 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:30.691871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a4f55d6-92ac-429d-9063-ade3caf3248d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:30.692352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a4f55d6-92ac-429d-9063-ade3caf3248d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:30.692783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a4f55d6-92ac-429d-9063-ade3caf3248d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:30.693510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a4f55d6-92ac-429d-9063-ade3caf3248d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:30.693957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a4f55d6-92ac-429d-9063-ade3caf3248d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:30.694373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a4f55d6-92ac-429d-9063-ade3caf3248d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:30.694472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2891f557-347a-4862-97e7-ce95c072f254 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:30.694905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2891f557-347a-4862-97e7-ce95c072f254 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:30.695349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2891f557-347a-4862-97e7-ce95c072f254 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:30.696041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2891f557-347a-4862-97e7-ce95c072f254 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:30.696500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2891f557-347a-4862-97e7-ce95c072f254 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:30.696924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2891f557-347a-4862-97e7-ce95c072f254 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:30.711179 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:30.896097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a4f55d6-92ac-429d-9063-ade3caf3248d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:30.901634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2891f557-347a-4862-97e7-ce95c072f254 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:30.903836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0a4f55d6-92ac-429d-9063-ade3caf3248d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.223054 Oct 28 20:09:30.904410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 308/626] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:30 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:30.910782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2891f557-347a-4862-97e7-ce95c072f254 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:30.912315 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2891f557-347a-4862-97e7-ce95c072f254 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:30.913502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2891f557-347a-4862-97e7-ce95c072f254 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.230295 Oct 28 20:09:30.914062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 319/627] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:30 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:31.925861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b1c37f6-3435-4f96-89b1-ee65c4f3380f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:31.926446 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9b1c37f6-3435-4f96-89b1-ee65c4f3380f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:31.932867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b1c37f6-3435-4f96-89b1-ee65c4f3380f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:31.933374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b1c37f6-3435-4f96-89b1-ee65c4f3380f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:31.933809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b1c37f6-3435-4f96-89b1-ee65c4f3380f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:31.934518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b1c37f6-3435-4f96-89b1-ee65c4f3380f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:31.934930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b1c37f6-3435-4f96-89b1-ee65c4f3380f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:31.935345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b1c37f6-3435-4f96-89b1-ee65c4f3380f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:31.940138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2e69bd56-2291-4bbb-a06b-47f6a52ad340 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:31.940753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2e69bd56-2291-4bbb-a06b-47f6a52ad340 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:31.947037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e69bd56-2291-4bbb-a06b-47f6a52ad340 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:31.947519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e69bd56-2291-4bbb-a06b-47f6a52ad340 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:31.947957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e69bd56-2291-4bbb-a06b-47f6a52ad340 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:31.948648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e69bd56-2291-4bbb-a06b-47f6a52ad340 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:31.949099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e69bd56-2291-4bbb-a06b-47f6a52ad340 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:31.949555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e69bd56-2291-4bbb-a06b-47f6a52ad340 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:32.133306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9b1c37f6-3435-4f96-89b1-ee65c4f3380f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:32.141478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b1c37f6-3435-4f96-89b1-ee65c4f3380f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.219507 Oct 28 20:09:32.142137 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 309/628] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:31 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:32.147992 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2e69bd56-2291-4bbb-a06b-47f6a52ad340 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:32.156682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2e69bd56-2291-4bbb-a06b-47f6a52ad340 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:32.158141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2e69bd56-2291-4bbb-a06b-47f6a52ad340 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:32.159279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2e69bd56-2291-4bbb-a06b-47f6a52ad340 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.223735 Oct 28 20:09:32.159817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 320/629] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:31 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:09:33.163864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a2798505-7825-4093-8963-ec701acc556a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:33.164482 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a2798505-7825-4093-8963-ec701acc556a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:33.170893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2798505-7825-4093-8963-ec701acc556a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:33.172199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2798505-7825-4093-8963-ec701acc556a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:33.172821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2798505-7825-4093-8963-ec701acc556a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:33.173554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2798505-7825-4093-8963-ec701acc556a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:33.174020 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2798505-7825-4093-8963-ec701acc556a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:33.174447 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2798505-7825-4093-8963-ec701acc556a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:33.184265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-65533882-8fd8-4c97-998f-ca6da6429864 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:33.184883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-65533882-8fd8-4c97-998f-ca6da6429864 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:33.192640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65533882-8fd8-4c97-998f-ca6da6429864 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:33.193128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65533882-8fd8-4c97-998f-ca6da6429864 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:33.193626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65533882-8fd8-4c97-998f-ca6da6429864 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:33.194480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65533882-8fd8-4c97-998f-ca6da6429864 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:33.194944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65533882-8fd8-4c97-998f-ca6da6429864 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:33.195389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65533882-8fd8-4c97-998f-ca6da6429864 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:33.373459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a2798505-7825-4093-8963-ec701acc556a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:33.380750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-65533882-8fd8-4c97-998f-ca6da6429864 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:33.381159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a2798505-7825-4093-8963-ec701acc556a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.221094 Oct 28 20:09:33.381769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 310/630] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:33 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:33.389227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-65533882-8fd8-4c97-998f-ca6da6429864 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:33.391071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-65533882-8fd8-4c97-998f-ca6da6429864 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:33.392222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-65533882-8fd8-4c97-998f-ca6da6429864 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.211785 Oct 28 20:09:33.392771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 321/631] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:33 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:09:34.403546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-339948b9-0561-47a3-aa95-3b8edb11b6f1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:34.404079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-339948b9-0561-47a3-aa95-3b8edb11b6f1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:34.410557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-339948b9-0561-47a3-aa95-3b8edb11b6f1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:34.411039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-339948b9-0561-47a3-aa95-3b8edb11b6f1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:34.411471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-339948b9-0561-47a3-aa95-3b8edb11b6f1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:34.412154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-339948b9-0561-47a3-aa95-3b8edb11b6f1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:34.412608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-339948b9-0561-47a3-aa95-3b8edb11b6f1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:34.413041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-339948b9-0561-47a3-aa95-3b8edb11b6f1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:34.418035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-38a9ba5d-ae88-4559-8c3f-c9fc3c17e3c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:34.418651 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-38a9ba5d-ae88-4559-8c3f-c9fc3c17e3c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:34.425737 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38a9ba5d-ae88-4559-8c3f-c9fc3c17e3c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:34.426222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38a9ba5d-ae88-4559-8c3f-c9fc3c17e3c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:34.426660 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38a9ba5d-ae88-4559-8c3f-c9fc3c17e3c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:34.427351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38a9ba5d-ae88-4559-8c3f-c9fc3c17e3c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:34.427807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38a9ba5d-ae88-4559-8c3f-c9fc3c17e3c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:34.428232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38a9ba5d-ae88-4559-8c3f-c9fc3c17e3c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:34.614836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-339948b9-0561-47a3-aa95-3b8edb11b6f1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:34.618010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-38a9ba5d-ae88-4559-8c3f-c9fc3c17e3c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:34.622783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-339948b9-0561-47a3-aa95-3b8edb11b6f1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.223103 Oct 28 20:09:34.623705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 311/632] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:34 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:34.629152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-38a9ba5d-ae88-4559-8c3f-c9fc3c17e3c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:34.631009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-38a9ba5d-ae88-4559-8c3f-c9fc3c17e3c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:34.631973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-38a9ba5d-ae88-4559-8c3f-c9fc3c17e3c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.217797 Oct 28 20:09:34.632530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 322/633] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:34 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:09:35.655095 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8cfb002d-bbfc-4ba8-a155-5637de1919c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:35.655713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8cfb002d-bbfc-4ba8-a155-5637de1919c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:35.657282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7d0960c7-d789-4fe1-aa68-389fe92c1354 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:35.657958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7d0960c7-d789-4fe1-aa68-389fe92c1354 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:35.662612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cfb002d-bbfc-4ba8-a155-5637de1919c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:35.663175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cfb002d-bbfc-4ba8-a155-5637de1919c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:35.663617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cfb002d-bbfc-4ba8-a155-5637de1919c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:35.664100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d0960c7-d789-4fe1-aa68-389fe92c1354 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:35.664319 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cfb002d-bbfc-4ba8-a155-5637de1919c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:35.664576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d0960c7-d789-4fe1-aa68-389fe92c1354 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:35.664779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cfb002d-bbfc-4ba8-a155-5637de1919c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:35.665005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d0960c7-d789-4fe1-aa68-389fe92c1354 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:35.665232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cfb002d-bbfc-4ba8-a155-5637de1919c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:35.665711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d0960c7-d789-4fe1-aa68-389fe92c1354 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:35.666169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d0960c7-d789-4fe1-aa68-389fe92c1354 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:35.666589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d0960c7-d789-4fe1-aa68-389fe92c1354 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:35.860808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7d0960c7-d789-4fe1-aa68-389fe92c1354 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:35.870050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8cfb002d-bbfc-4ba8-a155-5637de1919c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:35.871488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7d0960c7-d789-4fe1-aa68-389fe92c1354 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:35.873105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7d0960c7-d789-4fe1-aa68-389fe92c1354 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:35.875042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7d0960c7-d789-4fe1-aa68-389fe92c1354 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.220945 Oct 28 20:09:35.880914 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8cfb002d-bbfc-4ba8-a155-5637de1919c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.229784 Oct 28 20:09:35.881960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 312/634] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:35 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:35.882766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 323/635] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:35 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:09:36.899908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a73d01c1-197f-4acd-8055-fa6d610d4d5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:36.900648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a73d01c1-197f-4acd-8055-fa6d610d4d5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:36.903546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-de877088-acd0-4323-bc3e-bc3bfd796909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:36.904156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-de877088-acd0-4323-bc3e-bc3bfd796909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:36.908254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a73d01c1-197f-4acd-8055-fa6d610d4d5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:36.910285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a73d01c1-197f-4acd-8055-fa6d610d4d5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:36.910750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a73d01c1-197f-4acd-8055-fa6d610d4d5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:36.911308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de877088-acd0-4323-bc3e-bc3bfd796909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:36.911448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a73d01c1-197f-4acd-8055-fa6d610d4d5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:36.911792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de877088-acd0-4323-bc3e-bc3bfd796909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:36.911923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a73d01c1-197f-4acd-8055-fa6d610d4d5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:36.912230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de877088-acd0-4323-bc3e-bc3bfd796909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:36.912341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a73d01c1-197f-4acd-8055-fa6d610d4d5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:36.912921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de877088-acd0-4323-bc3e-bc3bfd796909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:36.913435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de877088-acd0-4323-bc3e-bc3bfd796909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:36.913858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de877088-acd0-4323-bc3e-bc3bfd796909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:37.113589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a73d01c1-197f-4acd-8055-fa6d610d4d5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:37.117985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-de877088-acd0-4323-bc3e-bc3bfd796909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:37.122594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a73d01c1-197f-4acd-8055-fa6d610d4d5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:37.124037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a73d01c1-197f-4acd-8055-fa6d610d4d5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:37.125983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-de877088-acd0-4323-bc3e-bc3bfd796909 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.226256 Oct 28 20:09:37.126120 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a73d01c1-197f-4acd-8055-fa6d610d4d5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.230093 Oct 28 20:09:37.126555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 324/636] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:36 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:37.126729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 313/637] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:36 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:38.149307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7eec54f8-13d1-41e5-942e-0ee8a6c2188d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:38.150060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7eec54f8-13d1-41e5-942e-0ee8a6c2188d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:38.151786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e9c33c43-9ba5-4342-9dfd-95ff3f547fea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:38.152952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e9c33c43-9ba5-4342-9dfd-95ff3f547fea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:38.157091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7eec54f8-13d1-41e5-942e-0ee8a6c2188d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:38.157609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7eec54f8-13d1-41e5-942e-0ee8a6c2188d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:38.158044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7eec54f8-13d1-41e5-942e-0ee8a6c2188d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:38.158767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7eec54f8-13d1-41e5-942e-0ee8a6c2188d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:38.159219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7eec54f8-13d1-41e5-942e-0ee8a6c2188d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:38.159641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7eec54f8-13d1-41e5-942e-0ee8a6c2188d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:38.160703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c33c43-9ba5-4342-9dfd-95ff3f547fea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:38.161200 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c33c43-9ba5-4342-9dfd-95ff3f547fea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:38.161668 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c33c43-9ba5-4342-9dfd-95ff3f547fea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:38.162372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c33c43-9ba5-4342-9dfd-95ff3f547fea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:38.162828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c33c43-9ba5-4342-9dfd-95ff3f547fea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:38.163257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c33c43-9ba5-4342-9dfd-95ff3f547fea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:38.362465 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e9c33c43-9ba5-4342-9dfd-95ff3f547fea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:38.364709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7eec54f8-13d1-41e5-942e-0ee8a6c2188d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:38.371277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e9c33c43-9ba5-4342-9dfd-95ff3f547fea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:38.372238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7eec54f8-13d1-41e5-942e-0ee8a6c2188d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.226817 Oct 28 20:09:38.372746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e9c33c43-9ba5-4342-9dfd-95ff3f547fea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:38.372920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 325/638] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:38 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:38.374416 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e9c33c43-9ba5-4342-9dfd-95ff3f547fea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.226365 Oct 28 20:09:38.375271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 314/639] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:38 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:39.395544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-206b9230-c796-4df8-81db-1a4d489864b9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:39.396152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-206b9230-c796-4df8-81db-1a4d489864b9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:39.400119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-12462e7b-f2ad-4421-8347-84f869f75608 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:39.400734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-12462e7b-f2ad-4421-8347-84f869f75608 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:39.402697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-206b9230-c796-4df8-81db-1a4d489864b9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:39.403179 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-206b9230-c796-4df8-81db-1a4d489864b9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:39.403610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-206b9230-c796-4df8-81db-1a4d489864b9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:39.404294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-206b9230-c796-4df8-81db-1a4d489864b9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:39.404744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-206b9230-c796-4df8-81db-1a4d489864b9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:39.405161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-206b9230-c796-4df8-81db-1a4d489864b9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:39.407510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12462e7b-f2ad-4421-8347-84f869f75608 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:39.408003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12462e7b-f2ad-4421-8347-84f869f75608 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:39.408648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12462e7b-f2ad-4421-8347-84f869f75608 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:39.409563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12462e7b-f2ad-4421-8347-84f869f75608 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:39.410042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:39.411597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12462e7b-f2ad-4421-8347-84f869f75608 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:39.411862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12462e7b-f2ad-4421-8347-84f869f75608 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:39.603182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-206b9230-c796-4df8-81db-1a4d489864b9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:39.606483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-12462e7b-f2ad-4421-8347-84f869f75608 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:39.611465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-206b9230-c796-4df8-81db-1a4d489864b9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.219821 Oct 28 20:09:39.612030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 326/640] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:39 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:39.615779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-12462e7b-f2ad-4421-8347-84f869f75608 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:39.617388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-12462e7b-f2ad-4421-8347-84f869f75608 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:39.618542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-12462e7b-f2ad-4421-8347-84f869f75608 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.222613 Oct 28 20:09:39.619089 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 315/641] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:39 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:09:40.573742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5045ec8-60c6-45ac-9794-47a61d283bb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:40.574331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f5045ec8-60c6-45ac-9794-47a61d283bb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:40.581122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5045ec8-60c6-45ac-9794-47a61d283bb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:40.581630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5045ec8-60c6-45ac-9794-47a61d283bb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:40.582070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5045ec8-60c6-45ac-9794-47a61d283bb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:40.582764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5045ec8-60c6-45ac-9794-47a61d283bb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:40.583218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5045ec8-60c6-45ac-9794-47a61d283bb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:40.583645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5045ec8-60c6-45ac-9794-47a61d283bb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:40.606797 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5045ec8-60c6-45ac-9794-47a61d283bb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2/ips" status: 200 len: 150 microversion: 2.1 time: 0.037022 Oct 28 20:09:40.607352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 327/642] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Oct 28 20:09:40 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:40.619042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-390b2512-dd14-4798-9ea0-d298733e1dcc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16204884-676d-4bca-84aa-d82d6ab87d89"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:40.621478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-390b2512-dd14-4798-9ea0-d298733e1dcc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:40.628090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-390b2512-dd14-4798-9ea0-d298733e1dcc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:40.628569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-390b2512-dd14-4798-9ea0-d298733e1dcc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:40.629007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-390b2512-dd14-4798-9ea0-d298733e1dcc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:40.629732 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-390b2512-dd14-4798-9ea0-d298733e1dcc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:40.630189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-390b2512-dd14-4798-9ea0-d298733e1dcc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:40.630614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-390b2512-dd14-4798-9ea0-d298733e1dcc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:40.634496 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3cdd9463-1f6f-48e0-a566-ef4b64a0c2e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:40.635116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3cdd9463-1f6f-48e0-a566-ef4b64a0c2e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:40.641582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cdd9463-1f6f-48e0-a566-ef4b64a0c2e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:40.642075 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cdd9463-1f6f-48e0-a566-ef4b64a0c2e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:40.642516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cdd9463-1f6f-48e0-a566-ef4b64a0c2e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:40.643217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cdd9463-1f6f-48e0-a566-ef4b64a0c2e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:40.643675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cdd9463-1f6f-48e0-a566-ef4b64a0c2e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:40.644101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cdd9463-1f6f-48e0-a566-ef4b64a0c2e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:40.712528 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-390b2512-dd14-4798-9ea0-d298733e1dcc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] HTTP exception thrown: Invalid volume: volume 16204884-676d-4bca-84aa-d82d6ab87d89 is already attached to instances: 83fb8150-cbd4-4139-bb47-a0fd318f8b86 Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-390b2512-dd14-4798-9ea0-d298733e1dcc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Request method failure captured: Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2/os-volume_attachments HTTP/1.1 Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 74 Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDYMvyQboftNRryWd3Rs40sLFlwhGaFtwYfaIeJnxRaNivrbjxkcoU7hik0GmB2LCAF23QhzK0jde7TY6jjLMWtp3be2qb3ioW4B_DmUzK25G3ialtqsuYDsquFjDhl4JMbgP7SnsYrOor-VBrDZUeFYQ9rlIGxqZsR02x8jWolIc1k Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:09:40.714389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:09:40.715915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_940ce72c42534c5196dfb909cc2a8d54", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:09:40.715915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:09:40.715915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:09:40.715915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:09:40.715915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:09:40.715915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:09:40.715915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:09:40.715915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: 724baaa4aa834e609fe4f513f9fc0b4b Oct 28 20:09:40.715915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:09:40.715915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Oct 28 20:09:40.715915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {"volumeAttachment": {"volumeId": "16204884-676d-4bca-84aa-d82d6ab87d89"}} Oct 28 20:09:40.715915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Invalid volume: volume 16204884-676d-4bca-84aa-d82d6ab87d89 is already attached to instances: 83fb8150-cbd4-4139-bb47-a0fd318f8b86 Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'server_id': 'b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2', 'body': {'volumeAttachment': {'volumeId': '16204884-676d-4bca-84aa-d82d6ab87d89'}}} Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 16204884-676d-4bca-84aa-d82d6ab87d89 is already attached to instances: 83fb8150-cbd4-4139-bb47-a0fd318f8b86 Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:09:40.716703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 16204884-676d-4bca-84aa-d82d6ab87d89 is already attached to instances: 83fb8150-cbd4-4139-bb47-a0fd318f8b86 Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:09:40.718605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:09:40.720204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:09:40.720204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:09:40.720204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:09:40.720204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 16204884-676d-4bca-84aa-d82d6ab87d89 is already attached to instances: 83fb8150-cbd4-4139-bb47-a0fd318f8b86 Oct 28 20:09:40.720204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:09:40.720204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-390b2512-dd14-4798-9ea0-d298733e1dcc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Returning 400 to user: Invalid volume: volume 16204884-676d-4bca-84aa-d82d6ab87d89 is already attached to instances: 83fb8150-cbd4-4139-bb47-a0fd318f8b86 {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:09:40.720204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-390b2512-dd14-4798-9ea0-d298733e1dcc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "POST /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101475 Oct 28 20:09:40.720204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 316/643] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Oct 28 20:09:40 2022] POST /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 20:09:40.722361 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-94a8bd43-9aae-40a4-835c-143ddc2a1dc8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:40.722965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-94a8bd43-9aae-40a4-835c-143ddc2a1dc8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:40.729412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94a8bd43-9aae-40a4-835c-143ddc2a1dc8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:40.729904 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94a8bd43-9aae-40a4-835c-143ddc2a1dc8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:40.730589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94a8bd43-9aae-40a4-835c-143ddc2a1dc8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:40.731017 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94a8bd43-9aae-40a4-835c-143ddc2a1dc8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:40.731595 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94a8bd43-9aae-40a4-835c-143ddc2a1dc8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:40.731886 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94a8bd43-9aae-40a4-835c-143ddc2a1dc8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:40.810906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3cdd9463-1f6f-48e0-a566-ef4b64a0c2e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:40.819095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3cdd9463-1f6f-48e0-a566-ef4b64a0c2e6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.188261 Oct 28 20:09:40.819681 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 328/644] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:40 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:40.824219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6a628f96-e61d-499a-bbb0-067f1d0534b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:40.825009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6a628f96-e61d-499a-bbb0-067f1d0534b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:40.831041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a628f96-e61d-499a-bbb0-067f1d0534b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:40.831524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a628f96-e61d-499a-bbb0-067f1d0534b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:40.831963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a628f96-e61d-499a-bbb0-067f1d0534b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:40.832653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a628f96-e61d-499a-bbb0-067f1d0534b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:40.833261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a628f96-e61d-499a-bbb0-067f1d0534b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:40.833859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a628f96-e61d-499a-bbb0-067f1d0534b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:40.859838 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6a628f96-e61d-499a-bbb0-067f1d0534b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:09:40.874859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-94a8bd43-9aae-40a4-835c-143ddc2a1dc8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:40.883453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-94a8bd43-9aae-40a4-835c-143ddc2a1dc8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:40.884906 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-94a8bd43-9aae-40a4-835c-143ddc2a1dc8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:40.886098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-94a8bd43-9aae-40a4-835c-143ddc2a1dc8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.168134 Oct 28 20:09:40.887611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 317/645] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:40 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:41.138451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6a628f96-e61d-499a-bbb0-067f1d0534b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 204 len: 0 microversion: 2.1 time: 0.317533 Oct 28 20:09:41.139037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 329/646] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:09:40 2022] DELETE /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:09:41.148617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a82bd4ed-c4f8-4aae-b5e8-a90dfa7a6528 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:41.149226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a82bd4ed-c4f8-4aae-b5e8-a90dfa7a6528 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:41.155713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a82bd4ed-c4f8-4aae-b5e8-a90dfa7a6528 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:41.156426 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a82bd4ed-c4f8-4aae-b5e8-a90dfa7a6528 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:41.156798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a82bd4ed-c4f8-4aae-b5e8-a90dfa7a6528 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:41.157525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a82bd4ed-c4f8-4aae-b5e8-a90dfa7a6528 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:41.158059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a82bd4ed-c4f8-4aae-b5e8-a90dfa7a6528 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:41.158639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a82bd4ed-c4f8-4aae-b5e8-a90dfa7a6528 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:41.295319 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a82bd4ed-c4f8-4aae-b5e8-a90dfa7a6528 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:41.303770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a82bd4ed-c4f8-4aae-b5e8-a90dfa7a6528 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1682 microversion: 2.1 time: 0.158875 Oct 28 20:09:41.304310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 318/647] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:41 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:41.842628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0db612ad-4875-42ec-8d63-81a7167e0018 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:41.843836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0db612ad-4875-42ec-8d63-81a7167e0018 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:41.850278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db612ad-4875-42ec-8d63-81a7167e0018 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:41.850782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db612ad-4875-42ec-8d63-81a7167e0018 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:41.851212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db612ad-4875-42ec-8d63-81a7167e0018 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:41.851899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db612ad-4875-42ec-8d63-81a7167e0018 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:41.852347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db612ad-4875-42ec-8d63-81a7167e0018 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:41.852767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db612ad-4875-42ec-8d63-81a7167e0018 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:41.912329 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-45ef0d86-25ec-4c70-a1eb-d491cc042703 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:41.912935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-45ef0d86-25ec-4c70-a1eb-d491cc042703 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:41.919233 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45ef0d86-25ec-4c70-a1eb-d491cc042703 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:41.919722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45ef0d86-25ec-4c70-a1eb-d491cc042703 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:41.920157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45ef0d86-25ec-4c70-a1eb-d491cc042703 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:41.920849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45ef0d86-25ec-4c70-a1eb-d491cc042703 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:41.921310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45ef0d86-25ec-4c70-a1eb-d491cc042703 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:41.921763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45ef0d86-25ec-4c70-a1eb-d491cc042703 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:42.025334 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0db612ad-4875-42ec-8d63-81a7167e0018 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:42.038603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0db612ad-4875-42ec-8d63-81a7167e0018 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.200299 Oct 28 20:09:42.039171 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 330/648] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:41 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:42.069249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-45ef0d86-25ec-4c70-a1eb-d491cc042703 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:42.078481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-45ef0d86-25ec-4c70-a1eb-d491cc042703 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:42.079922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-45ef0d86-25ec-4c70-a1eb-d491cc042703 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:42.081109 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-45ef0d86-25ec-4c70-a1eb-d491cc042703 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.172699 Oct 28 20:09:42.081684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 319/649] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:41 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:09:42.329207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b67fe698-0877-4a99-b33f-5378c561ebb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:42.329939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b67fe698-0877-4a99-b33f-5378c561ebb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:42.336741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b67fe698-0877-4a99-b33f-5378c561ebb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:42.337227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b67fe698-0877-4a99-b33f-5378c561ebb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:42.337955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b67fe698-0877-4a99-b33f-5378c561ebb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:42.338682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b67fe698-0877-4a99-b33f-5378c561ebb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:42.339193 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b67fe698-0877-4a99-b33f-5378c561ebb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:42.339638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b67fe698-0877-4a99-b33f-5378c561ebb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:42.483132 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b67fe698-0877-4a99-b33f-5378c561ebb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:42.492124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b67fe698-0877-4a99-b33f-5378c561ebb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1682 microversion: 2.1 time: 0.167541 Oct 28 20:09:42.492679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 331/650] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:42 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:43.062568 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-af1cc18e-51a2-4345-8fdd-9e7521ca3abf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:43.063177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-af1cc18e-51a2-4345-8fdd-9e7521ca3abf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:43.069511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af1cc18e-51a2-4345-8fdd-9e7521ca3abf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:43.069990 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af1cc18e-51a2-4345-8fdd-9e7521ca3abf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:43.070421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af1cc18e-51a2-4345-8fdd-9e7521ca3abf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:43.071110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af1cc18e-51a2-4345-8fdd-9e7521ca3abf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:43.071557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af1cc18e-51a2-4345-8fdd-9e7521ca3abf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:43.071977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af1cc18e-51a2-4345-8fdd-9e7521ca3abf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:43.107451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82825c9f-d76c-4f03-9029-26fd96e7728e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:43.108680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-82825c9f-d76c-4f03-9029-26fd96e7728e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:43.115153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82825c9f-d76c-4f03-9029-26fd96e7728e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:43.115648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82825c9f-d76c-4f03-9029-26fd96e7728e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:43.116087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82825c9f-d76c-4f03-9029-26fd96e7728e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:43.116819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82825c9f-d76c-4f03-9029-26fd96e7728e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:43.117485 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82825c9f-d76c-4f03-9029-26fd96e7728e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:43.118076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82825c9f-d76c-4f03-9029-26fd96e7728e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:43.261934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-af1cc18e-51a2-4345-8fdd-9e7521ca3abf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:43.270473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-af1cc18e-51a2-4345-8fdd-9e7521ca3abf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.212191 Oct 28 20:09:43.281999 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 320/651] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:43 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:43.294729 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-82825c9f-d76c-4f03-9029-26fd96e7728e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:43.304173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-82825c9f-d76c-4f03-9029-26fd96e7728e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:43.306065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-82825c9f-d76c-4f03-9029-26fd96e7728e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:43.307238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-82825c9f-d76c-4f03-9029-26fd96e7728e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.203807 Oct 28 20:09:43.307806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 332/652] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:43 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:09:43.521706 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-15aabc52-df6d-4189-b7fa-f52114dd0d98 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:43.522382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-15aabc52-df6d-4189-b7fa-f52114dd0d98 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:43.528506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15aabc52-df6d-4189-b7fa-f52114dd0d98 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:43.528995 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15aabc52-df6d-4189-b7fa-f52114dd0d98 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:43.529491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15aabc52-df6d-4189-b7fa-f52114dd0d98 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:43.530430 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15aabc52-df6d-4189-b7fa-f52114dd0d98 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:43.530935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15aabc52-df6d-4189-b7fa-f52114dd0d98 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:43.531772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15aabc52-df6d-4189-b7fa-f52114dd0d98 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:43.598699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-15aabc52-df6d-4189-b7fa-f52114dd0d98 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:43.606937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-15aabc52-df6d-4189-b7fa-f52114dd0d98 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1614 microversion: 2.1 time: 0.089539 Oct 28 20:09:43.607511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 321/653] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:43 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:43.816821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-36d3218d-90c4-4b43-a3a3-58584893f93c req-eea3846b-5447-4deb-adb0-7337cf16580f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2", "name": "network-vif-deleted", "tag": "85e3fd0b-83fb-48bf-8cd7-071823c4c38c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:43.827185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-36d3218d-90c4-4b43-a3a3-58584893f93c req-eea3846b-5447-4deb-adb0-7337cf16580f service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:43.829245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-36d3218d-90c4-4b43-a3a3-58584893f93c req-eea3846b-5447-4deb-adb0-7337cf16580f service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:43.829245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-36d3218d-90c4-4b43-a3a3-58584893f93c req-eea3846b-5447-4deb-adb0-7337cf16580f service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:43.840026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-36d3218d-90c4-4b43-a3a3-58584893f93c req-eea3846b-5447-4deb-adb0-7337cf16580f service nova] Creating event network-vif-deleted:85e3fd0b-83fb-48bf-8cd7-071823c4c38c for instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 on hv-cinder-86236 Oct 28 20:09:43.845624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-36d3218d-90c4-4b43-a3a3-58584893f93c req-eea3846b-5447-4deb-adb0-7337cf16580f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032378 Oct 28 20:09:43.846229 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 333/654] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:44.295367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4331dd71-69b9-42f4-a7b1-5155eae30424 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:44.297161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4331dd71-69b9-42f4-a7b1-5155eae30424 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:44.306232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4331dd71-69b9-42f4-a7b1-5155eae30424 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:44.307265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4331dd71-69b9-42f4-a7b1-5155eae30424 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:44.308314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4331dd71-69b9-42f4-a7b1-5155eae30424 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:44.309222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4331dd71-69b9-42f4-a7b1-5155eae30424 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:44.310771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4331dd71-69b9-42f4-a7b1-5155eae30424 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:44.312256 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4331dd71-69b9-42f4-a7b1-5155eae30424 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:44.337377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d50d47c-d2f2-474d-a843-130389e1bd53 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:44.338095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4d50d47c-d2f2-474d-a843-130389e1bd53 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:44.347776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d50d47c-d2f2-474d-a843-130389e1bd53 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:44.348269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d50d47c-d2f2-474d-a843-130389e1bd53 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:44.348705 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d50d47c-d2f2-474d-a843-130389e1bd53 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:44.351482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d50d47c-d2f2-474d-a843-130389e1bd53 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:44.353499 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d50d47c-d2f2-474d-a843-130389e1bd53 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:44.356695 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d50d47c-d2f2-474d-a843-130389e1bd53 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:44.570765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d50d47c-d2f2-474d-a843-130389e1bd53 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:44.581058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d50d47c-d2f2-474d-a843-130389e1bd53 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:44.582926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d50d47c-d2f2-474d-a843-130389e1bd53 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:44.584484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4d50d47c-d2f2-474d-a843-130389e1bd53 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.254768 Oct 28 20:09:44.585425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 334/655] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:44 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:09:44.608350 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4331dd71-69b9-42f4-a7b1-5155eae30424 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:44.618396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4331dd71-69b9-42f4-a7b1-5155eae30424 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.328005 Oct 28 20:09:44.619074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 322/656] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:44 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:44.631889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5ac3db80-b3a7-42a5-9088-06d803a92c42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:44.632503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5ac3db80-b3a7-42a5-9088-06d803a92c42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:44.635767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:44.641166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ac3db80-b3a7-42a5-9088-06d803a92c42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:44.641926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ac3db80-b3a7-42a5-9088-06d803a92c42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:44.642379 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ac3db80-b3a7-42a5-9088-06d803a92c42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:44.643090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ac3db80-b3a7-42a5-9088-06d803a92c42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:44.643608 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ac3db80-b3a7-42a5-9088-06d803a92c42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:44.644040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ac3db80-b3a7-42a5-9088-06d803a92c42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:44.680218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ac3db80-b3a7-42a5-9088-06d803a92c42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:44.680825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ac3db80-b3a7-42a5-9088-06d803a92c42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:44.685044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ac3db80-b3a7-42a5-9088-06d803a92c42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:44.685044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-5ac3db80-b3a7-42a5-9088-06d803a92c42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lazy-loading 'fault' on Instance uuid b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:09:44.729081 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5ac3db80-b3a7-42a5-9088-06d803a92c42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:44.738769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5ac3db80-b3a7-42a5-9088-06d803a92c42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 200 len: 1331 microversion: 2.1 time: 0.111709 Oct 28 20:09:44.741480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 335/657] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:44 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:45.618719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b2e25d8d-39d8-479e-9605-a75ac59c0185 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:45.619333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b2e25d8d-39d8-479e-9605-a75ac59c0185 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:45.625628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2e25d8d-39d8-479e-9605-a75ac59c0185 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:45.626114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2e25d8d-39d8-479e-9605-a75ac59c0185 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:45.626548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2e25d8d-39d8-479e-9605-a75ac59c0185 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:45.627239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2e25d8d-39d8-479e-9605-a75ac59c0185 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:45.627695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2e25d8d-39d8-479e-9605-a75ac59c0185 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:45.628143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2e25d8d-39d8-479e-9605-a75ac59c0185 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:45.644979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1012e7aa-fdfe-4060-ad32-599b95520380 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:45.645790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1012e7aa-fdfe-4060-ad32-599b95520380 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:45.653577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1012e7aa-fdfe-4060-ad32-599b95520380 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:45.654161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1012e7aa-fdfe-4060-ad32-599b95520380 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:45.655445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1012e7aa-fdfe-4060-ad32-599b95520380 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:45.659943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1012e7aa-fdfe-4060-ad32-599b95520380 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:45.659943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1012e7aa-fdfe-4060-ad32-599b95520380 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:45.659943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1012e7aa-fdfe-4060-ad32-599b95520380 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:45.834337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b2e25d8d-39d8-479e-9605-a75ac59c0185 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:45.843436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1012e7aa-fdfe-4060-ad32-599b95520380 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:45.843627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b2e25d8d-39d8-479e-9605-a75ac59c0185 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:45.845027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b2e25d8d-39d8-479e-9605-a75ac59c0185 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:45.846424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b2e25d8d-39d8-479e-9605-a75ac59c0185 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.231568 Oct 28 20:09:45.851981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1012e7aa-fdfe-4060-ad32-599b95520380 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.213256 Oct 28 20:09:45.852742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 336/658] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:45 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:45.857733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6c131b98-d220-4d7b-a716-5874f8f9e4aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:45.859039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6c131b98-d220-4d7b-a716-5874f8f9e4aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:45.861681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 323/659] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:45 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:45.865927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c131b98-d220-4d7b-a716-5874f8f9e4aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:45.866414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c131b98-d220-4d7b-a716-5874f8f9e4aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:45.866930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c131b98-d220-4d7b-a716-5874f8f9e4aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:45.867667 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c131b98-d220-4d7b-a716-5874f8f9e4aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:45.868117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c131b98-d220-4d7b-a716-5874f8f9e4aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:45.868539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c131b98-d220-4d7b-a716-5874f8f9e4aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:45.884223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-6c131b98-d220-4d7b-a716-5874f8f9e4aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] HTTP exception thrown: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6c131b98-d220-4d7b-a716-5874f8f9e4aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Request method failure captured: Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 HTTP/1.1 Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYMvyQboftNRryWd3Rs40sLFlwhGaFtwYfaIeJnxRaNivrbjxkcoU7hik0GmB2LCAF23QhzK0jde7TY6jjLMWtp3be2qb3ioW4B_DmUzK25G3ialtqsuYDsquFjDhl4JMbgP7SnsYrOor-VBrDZUeFYQ9rlIGxqZsR02x8jWolIc1k Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:09:45.885964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:09:45.887508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_940ce72c42534c5196dfb909cc2a8d54", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:09:45.887508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:09:45.887508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:09:45.887508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:09:45.887508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:09:45.887508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:09:45.887508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:09:45.887508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: 724baaa4aa834e609fe4f513f9fc0b4b Oct 28 20:09:45.887508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:09:45.887508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:09:45.887508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. Oct 28 20:09:45.887508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': 'b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2'} Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:09:45.888498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. Oct 28 20:09:45.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:09:45.891492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6c131b98-d220-4d7b-a716-5874f8f9e4aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Returning 404 to user: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:09:45.891492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6c131b98-d220-4d7b-a716-5874f8f9e4aa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 404 len: 111 microversion: 2.1 time: 0.033525 Oct 28 20:09:45.891492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 337/660] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:45 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:09:45.896797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bee2c910-6c23-4e1a-9c36-da35cf21763a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '.version_select at 0x7f1f4cee8ee0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:45.957000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bee2c910-6c23-4e1a-9c36-da35cf21763a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141916370" status: 202 len: 0 microversion: 2.1 time: 0.063882 Oct 28 20:09:45.957575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 324/661] 10.222.0.66 () {58 vars in 1221 bytes} [Fri Oct 28 20:09:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141916370 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 20:09:46.706812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8b5dcc31-93ce-413d-adab-345e473c41b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:46.707313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8b5dcc31-93ce-413d-adab-345e473c41b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:46.713461 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b5dcc31-93ce-413d-adab-345e473c41b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:46.713946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b5dcc31-93ce-413d-adab-345e473c41b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:46.714392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b5dcc31-93ce-413d-adab-345e473c41b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:46.715087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b5dcc31-93ce-413d-adab-345e473c41b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:46.715567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b5dcc31-93ce-413d-adab-345e473c41b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:46.715968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b5dcc31-93ce-413d-adab-345e473c41b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:46.845033 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-8b5dcc31-93ce-413d-adab-345e473c41b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lazy-loading 'services' on Instance uuid 83fb8150-cbd4-4139-bb47-a0fd318f8b86 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:09:46.872004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0c913eb-2c29-4cbe-b947-a2e968257d61 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:46.872624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0c913eb-2c29-4cbe-b947-a2e968257d61 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:46.880773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c913eb-2c29-4cbe-b947-a2e968257d61 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:46.881262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c913eb-2c29-4cbe-b947-a2e968257d61 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:46.881724 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c913eb-2c29-4cbe-b947-a2e968257d61 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:46.882475 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c913eb-2c29-4cbe-b947-a2e968257d61 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:46.882939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c913eb-2c29-4cbe-b947-a2e968257d61 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:46.883362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c913eb-2c29-4cbe-b947-a2e968257d61 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:47.015368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0c913eb-2c29-4cbe-b947-a2e968257d61 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:47.024025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0c913eb-2c29-4cbe-b947-a2e968257d61 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:47.025560 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0c913eb-2c29-4cbe-b947-a2e968257d61 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:47.026948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0c913eb-2c29-4cbe-b947-a2e968257d61 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.158696 Oct 28 20:09:47.027497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 325/662] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:46 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:09:47.034633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a8df84b1-2b85-4c3c-99ce-f2f677ee3602 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:47.035405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a8df84b1-2b85-4c3c-99ce-f2f677ee3602 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:47.042298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8df84b1-2b85-4c3c-99ce-f2f677ee3602 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:47.042795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8df84b1-2b85-4c3c-99ce-f2f677ee3602 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:47.043256 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8df84b1-2b85-4c3c-99ce-f2f677ee3602 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:47.043941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8df84b1-2b85-4c3c-99ce-f2f677ee3602 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:47.044404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8df84b1-2b85-4c3c-99ce-f2f677ee3602 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:47.044831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8df84b1-2b85-4c3c-99ce-f2f677ee3602 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:47.048079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:47.091702 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8b5dcc31-93ce-413d-adab-345e473c41b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "DELETE /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments/16204884-676d-4bca-84aa-d82d6ab87d89" status: 202 len: 0 microversion: 2.1 time: 0.390078 Oct 28 20:09:47.092664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 338/663] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Oct 28 20:09:46 2022] DELETE /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments/16204884-676d-4bca-84aa-d82d6ab87d89 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:09:47.103438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8c78ee2e-b26c-406f-a8e4-2b078af10388 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:47.106248 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8c78ee2e-b26c-406f-a8e4-2b078af10388 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:47.114249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c78ee2e-b26c-406f-a8e4-2b078af10388 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:47.114733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c78ee2e-b26c-406f-a8e4-2b078af10388 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:47.115170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c78ee2e-b26c-406f-a8e4-2b078af10388 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:47.115866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c78ee2e-b26c-406f-a8e4-2b078af10388 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:47.116346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c78ee2e-b26c-406f-a8e4-2b078af10388 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:47.116772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c78ee2e-b26c-406f-a8e4-2b078af10388 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:47.148763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8c78ee2e-b26c-406f-a8e4-2b078af10388 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050966 Oct 28 20:09:47.149347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 339/664] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:09:47 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:09:47.184018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a8df84b1-2b85-4c3c-99ce-f2f677ee3602 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:47.192831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a8df84b1-2b85-4c3c-99ce-f2f677ee3602 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.163708 Oct 28 20:09:47.193450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 326/665] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:47 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:48.060875 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-99ae0e6a-344e-47b9-a214-3f1eb18b8ce8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:48.061824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-99ae0e6a-344e-47b9-a214-3f1eb18b8ce8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:48.068343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99ae0e6a-344e-47b9-a214-3f1eb18b8ce8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:48.068827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99ae0e6a-344e-47b9-a214-3f1eb18b8ce8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:48.069266 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99ae0e6a-344e-47b9-a214-3f1eb18b8ce8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:48.069977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99ae0e6a-344e-47b9-a214-3f1eb18b8ce8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:48.070436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99ae0e6a-344e-47b9-a214-3f1eb18b8ce8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:48.070859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99ae0e6a-344e-47b9-a214-3f1eb18b8ce8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:48.161149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0d1ce92-b686-4d34-96b6-54b8cc364074 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:48.163390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0d1ce92-b686-4d34-96b6-54b8cc364074 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:48.165793 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:48.171548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0d1ce92-b686-4d34-96b6-54b8cc364074 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:48.172036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0d1ce92-b686-4d34-96b6-54b8cc364074 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:48.172478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0d1ce92-b686-4d34-96b6-54b8cc364074 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:48.173178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0d1ce92-b686-4d34-96b6-54b8cc364074 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:48.173667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0d1ce92-b686-4d34-96b6-54b8cc364074 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:48.176940 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0d1ce92-b686-4d34-96b6-54b8cc364074 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:48.206407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c0d1ce92-b686-4d34-96b6-54b8cc364074 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049140 Oct 28 20:09:48.206983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 327/666] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:09:48 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:48.207466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-99ae0e6a-344e-47b9-a214-3f1eb18b8ce8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:48.216100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c08325e-bef3-4b56-8ca9-646e6f3b0529 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:48.216710 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-99ae0e6a-344e-47b9-a214-3f1eb18b8ce8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:48.216852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8c08325e-bef3-4b56-8ca9-646e6f3b0529 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:48.219820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-99ae0e6a-344e-47b9-a214-3f1eb18b8ce8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:48.220991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-99ae0e6a-344e-47b9-a214-3f1eb18b8ce8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.164108 Oct 28 20:09:48.221592 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 340/667] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:48 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:48.223429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c08325e-bef3-4b56-8ca9-646e6f3b0529 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:48.223915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c08325e-bef3-4b56-8ca9-646e6f3b0529 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:48.224354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c08325e-bef3-4b56-8ca9-646e6f3b0529 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:48.225047 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c08325e-bef3-4b56-8ca9-646e6f3b0529 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:48.225529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c08325e-bef3-4b56-8ca9-646e6f3b0529 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:48.225955 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c08325e-bef3-4b56-8ca9-646e6f3b0529 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:48.354117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8c08325e-bef3-4b56-8ca9-646e6f3b0529 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:48.362184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8c08325e-bef3-4b56-8ca9-646e6f3b0529 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.149686 Oct 28 20:09:48.362748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 328/668] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:48 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:49.219589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6bbf51b2-a531-4afe-9d56-79d1633d05ef tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:49.221827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6bbf51b2-a531-4afe-9d56-79d1633d05ef tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:49.228713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bbf51b2-a531-4afe-9d56-79d1633d05ef tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:49.229201 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bbf51b2-a531-4afe-9d56-79d1633d05ef tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:49.229673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bbf51b2-a531-4afe-9d56-79d1633d05ef tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:49.230368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bbf51b2-a531-4afe-9d56-79d1633d05ef tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:49.230825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bbf51b2-a531-4afe-9d56-79d1633d05ef tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:49.231250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bbf51b2-a531-4afe-9d56-79d1633d05ef tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:49.247501 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f427572f-a769-44b8-8879-d2d3a24115d6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:49.248123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f427572f-a769-44b8-8879-d2d3a24115d6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:49.255326 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f427572f-a769-44b8-8879-d2d3a24115d6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:49.255824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f427572f-a769-44b8-8879-d2d3a24115d6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:49.256269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f427572f-a769-44b8-8879-d2d3a24115d6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:49.256973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f427572f-a769-44b8-8879-d2d3a24115d6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:49.257292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:49.257457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f427572f-a769-44b8-8879-d2d3a24115d6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:49.257882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f427572f-a769-44b8-8879-d2d3a24115d6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:49.262025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6bbf51b2-a531-4afe-9d56-79d1633d05ef tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046715 Oct 28 20:09:49.266500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 341/669] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:09:49 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:49.384514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8976e047-6ebf-4225-87e5-c20c13ce4b95 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:49.385280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8976e047-6ebf-4225-87e5-c20c13ce4b95 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:49.388915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f427572f-a769-44b8-8879-d2d3a24115d6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:49.392819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8976e047-6ebf-4225-87e5-c20c13ce4b95 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:49.393308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8976e047-6ebf-4225-87e5-c20c13ce4b95 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:49.393834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8976e047-6ebf-4225-87e5-c20c13ce4b95 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:49.394644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8976e047-6ebf-4225-87e5-c20c13ce4b95 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:49.395098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8976e047-6ebf-4225-87e5-c20c13ce4b95 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:49.395704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8976e047-6ebf-4225-87e5-c20c13ce4b95 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:49.398303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f427572f-a769-44b8-8879-d2d3a24115d6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:49.399838 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f427572f-a769-44b8-8879-d2d3a24115d6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:49.403797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f427572f-a769-44b8-8879-d2d3a24115d6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.157482 Oct 28 20:09:49.403797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 329/670] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:49 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:09:49.525170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8976e047-6ebf-4225-87e5-c20c13ce4b95 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:49.532822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8976e047-6ebf-4225-87e5-c20c13ce4b95 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.152343 Oct 28 20:09:49.533392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 342/671] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:49 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:49.600085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-46221791-5fc1-4809-b185-094c61dc73e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "960fe9cc-8f7e-48eb-9abd-643a305f69b9"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:49.602524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-46221791-5fc1-4809-b185-094c61dc73e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:49.609143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46221791-5fc1-4809-b185-094c61dc73e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:49.609656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46221791-5fc1-4809-b185-094c61dc73e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:49.610152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46221791-5fc1-4809-b185-094c61dc73e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:49.610850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46221791-5fc1-4809-b185-094c61dc73e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:49.611303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46221791-5fc1-4809-b185-094c61dc73e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:49.611725 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46221791-5fc1-4809-b185-094c61dc73e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:50.275426 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9f21b834-2c00-4668-b479-c9f2150b478f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:50.277665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9f21b834-2c00-4668-b479-c9f2150b478f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:50.284161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f21b834-2c00-4668-b479-c9f2150b478f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:50.284640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f21b834-2c00-4668-b479-c9f2150b478f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:50.285078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f21b834-2c00-4668-b479-c9f2150b478f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:50.285840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f21b834-2c00-4668-b479-c9f2150b478f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:50.286295 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f21b834-2c00-4668-b479-c9f2150b478f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:50.286719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f21b834-2c00-4668-b479-c9f2150b478f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:50.317137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9f21b834-2c00-4668-b479-c9f2150b478f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045631 Oct 28 20:09:50.317721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 343/672] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:09:50 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:09:50.427497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7155a28e-9f86-4936-8870-5d4264f279de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:50.427851 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-46221791-5fc1-4809-b185-094c61dc73e2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "POST /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831585 Oct 28 20:09:50.428312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7155a28e-9f86-4936-8870-5d4264f279de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:50.428483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 330/673] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Oct 28 20:09:49 2022] POST /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72/os-volume_attachments => generated 194 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:50.434255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7155a28e-9f86-4936-8870-5d4264f279de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:50.434741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7155a28e-9f86-4936-8870-5d4264f279de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:50.435176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7155a28e-9f86-4936-8870-5d4264f279de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:50.436656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7155a28e-9f86-4936-8870-5d4264f279de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:50.437687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7155a28e-9f86-4936-8870-5d4264f279de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:50.438122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7155a28e-9f86-4936-8870-5d4264f279de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:50.558832 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fc92b662-cede-442b-8c89-76cd08cf2a42 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:50.559674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fc92b662-cede-442b-8c89-76cd08cf2a42 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:50.566974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc92b662-cede-442b-8c89-76cd08cf2a42 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:50.567565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc92b662-cede-442b-8c89-76cd08cf2a42 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:50.568343 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc92b662-cede-442b-8c89-76cd08cf2a42 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:50.569310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc92b662-cede-442b-8c89-76cd08cf2a42 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:50.569862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc92b662-cede-442b-8c89-76cd08cf2a42 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:50.570361 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc92b662-cede-442b-8c89-76cd08cf2a42 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:50.571386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7155a28e-9f86-4936-8870-5d4264f279de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:50.580452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7155a28e-9f86-4936-8870-5d4264f279de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:50.582116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7155a28e-9f86-4936-8870-5d4264f279de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:50.583307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7155a28e-9f86-4936-8870-5d4264f279de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.160502 Oct 28 20:09:50.584036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 344/674] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:50 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:09:50.708105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fc92b662-cede-442b-8c89-76cd08cf2a42 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:50.716116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fc92b662-cede-442b-8c89-76cd08cf2a42 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.163399 Oct 28 20:09:50.716683 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 331/675] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:50 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:51.330173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-35543355-cb86-4031-8fec-33ab2328ff45 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:51.332244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-35543355-cb86-4031-8fec-33ab2328ff45 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:51.338895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35543355-cb86-4031-8fec-33ab2328ff45 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:51.339380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35543355-cb86-4031-8fec-33ab2328ff45 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:51.339818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35543355-cb86-4031-8fec-33ab2328ff45 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:51.340505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35543355-cb86-4031-8fec-33ab2328ff45 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:51.340960 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35543355-cb86-4031-8fec-33ab2328ff45 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:51.341411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35543355-cb86-4031-8fec-33ab2328ff45 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:51.371938 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-35543355-cb86-4031-8fec-33ab2328ff45 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046229 Oct 28 20:09:51.372488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 345/676] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:09:51 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:51.609356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b540f12a-58ef-4e6d-b8c7-c0eb5709529a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:51.609914 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b540f12a-58ef-4e6d-b8c7-c0eb5709529a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:51.616125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b540f12a-58ef-4e6d-b8c7-c0eb5709529a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:51.616602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b540f12a-58ef-4e6d-b8c7-c0eb5709529a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:51.617033 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b540f12a-58ef-4e6d-b8c7-c0eb5709529a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:51.617742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b540f12a-58ef-4e6d-b8c7-c0eb5709529a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:51.618189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b540f12a-58ef-4e6d-b8c7-c0eb5709529a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:51.618606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b540f12a-58ef-4e6d-b8c7-c0eb5709529a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:51.739663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4f8c49c4-9db0-4529-a28e-21053f0c2c7b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:51.740272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4f8c49c4-9db0-4529-a28e-21053f0c2c7b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:51.746091 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b540f12a-58ef-4e6d-b8c7-c0eb5709529a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:51.746238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8c49c4-9db0-4529-a28e-21053f0c2c7b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:51.746699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8c49c4-9db0-4529-a28e-21053f0c2c7b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:51.747127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8c49c4-9db0-4529-a28e-21053f0c2c7b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:51.747804 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8c49c4-9db0-4529-a28e-21053f0c2c7b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:51.748915 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8c49c4-9db0-4529-a28e-21053f0c2c7b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:51.749509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8c49c4-9db0-4529-a28e-21053f0c2c7b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:51.755759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b540f12a-58ef-4e6d-b8c7-c0eb5709529a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:51.757211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b540f12a-58ef-4e6d-b8c7-c0eb5709529a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:51.758390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b540f12a-58ef-4e6d-b8c7-c0eb5709529a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.153079 Oct 28 20:09:51.758949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 332/677] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:51 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:51.880366 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f8c49c4-9db0-4529-a28e-21053f0c2c7b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:51.887842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4f8c49c4-9db0-4529-a28e-21053f0c2c7b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.152028 Oct 28 20:09:51.888390 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 346/678] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:51 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:52.384260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7fa9ddd5-a3cb-417c-a4f6-f7df27db975f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:52.386538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7fa9ddd5-a3cb-417c-a4f6-f7df27db975f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:52.393013 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fa9ddd5-a3cb-417c-a4f6-f7df27db975f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:52.396949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fa9ddd5-a3cb-417c-a4f6-f7df27db975f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:52.396949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fa9ddd5-a3cb-417c-a4f6-f7df27db975f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:52.396949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fa9ddd5-a3cb-417c-a4f6-f7df27db975f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:52.396949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fa9ddd5-a3cb-417c-a4f6-f7df27db975f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:52.397341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fa9ddd5-a3cb-417c-a4f6-f7df27db975f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:52.424834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7fa9ddd5-a3cb-417c-a4f6-f7df27db975f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044679 Oct 28 20:09:52.425392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 333/679] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:09:52 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:52.784685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-af7e5285-3b76-4719-9f89-15492e4ebafc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:52.785292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-af7e5285-3b76-4719-9f89-15492e4ebafc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:52.791884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af7e5285-3b76-4719-9f89-15492e4ebafc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:52.792361 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af7e5285-3b76-4719-9f89-15492e4ebafc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:52.792786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af7e5285-3b76-4719-9f89-15492e4ebafc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:52.793495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af7e5285-3b76-4719-9f89-15492e4ebafc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:52.793941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af7e5285-3b76-4719-9f89-15492e4ebafc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:52.794355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af7e5285-3b76-4719-9f89-15492e4ebafc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:52.911029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ff55932-c5bd-4628-ac1b-1ca4ada19765 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:52.911803 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6ff55932-c5bd-4628-ac1b-1ca4ada19765 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:52.925516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ff55932-c5bd-4628-ac1b-1ca4ada19765 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:52.926014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ff55932-c5bd-4628-ac1b-1ca4ada19765 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:52.926450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ff55932-c5bd-4628-ac1b-1ca4ada19765 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:52.927157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ff55932-c5bd-4628-ac1b-1ca4ada19765 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:52.927535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-af7e5285-3b76-4719-9f89-15492e4ebafc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:52.927654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ff55932-c5bd-4628-ac1b-1ca4ada19765 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:52.928020 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ff55932-c5bd-4628-ac1b-1ca4ada19765 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:52.936536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-af7e5285-3b76-4719-9f89-15492e4ebafc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:52.938028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-af7e5285-3b76-4719-9f89-15492e4ebafc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:52.939247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-af7e5285-3b76-4719-9f89-15492e4ebafc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.158590 Oct 28 20:09:52.939807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 347/680] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:52 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:53.061613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6ff55932-c5bd-4628-ac1b-1ca4ada19765 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:53.069120 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6ff55932-c5bd-4628-ac1b-1ca4ada19765 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.161952 Oct 28 20:09:53.069699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 334/681] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:52 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:53.438242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9cc81db6-1184-4262-a357-fc2c00b505a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:53.440292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9cc81db6-1184-4262-a357-fc2c00b505a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:53.446222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cc81db6-1184-4262-a357-fc2c00b505a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:53.446704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cc81db6-1184-4262-a357-fc2c00b505a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:53.447146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cc81db6-1184-4262-a357-fc2c00b505a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:53.447828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cc81db6-1184-4262-a357-fc2c00b505a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:53.448283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cc81db6-1184-4262-a357-fc2c00b505a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:53.448709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cc81db6-1184-4262-a357-fc2c00b505a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:53.478653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9cc81db6-1184-4262-a357-fc2c00b505a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045419 Oct 28 20:09:53.479196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 348/682] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:09:53 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:53.964636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c986a99-4f17-41b1-960c-c31a6ad39384 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:53.965251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7c986a99-4f17-41b1-960c-c31a6ad39384 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:53.972779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c986a99-4f17-41b1-960c-c31a6ad39384 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:53.973266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c986a99-4f17-41b1-960c-c31a6ad39384 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:53.973741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c986a99-4f17-41b1-960c-c31a6ad39384 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:53.974430 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c986a99-4f17-41b1-960c-c31a6ad39384 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:53.974891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c986a99-4f17-41b1-960c-c31a6ad39384 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:53.975320 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c986a99-4f17-41b1-960c-c31a6ad39384 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:54.084969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc78812d-5069-4914-8d01-b41ebed69baa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:54.085882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dc78812d-5069-4914-8d01-b41ebed69baa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:54.092793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc78812d-5069-4914-8d01-b41ebed69baa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:54.093366 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc78812d-5069-4914-8d01-b41ebed69baa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:54.093871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc78812d-5069-4914-8d01-b41ebed69baa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:54.094912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc78812d-5069-4914-8d01-b41ebed69baa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:54.095453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc78812d-5069-4914-8d01-b41ebed69baa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:54.095936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc78812d-5069-4914-8d01-b41ebed69baa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:54.104414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7c986a99-4f17-41b1-960c-c31a6ad39384 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:54.113696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7c986a99-4f17-41b1-960c-c31a6ad39384 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:54.115149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7c986a99-4f17-41b1-960c-c31a6ad39384 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:54.116311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c986a99-4f17-41b1-960c-c31a6ad39384 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.155858 Oct 28 20:09:54.116874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 335/683] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:53 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:54.121381 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f90fab14-990d-4336-86fd-b374a43fa866 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:54.121895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f90fab14-990d-4336-86fd-b374a43fa866 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:54.127826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f90fab14-990d-4336-86fd-b374a43fa866 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:54.128317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f90fab14-990d-4336-86fd-b374a43fa866 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:54.128761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f90fab14-990d-4336-86fd-b374a43fa866 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:54.129488 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f90fab14-990d-4336-86fd-b374a43fa866 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:54.129950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f90fab14-990d-4336-86fd-b374a43fa866 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:54.130382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f90fab14-990d-4336-86fd-b374a43fa866 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:54.179232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-dc78812d-5069-4914-8d01-b41ebed69baa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lazy-loading 'services' on Instance uuid 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:09:54.265981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f90fab14-990d-4336-86fd-b374a43fa866 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:54.273524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f90fab14-990d-4336-86fd-b374a43fa866 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.155641 Oct 28 20:09:54.274090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 336/684] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:54 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:54.382597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc78812d-5069-4914-8d01-b41ebed69baa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments/5c11093d-2660-4ab4-990d-7931e2c42415" status: 202 len: 0 microversion: 2.1 time: 0.301343 Oct 28 20:09:54.383254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 349/685] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Oct 28 20:09:54 2022] DELETE /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments/5c11093d-2660-4ab4-990d-7931e2c42415 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 20:09:54.491641 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5176636e-5db8-4901-9bbc-d7e3837b8a8d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:54.493779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5176636e-5db8-4901-9bbc-d7e3837b8a8d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:54.500498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5176636e-5db8-4901-9bbc-d7e3837b8a8d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:54.501037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5176636e-5db8-4901-9bbc-d7e3837b8a8d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:54.501575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5176636e-5db8-4901-9bbc-d7e3837b8a8d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:54.502351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5176636e-5db8-4901-9bbc-d7e3837b8a8d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:54.502811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5176636e-5db8-4901-9bbc-d7e3837b8a8d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:54.503291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5176636e-5db8-4901-9bbc-d7e3837b8a8d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:54.533808 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5176636e-5db8-4901-9bbc-d7e3837b8a8d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046144 Oct 28 20:09:54.534602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 337/686] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:09:54 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:55.144892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bfd292d2-9a87-4582-a310-527d8496269f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:55.145543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bfd292d2-9a87-4582-a310-527d8496269f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:55.151604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfd292d2-9a87-4582-a310-527d8496269f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:55.152082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfd292d2-9a87-4582-a310-527d8496269f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:55.152513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfd292d2-9a87-4582-a310-527d8496269f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:55.153183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfd292d2-9a87-4582-a310-527d8496269f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:55.153655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfd292d2-9a87-4582-a310-527d8496269f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:55.154073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfd292d2-9a87-4582-a310-527d8496269f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:55.283401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bfd292d2-9a87-4582-a310-527d8496269f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:55.291778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bfd292d2-9a87-4582-a310-527d8496269f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:55.293217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bfd292d2-9a87-4582-a310-527d8496269f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:55.294396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bfd292d2-9a87-4582-a310-527d8496269f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.154384 Oct 28 20:09:55.305343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 350/687] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:55 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:55.305520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a80a6ea2-880c-4a7a-84b5-e0e17a880276 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:55.305520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a80a6ea2-880c-4a7a-84b5-e0e17a880276 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:55.305520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a80a6ea2-880c-4a7a-84b5-e0e17a880276 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:55.305520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a80a6ea2-880c-4a7a-84b5-e0e17a880276 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:55.306206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a80a6ea2-880c-4a7a-84b5-e0e17a880276 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:55.306206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a80a6ea2-880c-4a7a-84b5-e0e17a880276 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:55.306206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a80a6ea2-880c-4a7a-84b5-e0e17a880276 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:55.306451 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a80a6ea2-880c-4a7a-84b5-e0e17a880276 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:55.439881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a80a6ea2-880c-4a7a-84b5-e0e17a880276 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:55.449393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a80a6ea2-880c-4a7a-84b5-e0e17a880276 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.156050 Oct 28 20:09:55.449974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 338/688] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:55 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:55.546225 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d51feb19-3f54-4df7-941c-e2c3001943e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:55.548492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d51feb19-3f54-4df7-941c-e2c3001943e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:55.554385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d51feb19-3f54-4df7-941c-e2c3001943e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:55.554864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d51feb19-3f54-4df7-941c-e2c3001943e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:55.555300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d51feb19-3f54-4df7-941c-e2c3001943e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:55.555981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d51feb19-3f54-4df7-941c-e2c3001943e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:55.556432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d51feb19-3f54-4df7-941c-e2c3001943e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:55.556857 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d51feb19-3f54-4df7-941c-e2c3001943e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:55.586673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d51feb19-3f54-4df7-941c-e2c3001943e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044950 Oct 28 20:09:55.587220 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 351/689] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:09:55 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:56.322091 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a8d471e4-5808-4467-9c4d-d048d6de96d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:56.322625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a8d471e4-5808-4467-9c4d-d048d6de96d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:56.329219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8d471e4-5808-4467-9c4d-d048d6de96d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:56.329722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8d471e4-5808-4467-9c4d-d048d6de96d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:56.330153 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8d471e4-5808-4467-9c4d-d048d6de96d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:56.330827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8d471e4-5808-4467-9c4d-d048d6de96d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:56.331275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8d471e4-5808-4467-9c4d-d048d6de96d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:56.331693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8d471e4-5808-4467-9c4d-d048d6de96d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:56.463204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a8d471e4-5808-4467-9c4d-d048d6de96d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:56.473098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a8d471e4-5808-4467-9c4d-d048d6de96d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:56.473213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1f10ee60-0deb-4624-92ca-8d8fc9822947 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:56.474120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1f10ee60-0deb-4624-92ca-8d8fc9822947 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:56.474531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a8d471e4-5808-4467-9c4d-d048d6de96d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:56.475754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a8d471e4-5808-4467-9c4d-d048d6de96d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.157515 Oct 28 20:09:56.489542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 339/690] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:56 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:56.490040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f10ee60-0deb-4624-92ca-8d8fc9822947 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:56.490040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f10ee60-0deb-4624-92ca-8d8fc9822947 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:56.490040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f10ee60-0deb-4624-92ca-8d8fc9822947 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:56.490040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f10ee60-0deb-4624-92ca-8d8fc9822947 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:56.490454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f10ee60-0deb-4624-92ca-8d8fc9822947 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:56.490454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f10ee60-0deb-4624-92ca-8d8fc9822947 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:56.599674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cb19e15a-42e2-4ade-a818-f6cf4f4500fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:56.601759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cb19e15a-42e2-4ade-a818-f6cf4f4500fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:56.608991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb19e15a-42e2-4ade-a818-f6cf4f4500fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:56.612561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb19e15a-42e2-4ade-a818-f6cf4f4500fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:56.612561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb19e15a-42e2-4ade-a818-f6cf4f4500fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:56.612561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb19e15a-42e2-4ade-a818-f6cf4f4500fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:56.612561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb19e15a-42e2-4ade-a818-f6cf4f4500fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:56.612886 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb19e15a-42e2-4ade-a818-f6cf4f4500fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:56.618028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1f10ee60-0deb-4624-92ca-8d8fc9822947 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:56.626213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1f10ee60-0deb-4624-92ca-8d8fc9822947 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.157089 Oct 28 20:09:56.626783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 352/691] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:56 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:56.646143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cb19e15a-42e2-4ade-a818-f6cf4f4500fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050472 Oct 28 20:09:56.646707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 340/692] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:09:56 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:09:57.504566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f45aed6c-0c50-469f-b051-87f1d3ee61c4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:57.505213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f45aed6c-0c50-469f-b051-87f1d3ee61c4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:57.511716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f45aed6c-0c50-469f-b051-87f1d3ee61c4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:57.512199 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f45aed6c-0c50-469f-b051-87f1d3ee61c4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:57.512639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f45aed6c-0c50-469f-b051-87f1d3ee61c4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:57.513347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f45aed6c-0c50-469f-b051-87f1d3ee61c4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:57.514617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f45aed6c-0c50-469f-b051-87f1d3ee61c4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:57.515121 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f45aed6c-0c50-469f-b051-87f1d3ee61c4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:57.650740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f45aed6c-0c50-469f-b051-87f1d3ee61c4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:57.650898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-da25c50f-fcf9-42a6-a076-dd775a71452e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:57.652899 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-da25c50f-fcf9-42a6-a076-dd775a71452e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:57.658087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da25c50f-fcf9-42a6-a076-dd775a71452e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:57.658578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da25c50f-fcf9-42a6-a076-dd775a71452e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:57.659019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da25c50f-fcf9-42a6-a076-dd775a71452e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:57.659718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da25c50f-fcf9-42a6-a076-dd775a71452e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:57.660176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da25c50f-fcf9-42a6-a076-dd775a71452e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:57.660273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f45aed6c-0c50-469f-b051-87f1d3ee61c4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:57.660607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da25c50f-fcf9-42a6-a076-dd775a71452e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:57.661941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f45aed6c-0c50-469f-b051-87f1d3ee61c4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:57.663094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f45aed6c-0c50-469f-b051-87f1d3ee61c4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.162455 Oct 28 20:09:57.663861 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 353/693] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:57 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:57.673482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-510d05cf-675a-42f9-bc1c-9b042e21de4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:57.675669 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-510d05cf-675a-42f9-bc1c-9b042e21de4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:57.675990 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:57.681841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-510d05cf-675a-42f9-bc1c-9b042e21de4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:57.682327 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-510d05cf-675a-42f9-bc1c-9b042e21de4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:57.694324 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-510d05cf-675a-42f9-bc1c-9b042e21de4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:57.694324 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-510d05cf-675a-42f9-bc1c-9b042e21de4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:57.694324 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-510d05cf-675a-42f9-bc1c-9b042e21de4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:57.694324 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-510d05cf-675a-42f9-bc1c-9b042e21de4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:57.714850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-510d05cf-675a-42f9-bc1c-9b042e21de4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049950 Oct 28 20:09:57.715420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 354/694] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:09:57 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:57.794384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-da25c50f-fcf9-42a6-a076-dd775a71452e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:57.802746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-da25c50f-fcf9-42a6-a076-dd775a71452e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.156098 Oct 28 20:09:57.803302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 341/695] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:57 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:58.688779 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2c0bd6e9-2030-429f-8ec0-ab62aee658bb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:58.689440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2c0bd6e9-2030-429f-8ec0-ab62aee658bb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:58.696660 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c0bd6e9-2030-429f-8ec0-ab62aee658bb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:58.697144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c0bd6e9-2030-429f-8ec0-ab62aee658bb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:58.698541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c0bd6e9-2030-429f-8ec0-ab62aee658bb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:58.698541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c0bd6e9-2030-429f-8ec0-ab62aee658bb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:58.698959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c0bd6e9-2030-429f-8ec0-ab62aee658bb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:58.699436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c0bd6e9-2030-429f-8ec0-ab62aee658bb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:58.727538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cdb07edc-e95f-4ab7-9e63-fddb5b5385df tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:58.730436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cdb07edc-e95f-4ab7-9e63-fddb5b5385df tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:58.738545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdb07edc-e95f-4ab7-9e63-fddb5b5385df tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:58.739424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdb07edc-e95f-4ab7-9e63-fddb5b5385df tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:58.739867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdb07edc-e95f-4ab7-9e63-fddb5b5385df tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:58.740882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdb07edc-e95f-4ab7-9e63-fddb5b5385df tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:58.741408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdb07edc-e95f-4ab7-9e63-fddb5b5385df tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:58.741882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdb07edc-e95f-4ab7-9e63-fddb5b5385df tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:58.775863 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cdb07edc-e95f-4ab7-9e63-fddb5b5385df tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052177 Oct 28 20:09:58.776501 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 342/696] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:09:58 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:58.826786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0b5c1fe8-252e-4d3f-9333-189e561644ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:58.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0b5c1fe8-252e-4d3f-9333-189e561644ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:58.830331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2c0bd6e9-2030-429f-8ec0-ab62aee658bb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:58.833257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b5c1fe8-252e-4d3f-9333-189e561644ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:58.833797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b5c1fe8-252e-4d3f-9333-189e561644ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:58.834232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b5c1fe8-252e-4d3f-9333-189e561644ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:58.834916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b5c1fe8-252e-4d3f-9333-189e561644ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:58.835372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b5c1fe8-252e-4d3f-9333-189e561644ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:58.836092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b5c1fe8-252e-4d3f-9333-189e561644ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:58.839172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2c0bd6e9-2030-429f-8ec0-ab62aee658bb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:58.840608 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2c0bd6e9-2030-429f-8ec0-ab62aee658bb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:58.842496 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2c0bd6e9-2030-429f-8ec0-ab62aee658bb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.157465 Oct 28 20:09:58.843180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 355/697] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:58 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:09:58.973312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0b5c1fe8-252e-4d3f-9333-189e561644ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:58.980920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0b5c1fe8-252e-4d3f-9333-189e561644ae tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.158958 Oct 28 20:09:58.993413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 343/698] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:58 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:59.793925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-501dc755-24d6-4be7-bc14-cf5e054bda12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:59.796250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-501dc755-24d6-4be7-bc14-cf5e054bda12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:59.802801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-501dc755-24d6-4be7-bc14-cf5e054bda12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:59.803289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-501dc755-24d6-4be7-bc14-cf5e054bda12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:59.803723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-501dc755-24d6-4be7-bc14-cf5e054bda12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:59.804413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-501dc755-24d6-4be7-bc14-cf5e054bda12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:59.804864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-501dc755-24d6-4be7-bc14-cf5e054bda12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:59.805349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-501dc755-24d6-4be7-bc14-cf5e054bda12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:59.835929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-501dc755-24d6-4be7-bc14-cf5e054bda12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045519 Oct 28 20:09:59.836477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 356/699] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:09:59 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:59.872056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4977ca1b-f343-4beb-9d64-447736eec3ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:59.872610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4977ca1b-f343-4beb-9d64-447736eec3ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:59.879522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4977ca1b-f343-4beb-9d64-447736eec3ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:59.880016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4977ca1b-f343-4beb-9d64-447736eec3ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:59.880454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4977ca1b-f343-4beb-9d64-447736eec3ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:59.881140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4977ca1b-f343-4beb-9d64-447736eec3ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:59.881649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4977ca1b-f343-4beb-9d64-447736eec3ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:59.882071 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4977ca1b-f343-4beb-9d64-447736eec3ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:00.007945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-29ed5512-b836-4125-9d8f-f2f366ffecba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:00.008654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-29ed5512-b836-4125-9d8f-f2f366ffecba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:00.012401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4977ca1b-f343-4beb-9d64-447736eec3ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:00.016761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29ed5512-b836-4125-9d8f-f2f366ffecba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:00.017563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29ed5512-b836-4125-9d8f-f2f366ffecba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:00.018208 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29ed5512-b836-4125-9d8f-f2f366ffecba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:00.019003 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29ed5512-b836-4125-9d8f-f2f366ffecba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:00.019663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29ed5512-b836-4125-9d8f-f2f366ffecba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:00.020474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29ed5512-b836-4125-9d8f-f2f366ffecba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:00.021608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4977ca1b-f343-4beb-9d64-447736eec3ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:00.023047 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4977ca1b-f343-4beb-9d64-447736eec3ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:00.024192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4977ca1b-f343-4beb-9d64-447736eec3ac tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.156083 Oct 28 20:10:00.041439 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 344/700] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:09:59 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:00.152038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-29ed5512-b836-4125-9d8f-f2f366ffecba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:00.155966 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:00.160346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-29ed5512-b836-4125-9d8f-f2f366ffecba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.158176 Oct 28 20:10:00.160902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 357/701] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:00 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:00.848152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a9f9637e-3ec0-4712-833e-b22b9201fcc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:00.850290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a9f9637e-3ec0-4712-833e-b22b9201fcc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:00.856047 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9f9637e-3ec0-4712-833e-b22b9201fcc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:00.856525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9f9637e-3ec0-4712-833e-b22b9201fcc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:00.857518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9f9637e-3ec0-4712-833e-b22b9201fcc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:00.858165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9f9637e-3ec0-4712-833e-b22b9201fcc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:00.862182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9f9637e-3ec0-4712-833e-b22b9201fcc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:00.862182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9f9637e-3ec0-4712-833e-b22b9201fcc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:00.889442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a9f9637e-3ec0-4712-833e-b22b9201fcc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045188 Oct 28 20:10:00.890092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 345/702] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:00 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:10:01.051107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-426b332b-c99c-4b3c-bb5f-0b39a1f99f44 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:01.051723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-426b332b-c99c-4b3c-bb5f-0b39a1f99f44 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:01.058538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-426b332b-c99c-4b3c-bb5f-0b39a1f99f44 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:01.059026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-426b332b-c99c-4b3c-bb5f-0b39a1f99f44 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:01.059467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-426b332b-c99c-4b3c-bb5f-0b39a1f99f44 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:01.060193 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-426b332b-c99c-4b3c-bb5f-0b39a1f99f44 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:01.060658 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-426b332b-c99c-4b3c-bb5f-0b39a1f99f44 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:01.061080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-426b332b-c99c-4b3c-bb5f-0b39a1f99f44 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:01.183504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a200b1b8-e79f-4139-b641-b36ef4c0cd1e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:01.184151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a200b1b8-e79f-4139-b641-b36ef4c0cd1e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:01.190082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a200b1b8-e79f-4139-b641-b36ef4c0cd1e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:01.190573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a200b1b8-e79f-4139-b641-b36ef4c0cd1e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:01.191015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a200b1b8-e79f-4139-b641-b36ef4c0cd1e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:01.191739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a200b1b8-e79f-4139-b641-b36ef4c0cd1e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:01.192199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a200b1b8-e79f-4139-b641-b36ef4c0cd1e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:01.192625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a200b1b8-e79f-4139-b641-b36ef4c0cd1e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:01.194795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-426b332b-c99c-4b3c-bb5f-0b39a1f99f44 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:01.203359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-426b332b-c99c-4b3c-bb5f-0b39a1f99f44 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:01.204789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-426b332b-c99c-4b3c-bb5f-0b39a1f99f44 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:01.205965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-426b332b-c99c-4b3c-bb5f-0b39a1f99f44 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.159030 Oct 28 20:10:01.206511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 358/703] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:01 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:01.320320 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a200b1b8-e79f-4139-b641-b36ef4c0cd1e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:01.328767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a200b1b8-e79f-4139-b641-b36ef4c0cd1e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.149178 Oct 28 20:10:01.329355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 346/704] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:01 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:10:01.901491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ae8078ec-f74b-4635-a723-3a954e90aa6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:01.903598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ae8078ec-f74b-4635-a723-3a954e90aa6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:01.910428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae8078ec-f74b-4635-a723-3a954e90aa6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:01.910913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae8078ec-f74b-4635-a723-3a954e90aa6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:01.911351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae8078ec-f74b-4635-a723-3a954e90aa6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:01.912050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae8078ec-f74b-4635-a723-3a954e90aa6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:01.912504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae8078ec-f74b-4635-a723-3a954e90aa6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:01.912925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae8078ec-f74b-4635-a723-3a954e90aa6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:01.943468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ae8078ec-f74b-4635-a723-3a954e90aa6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046121 Oct 28 20:10:01.944027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 359/705] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:01 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:02.231933 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-369bb56f-f24f-4cd0-8ee0-49461bf66570 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:02.232647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-369bb56f-f24f-4cd0-8ee0-49461bf66570 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:02.239188 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-369bb56f-f24f-4cd0-8ee0-49461bf66570 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:02.239674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-369bb56f-f24f-4cd0-8ee0-49461bf66570 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:02.240121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-369bb56f-f24f-4cd0-8ee0-49461bf66570 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:02.240809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-369bb56f-f24f-4cd0-8ee0-49461bf66570 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:02.241267 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-369bb56f-f24f-4cd0-8ee0-49461bf66570 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:02.241716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-369bb56f-f24f-4cd0-8ee0-49461bf66570 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:02.352084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1f9c7bd1-46ef-4566-a724-b7d1bbe08218 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:02.352699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1f9c7bd1-46ef-4566-a724-b7d1bbe08218 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:02.359308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f9c7bd1-46ef-4566-a724-b7d1bbe08218 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:02.359797 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f9c7bd1-46ef-4566-a724-b7d1bbe08218 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:02.360229 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f9c7bd1-46ef-4566-a724-b7d1bbe08218 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:02.360923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f9c7bd1-46ef-4566-a724-b7d1bbe08218 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:02.361393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f9c7bd1-46ef-4566-a724-b7d1bbe08218 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:02.367675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f9c7bd1-46ef-4566-a724-b7d1bbe08218 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:02.665574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-369bb56f-f24f-4cd0-8ee0-49461bf66570 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:02.668806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1f9c7bd1-46ef-4566-a724-b7d1bbe08218 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:02.674707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-369bb56f-f24f-4cd0-8ee0-49461bf66570 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:02.676161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-369bb56f-f24f-4cd0-8ee0-49461bf66570 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:02.676438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1f9c7bd1-46ef-4566-a724-b7d1bbe08218 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.328268 Oct 28 20:10:02.677008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 360/706] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:02 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:10:02.677341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-369bb56f-f24f-4cd0-8ee0-49461bf66570 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.449276 Oct 28 20:10:02.677889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 347/707] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:02 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:02.956541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b6e15757-cbeb-4f60-b1bd-46bb5c3e1549 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:02.958707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b6e15757-cbeb-4f60-b1bd-46bb5c3e1549 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:02.964769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6e15757-cbeb-4f60-b1bd-46bb5c3e1549 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:02.965257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6e15757-cbeb-4f60-b1bd-46bb5c3e1549 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:02.965931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6e15757-cbeb-4f60-b1bd-46bb5c3e1549 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:02.966510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6e15757-cbeb-4f60-b1bd-46bb5c3e1549 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:02.966886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6e15757-cbeb-4f60-b1bd-46bb5c3e1549 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:02.968031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6e15757-cbeb-4f60-b1bd-46bb5c3e1549 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:02.997734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b6e15757-cbeb-4f60-b1bd-46bb5c3e1549 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045606 Oct 28 20:10:02.998347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 361/708] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:02 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:03.699789 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dd62a411-6dee-4cd9-90d9-3fa06cea5264 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:03.700415 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dd62a411-6dee-4cd9-90d9-3fa06cea5264 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:03.703605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3d1c1ed7-2db9-46ed-90e7-300d2672ca87 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:03.704226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3d1c1ed7-2db9-46ed-90e7-300d2672ca87 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:03.707733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd62a411-6dee-4cd9-90d9-3fa06cea5264 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:03.708217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd62a411-6dee-4cd9-90d9-3fa06cea5264 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:03.708658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd62a411-6dee-4cd9-90d9-3fa06cea5264 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:03.709369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd62a411-6dee-4cd9-90d9-3fa06cea5264 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:03.709826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd62a411-6dee-4cd9-90d9-3fa06cea5264 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:03.710258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd62a411-6dee-4cd9-90d9-3fa06cea5264 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:03.710781 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d1c1ed7-2db9-46ed-90e7-300d2672ca87 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:03.711267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d1c1ed7-2db9-46ed-90e7-300d2672ca87 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:03.711706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d1c1ed7-2db9-46ed-90e7-300d2672ca87 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:03.712398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d1c1ed7-2db9-46ed-90e7-300d2672ca87 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:03.712857 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d1c1ed7-2db9-46ed-90e7-300d2672ca87 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:03.713281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d1c1ed7-2db9-46ed-90e7-300d2672ca87 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:03.907973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-dd62a411-6dee-4cd9-90d9-3fa06cea5264 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:03.910957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3d1c1ed7-2db9-46ed-90e7-300d2672ca87 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:03.915823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dd62a411-6dee-4cd9-90d9-3fa06cea5264 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.220194 Oct 28 20:10:03.916399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 348/709] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:03 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:03.919896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3d1c1ed7-2db9-46ed-90e7-300d2672ca87 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:03.921466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3d1c1ed7-2db9-46ed-90e7-300d2672ca87 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:03.922635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3d1c1ed7-2db9-46ed-90e7-300d2672ca87 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.223593 Oct 28 20:10:03.923187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 362/710] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:03 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:04.010195 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e3d69b21-608e-44d7-a4a9-2857f58642bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:04.012598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e3d69b21-608e-44d7-a4a9-2857f58642bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:04.019169 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d69b21-608e-44d7-a4a9-2857f58642bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:04.019688 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d69b21-608e-44d7-a4a9-2857f58642bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:04.020123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d69b21-608e-44d7-a4a9-2857f58642bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:04.020813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d69b21-608e-44d7-a4a9-2857f58642bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:04.021429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d69b21-608e-44d7-a4a9-2857f58642bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:04.021853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d69b21-608e-44d7-a4a9-2857f58642bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:04.053966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e3d69b21-608e-44d7-a4a9-2857f58642bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047558 Oct 28 20:10:04.054693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 349/711] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:04 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:04.939646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0714e0bb-d9c7-470f-b71b-dd07a9c3d11e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:04.940182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0714e0bb-d9c7-470f-b71b-dd07a9c3d11e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:04.946932 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0714e0bb-d9c7-470f-b71b-dd07a9c3d11e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:04.947428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0714e0bb-d9c7-470f-b71b-dd07a9c3d11e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:04.947761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2779e4f8-2465-4a14-a15e-d5413b4dc464 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:04.948160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0714e0bb-d9c7-470f-b71b-dd07a9c3d11e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:04.948421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2779e4f8-2465-4a14-a15e-d5413b4dc464 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:04.948585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0714e0bb-d9c7-470f-b71b-dd07a9c3d11e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:04.949027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0714e0bb-d9c7-470f-b71b-dd07a9c3d11e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:04.949481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0714e0bb-d9c7-470f-b71b-dd07a9c3d11e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:04.954788 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2779e4f8-2465-4a14-a15e-d5413b4dc464 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:04.955260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2779e4f8-2465-4a14-a15e-d5413b4dc464 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:04.955688 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2779e4f8-2465-4a14-a15e-d5413b4dc464 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:04.956369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2779e4f8-2465-4a14-a15e-d5413b4dc464 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:04.956815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2779e4f8-2465-4a14-a15e-d5413b4dc464 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:04.957235 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2779e4f8-2465-4a14-a15e-d5413b4dc464 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:05.144452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0714e0bb-d9c7-470f-b71b-dd07a9c3d11e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:05.148361 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2779e4f8-2465-4a14-a15e-d5413b4dc464 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:05.153055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0714e0bb-d9c7-470f-b71b-dd07a9c3d11e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.217763 Oct 28 20:10:05.153660 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 363/712] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:04 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:05.158701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e8d4e08b-4bf7-4153-b463-9d91b1f0482d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:05.158949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2779e4f8-2465-4a14-a15e-d5413b4dc464 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:05.161003 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e8d4e08b-4bf7-4153-b463-9d91b1f0482d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:05.161741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2779e4f8-2465-4a14-a15e-d5413b4dc464 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:05.162991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2779e4f8-2465-4a14-a15e-d5413b4dc464 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.219046 Oct 28 20:10:05.163771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 350/713] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:04 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:05.167170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d4e08b-4bf7-4153-b463-9d91b1f0482d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:05.167656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d4e08b-4bf7-4153-b463-9d91b1f0482d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:05.168091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d4e08b-4bf7-4153-b463-9d91b1f0482d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:05.168784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d4e08b-4bf7-4153-b463-9d91b1f0482d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:05.169382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d4e08b-4bf7-4153-b463-9d91b1f0482d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:05.169811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d4e08b-4bf7-4153-b463-9d91b1f0482d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:05.203040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e8d4e08b-4bf7-4153-b463-9d91b1f0482d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048303 Oct 28 20:10:05.203595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 364/714] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:05 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:06.185532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-df776ded-6323-4f90-bff1-248a8d42dbd1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:06.187406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-df776ded-6323-4f90-bff1-248a8d42dbd1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:06.190339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-84eeb7b0-f8da-41e2-b266-b530258d4825 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:06.190953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-84eeb7b0-f8da-41e2-b266-b530258d4825 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:06.194715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df776ded-6323-4f90-bff1-248a8d42dbd1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:06.195199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df776ded-6323-4f90-bff1-248a8d42dbd1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:06.195638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df776ded-6323-4f90-bff1-248a8d42dbd1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:06.196328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df776ded-6323-4f90-bff1-248a8d42dbd1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:06.196775 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df776ded-6323-4f90-bff1-248a8d42dbd1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:06.197194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df776ded-6323-4f90-bff1-248a8d42dbd1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:06.197468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84eeb7b0-f8da-41e2-b266-b530258d4825 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:06.197952 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84eeb7b0-f8da-41e2-b266-b530258d4825 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:06.198393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84eeb7b0-f8da-41e2-b266-b530258d4825 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:06.199084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84eeb7b0-f8da-41e2-b266-b530258d4825 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:06.199538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84eeb7b0-f8da-41e2-b266-b530258d4825 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:06.199958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84eeb7b0-f8da-41e2-b266-b530258d4825 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:06.399509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-df776ded-6323-4f90-bff1-248a8d42dbd1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:06.402754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-84eeb7b0-f8da-41e2-b266-b530258d4825 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:06.407986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-df776ded-6323-4f90-bff1-248a8d42dbd1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.227272 Oct 28 20:10:06.408557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 351/715] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:06 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:06.416854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-84eeb7b0-f8da-41e2-b266-b530258d4825 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:06.417036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5d3c59f2-bc7b-40bd-95a2-b9ea93eed63b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:06.417150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-84eeb7b0-f8da-41e2-b266-b530258d4825 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:06.417150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-84eeb7b0-f8da-41e2-b266-b530258d4825 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.229085 Oct 28 20:10:06.417311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5d3c59f2-bc7b-40bd-95a2-b9ea93eed63b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:06.417428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 365/716] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:06 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:06.421132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d3c59f2-bc7b-40bd-95a2-b9ea93eed63b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:06.421652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d3c59f2-bc7b-40bd-95a2-b9ea93eed63b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:06.422221 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d3c59f2-bc7b-40bd-95a2-b9ea93eed63b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:06.422881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d3c59f2-bc7b-40bd-95a2-b9ea93eed63b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:06.423304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d3c59f2-bc7b-40bd-95a2-b9ea93eed63b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:06.423730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d3c59f2-bc7b-40bd-95a2-b9ea93eed63b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:06.454060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5d3c59f2-bc7b-40bd-95a2-b9ea93eed63b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044489 Oct 28 20:10:06.454615 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 352/717] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:06 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:07.437651 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-459713a9-dbdb-4272-9bba-325a0a4cc707 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:07.438374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-459713a9-dbdb-4272-9bba-325a0a4cc707 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:07.443817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-052446cb-2afd-4419-abb8-8eeebb4c4f15 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:07.444431 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-052446cb-2afd-4419-abb8-8eeebb4c4f15 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:07.445138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-459713a9-dbdb-4272-9bba-325a0a4cc707 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:07.445749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-459713a9-dbdb-4272-9bba-325a0a4cc707 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:07.446272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-459713a9-dbdb-4272-9bba-325a0a4cc707 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:07.447033 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-459713a9-dbdb-4272-9bba-325a0a4cc707 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:07.447560 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-459713a9-dbdb-4272-9bba-325a0a4cc707 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:07.447990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-459713a9-dbdb-4272-9bba-325a0a4cc707 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:07.450802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-052446cb-2afd-4419-abb8-8eeebb4c4f15 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:07.451880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-052446cb-2afd-4419-abb8-8eeebb4c4f15 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:07.452477 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-052446cb-2afd-4419-abb8-8eeebb4c4f15 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:07.453238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-052446cb-2afd-4419-abb8-8eeebb4c4f15 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:07.453985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-052446cb-2afd-4419-abb8-8eeebb4c4f15 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:07.454477 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-052446cb-2afd-4419-abb8-8eeebb4c4f15 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:07.642865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-459713a9-dbdb-4272-9bba-325a0a4cc707 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:07.646865 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-052446cb-2afd-4419-abb8-8eeebb4c4f15 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:07.650445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-459713a9-dbdb-4272-9bba-325a0a4cc707 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.217009 Oct 28 20:10:07.651200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 366/718] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:07 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:07.655778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c0f4f2ae-e3e9-453d-a0ba-c966e3d4dd6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:07.655950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-052446cb-2afd-4419-abb8-8eeebb4c4f15 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:07.657216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-052446cb-2afd-4419-abb8-8eeebb4c4f15 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:07.657904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c0f4f2ae-e3e9-453d-a0ba-c966e3d4dd6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:07.658576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-052446cb-2afd-4419-abb8-8eeebb4c4f15 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.218646 Oct 28 20:10:07.659113 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 353/719] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:07 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:07.663613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0f4f2ae-e3e9-453d-a0ba-c966e3d4dd6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:07.664099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0f4f2ae-e3e9-453d-a0ba-c966e3d4dd6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:07.664573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0f4f2ae-e3e9-453d-a0ba-c966e3d4dd6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:07.665275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0f4f2ae-e3e9-453d-a0ba-c966e3d4dd6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:07.665783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0f4f2ae-e3e9-453d-a0ba-c966e3d4dd6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:07.666213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0f4f2ae-e3e9-453d-a0ba-c966e3d4dd6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:07.696109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c0f4f2ae-e3e9-453d-a0ba-c966e3d4dd6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043915 Oct 28 20:10:07.696661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 367/720] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:07 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:08.674434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01c2f0ad-81bf-42f7-a4a2-dcbfffe2743c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:08.674973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-01c2f0ad-81bf-42f7-a4a2-dcbfffe2743c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:08.681390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01c2f0ad-81bf-42f7-a4a2-dcbfffe2743c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:08.681877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01c2f0ad-81bf-42f7-a4a2-dcbfffe2743c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:08.682315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01c2f0ad-81bf-42f7-a4a2-dcbfffe2743c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:08.683008 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01c2f0ad-81bf-42f7-a4a2-dcbfffe2743c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:08.683506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01c2f0ad-81bf-42f7-a4a2-dcbfffe2743c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:08.683984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01c2f0ad-81bf-42f7-a4a2-dcbfffe2743c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:08.684148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d0cd5c00-747f-4d4f-8994-c41ca85d2fd3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:08.684763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d0cd5c00-747f-4d4f-8994-c41ca85d2fd3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:08.691563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0cd5c00-747f-4d4f-8994-c41ca85d2fd3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:08.692047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0cd5c00-747f-4d4f-8994-c41ca85d2fd3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:08.692489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0cd5c00-747f-4d4f-8994-c41ca85d2fd3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:08.693184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0cd5c00-747f-4d4f-8994-c41ca85d2fd3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:08.693670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0cd5c00-747f-4d4f-8994-c41ca85d2fd3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:08.694093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0cd5c00-747f-4d4f-8994-c41ca85d2fd3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:08.885156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-01c2f0ad-81bf-42f7-a4a2-dcbfffe2743c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:08.889464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0cd5c00-747f-4d4f-8994-c41ca85d2fd3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:08.893253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-01c2f0ad-81bf-42f7-a4a2-dcbfffe2743c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.223515 Oct 28 20:10:08.893850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 354/721] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:08 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:08.898497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e4d7f6f6-780e-47c7-9c38-fec624820dca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:08.898641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0cd5c00-747f-4d4f-8994-c41ca85d2fd3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:08.900174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0cd5c00-747f-4d4f-8994-c41ca85d2fd3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:08.900888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e4d7f6f6-780e-47c7-9c38-fec624820dca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:08.901554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d0cd5c00-747f-4d4f-8994-c41ca85d2fd3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.221193 Oct 28 20:10:08.902711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 368/722] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:08 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:08.907080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4d7f6f6-780e-47c7-9c38-fec624820dca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:08.907561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4d7f6f6-780e-47c7-9c38-fec624820dca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:08.907993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4d7f6f6-780e-47c7-9c38-fec624820dca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:08.908681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4d7f6f6-780e-47c7-9c38-fec624820dca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:08.909271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4d7f6f6-780e-47c7-9c38-fec624820dca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:08.909737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4d7f6f6-780e-47c7-9c38-fec624820dca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:08.942971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e4d7f6f6-780e-47c7-9c38-fec624820dca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048112 Oct 28 20:10:08.943534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 355/723] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:08 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:09.923724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-39075b9f-415c-4568-9ba2-ffcb544653d6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:09.924467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-39075b9f-415c-4568-9ba2-ffcb544653d6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:09.927822 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b1c7f79e-2442-4720-9109-f89c758d142f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:09.928428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b1c7f79e-2442-4720-9109-f89c758d142f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:09.931032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39075b9f-415c-4568-9ba2-ffcb544653d6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:09.931521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39075b9f-415c-4568-9ba2-ffcb544653d6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:09.931958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39075b9f-415c-4568-9ba2-ffcb544653d6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:09.932648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39075b9f-415c-4568-9ba2-ffcb544653d6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:09.933097 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39075b9f-415c-4568-9ba2-ffcb544653d6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:09.933552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39075b9f-415c-4568-9ba2-ffcb544653d6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:09.934686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1c7f79e-2442-4720-9109-f89c758d142f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:09.935162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1c7f79e-2442-4720-9109-f89c758d142f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:09.936098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1c7f79e-2442-4720-9109-f89c758d142f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:09.936799 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1c7f79e-2442-4720-9109-f89c758d142f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:09.937244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1c7f79e-2442-4720-9109-f89c758d142f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:09.937686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1c7f79e-2442-4720-9109-f89c758d142f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:10.127460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b1c7f79e-2442-4720-9109-f89c758d142f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:10.133914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-39075b9f-415c-4568-9ba2-ffcb544653d6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:10.134461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b1c7f79e-2442-4720-9109-f89c758d142f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:10.135869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b1c7f79e-2442-4720-9109-f89c758d142f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:10.137031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b1c7f79e-2442-4720-9109-f89c758d142f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.213080 Oct 28 20:10:10.137625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 356/724] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:09 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:10.142349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-39075b9f-415c-4568-9ba2-ffcb544653d6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.222532 Oct 28 20:10:10.142594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3075338a-867f-49be-b4b1-d4a3a662b4bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:10.143140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 369/725] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:09 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:10.144725 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3075338a-867f-49be-b4b1-d4a3a662b4bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:10.150508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3075338a-867f-49be-b4b1-d4a3a662b4bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:10.150992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3075338a-867f-49be-b4b1-d4a3a662b4bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:10.151424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3075338a-867f-49be-b4b1-d4a3a662b4bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:10.152258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3075338a-867f-49be-b4b1-d4a3a662b4bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:10.152718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3075338a-867f-49be-b4b1-d4a3a662b4bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:10.153143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3075338a-867f-49be-b4b1-d4a3a662b4bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:10.182872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3075338a-867f-49be-b4b1-d4a3a662b4bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044177 Oct 28 20:10:10.183344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 357/726] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:10 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:11.163810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f3d475af-30c0-4968-924d-4dbd8c70b21f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:11.164441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f3d475af-30c0-4968-924d-4dbd8c70b21f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:11.165284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-df95c603-9144-4572-b2e9-5c7760bfe3a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:11.166085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-df95c603-9144-4572-b2e9-5c7760bfe3a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:11.170935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3d475af-30c0-4968-924d-4dbd8c70b21f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:11.171412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3d475af-30c0-4968-924d-4dbd8c70b21f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:11.171840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3d475af-30c0-4968-924d-4dbd8c70b21f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:11.172496 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df95c603-9144-4572-b2e9-5c7760bfe3a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:11.172612 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3d475af-30c0-4968-924d-4dbd8c70b21f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:11.172949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3d475af-30c0-4968-924d-4dbd8c70b21f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:11.173058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df95c603-9144-4572-b2e9-5c7760bfe3a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:11.173384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3d475af-30c0-4968-924d-4dbd8c70b21f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:11.173491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df95c603-9144-4572-b2e9-5c7760bfe3a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:11.174127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df95c603-9144-4572-b2e9-5c7760bfe3a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:11.174584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df95c603-9144-4572-b2e9-5c7760bfe3a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:11.175014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df95c603-9144-4572-b2e9-5c7760bfe3a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:11.179014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:11.375348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f3d475af-30c0-4968-924d-4dbd8c70b21f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:11.378734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-df95c603-9144-4572-b2e9-5c7760bfe3a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:11.384155 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f3d475af-30c0-4968-924d-4dbd8c70b21f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:11.385617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f3d475af-30c0-4968-924d-4dbd8c70b21f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:11.386144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-df95c603-9144-4572-b2e9-5c7760bfe3a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.224621 Oct 28 20:10:11.386719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 358/727] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:11 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:10:11.386850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f3d475af-30c0-4968-924d-4dbd8c70b21f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.226951 Oct 28 20:10:11.387306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 370/728] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:11 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:11.391713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4905c846-9fe2-45ed-a169-d2208da5dada tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:11.393931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4905c846-9fe2-45ed-a169-d2208da5dada tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:11.399721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4905c846-9fe2-45ed-a169-d2208da5dada tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:11.400386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4905c846-9fe2-45ed-a169-d2208da5dada tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:11.400819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4905c846-9fe2-45ed-a169-d2208da5dada tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:11.401533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4905c846-9fe2-45ed-a169-d2208da5dada tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:11.401982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4905c846-9fe2-45ed-a169-d2208da5dada tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:11.402403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4905c846-9fe2-45ed-a169-d2208da5dada tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:11.431277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4905c846-9fe2-45ed-a169-d2208da5dada tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043602 Oct 28 20:10:11.431818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 359/729] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:11 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:12.409450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cbcccefe-13f9-4002-ab5b-26a13e5ed3f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:12.410090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cbcccefe-13f9-4002-ab5b-26a13e5ed3f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:12.415123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3e879965-efbd-4e55-af4f-30da6ef4ebd6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:12.415737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3e879965-efbd-4e55-af4f-30da6ef4ebd6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:12.416539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cbcccefe-13f9-4002-ab5b-26a13e5ed3f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:12.417017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cbcccefe-13f9-4002-ab5b-26a13e5ed3f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:12.417485 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cbcccefe-13f9-4002-ab5b-26a13e5ed3f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:12.418174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cbcccefe-13f9-4002-ab5b-26a13e5ed3f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:12.418623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cbcccefe-13f9-4002-ab5b-26a13e5ed3f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:12.419041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cbcccefe-13f9-4002-ab5b-26a13e5ed3f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:12.423452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e879965-efbd-4e55-af4f-30da6ef4ebd6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:12.424021 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e879965-efbd-4e55-af4f-30da6ef4ebd6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:12.424468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e879965-efbd-4e55-af4f-30da6ef4ebd6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:12.425158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e879965-efbd-4e55-af4f-30da6ef4ebd6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:12.425647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e879965-efbd-4e55-af4f-30da6ef4ebd6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:12.426072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e879965-efbd-4e55-af4f-30da6ef4ebd6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:12.620201 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cbcccefe-13f9-4002-ab5b-26a13e5ed3f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:12.625389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cbcccefe-13f9-4002-ab5b-26a13e5ed3f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.219882 Oct 28 20:10:12.626466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 371/730] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:12 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:12.627306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3e879965-efbd-4e55-af4f-30da6ef4ebd6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:12.632395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e532fe1d-29c0-4227-9e31-a4373ae13571 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:12.634757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e532fe1d-29c0-4227-9e31-a4373ae13571 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:12.642941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e532fe1d-29c0-4227-9e31-a4373ae13571 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:12.643433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e532fe1d-29c0-4227-9e31-a4373ae13571 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:12.644059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e532fe1d-29c0-4227-9e31-a4373ae13571 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:12.645006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e532fe1d-29c0-4227-9e31-a4373ae13571 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:12.645681 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e532fe1d-29c0-4227-9e31-a4373ae13571 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:12.646291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e532fe1d-29c0-4227-9e31-a4373ae13571 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:12.655394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3e879965-efbd-4e55-af4f-30da6ef4ebd6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:12.655394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3e879965-efbd-4e55-af4f-30da6ef4ebd6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:12.656383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3e879965-efbd-4e55-af4f-30da6ef4ebd6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.245803 Oct 28 20:10:12.673697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 360/731] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:12 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:12.681647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e532fe1d-29c0-4227-9e31-a4373ae13571 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053869 Oct 28 20:10:12.682205 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 372/732] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:12 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:13.651182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ab5f00fc-53c9-48ba-87aa-d2442427b767 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:13.651544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ab5f00fc-53c9-48ba-87aa-d2442427b767 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:13.658015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab5f00fc-53c9-48ba-87aa-d2442427b767 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:13.658506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab5f00fc-53c9-48ba-87aa-d2442427b767 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:13.658942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab5f00fc-53c9-48ba-87aa-d2442427b767 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:13.659639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab5f00fc-53c9-48ba-87aa-d2442427b767 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:13.660095 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab5f00fc-53c9-48ba-87aa-d2442427b767 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:13.660520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab5f00fc-53c9-48ba-87aa-d2442427b767 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:13.687533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b4554d77-8624-43a7-add5-92204ebceea7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:13.688158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b4554d77-8624-43a7-add5-92204ebceea7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:13.694854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4554d77-8624-43a7-add5-92204ebceea7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:13.695584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4554d77-8624-43a7-add5-92204ebceea7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:13.696186 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4554d77-8624-43a7-add5-92204ebceea7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:13.696885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4554d77-8624-43a7-add5-92204ebceea7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:13.697562 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4554d77-8624-43a7-add5-92204ebceea7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:13.697993 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4554d77-8624-43a7-add5-92204ebceea7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:13.851865 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ab5f00fc-53c9-48ba-87aa-d2442427b767 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:13.859598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ab5f00fc-53c9-48ba-87aa-d2442427b767 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.212790 Oct 28 20:10:13.860257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 361/733] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:13 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:13.864889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a52e15ad-3357-4403-bf37-b54ac41fae8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:13.867130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a52e15ad-3357-4403-bf37-b54ac41fae8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:13.872759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a52e15ad-3357-4403-bf37-b54ac41fae8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:13.873872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a52e15ad-3357-4403-bf37-b54ac41fae8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:13.874543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a52e15ad-3357-4403-bf37-b54ac41fae8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:13.875318 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a52e15ad-3357-4403-bf37-b54ac41fae8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:13.875850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a52e15ad-3357-4403-bf37-b54ac41fae8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:13.876349 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a52e15ad-3357-4403-bf37-b54ac41fae8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:13.880908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b4554d77-8624-43a7-add5-92204ebceea7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:13.890496 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b4554d77-8624-43a7-add5-92204ebceea7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:13.891947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b4554d77-8624-43a7-add5-92204ebceea7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:13.893388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b4554d77-8624-43a7-add5-92204ebceea7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.210835 Oct 28 20:10:13.893964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 373/734] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:13 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:13.906060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a52e15ad-3357-4403-bf37-b54ac41fae8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044686 Oct 28 20:10:13.906613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 362/735] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:13 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:14.882923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1984ec80-42f6-4a43-a80c-b0ca7c0dfeb4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:14.883633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1984ec80-42f6-4a43-a80c-b0ca7c0dfeb4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:14.890957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1984ec80-42f6-4a43-a80c-b0ca7c0dfeb4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:14.891580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1984ec80-42f6-4a43-a80c-b0ca7c0dfeb4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:14.892042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1984ec80-42f6-4a43-a80c-b0ca7c0dfeb4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:14.892736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1984ec80-42f6-4a43-a80c-b0ca7c0dfeb4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:14.893192 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1984ec80-42f6-4a43-a80c-b0ca7c0dfeb4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:14.893648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1984ec80-42f6-4a43-a80c-b0ca7c0dfeb4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:14.912893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:14.918379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-77b63250-d7fb-4145-be51-0af57698c6eb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:14.924084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-77b63250-d7fb-4145-be51-0af57698c6eb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:14.926190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77b63250-d7fb-4145-be51-0af57698c6eb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:14.926672 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77b63250-d7fb-4145-be51-0af57698c6eb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:14.927112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77b63250-d7fb-4145-be51-0af57698c6eb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:14.927810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77b63250-d7fb-4145-be51-0af57698c6eb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:14.928262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77b63250-d7fb-4145-be51-0af57698c6eb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:14.928771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77b63250-d7fb-4145-be51-0af57698c6eb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:15.104322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1984ec80-42f6-4a43-a80c-b0ca7c0dfeb4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:15.107669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-77b63250-d7fb-4145-be51-0af57698c6eb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:15.112255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1984ec80-42f6-4a43-a80c-b0ca7c0dfeb4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.233137 Oct 28 20:10:15.112900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 374/736] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:14 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:15.116349 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-77b63250-d7fb-4145-be51-0af57698c6eb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:15.117638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a45b5ce-8416-4431-b19b-2f724aaffb3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:15.117836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-77b63250-d7fb-4145-be51-0af57698c6eb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:15.119106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-77b63250-d7fb-4145-be51-0af57698c6eb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.204760 Oct 28 20:10:15.119653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 363/737] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:14 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:15.119797 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7a45b5ce-8416-4431-b19b-2f724aaffb3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:15.125562 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a45b5ce-8416-4431-b19b-2f724aaffb3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:15.126033 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a45b5ce-8416-4431-b19b-2f724aaffb3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:15.126469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a45b5ce-8416-4431-b19b-2f724aaffb3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:15.127153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a45b5ce-8416-4431-b19b-2f724aaffb3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:15.127596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a45b5ce-8416-4431-b19b-2f724aaffb3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:15.128029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a45b5ce-8416-4431-b19b-2f724aaffb3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:15.158213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7a45b5ce-8416-4431-b19b-2f724aaffb3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Oct 28 20:10:15.158776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 375/738] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:15 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:16.135211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f5379aa2-6ece-4e32-b67b-b96699745265 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:16.135785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f5379aa2-6ece-4e32-b67b-b96699745265 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:16.142855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5379aa2-6ece-4e32-b67b-b96699745265 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:16.143478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5379aa2-6ece-4e32-b67b-b96699745265 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:16.143919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5379aa2-6ece-4e32-b67b-b96699745265 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:16.144511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9302e7eb-44bc-4656-80be-10211b9be229 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:16.144900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5379aa2-6ece-4e32-b67b-b96699745265 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:16.145043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5379aa2-6ece-4e32-b67b-b96699745265 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:16.145143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9302e7eb-44bc-4656-80be-10211b9be229 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:16.145510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5379aa2-6ece-4e32-b67b-b96699745265 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:16.147474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=84 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:16.152043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9302e7eb-44bc-4656-80be-10211b9be229 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:16.152522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9302e7eb-44bc-4656-80be-10211b9be229 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:16.157217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9302e7eb-44bc-4656-80be-10211b9be229 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:16.157217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9302e7eb-44bc-4656-80be-10211b9be229 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:16.157217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9302e7eb-44bc-4656-80be-10211b9be229 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:16.157217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9302e7eb-44bc-4656-80be-10211b9be229 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:16.342642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f5379aa2-6ece-4e32-b67b-b96699745265 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:16.346011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9302e7eb-44bc-4656-80be-10211b9be229 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:16.350461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f5379aa2-6ece-4e32-b67b-b96699745265 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.219422 Oct 28 20:10:16.351120 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 364/739] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:16 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:16.355758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fe5f5d80-32ac-46bf-9486-efe0a46dc949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:16.358544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fe5f5d80-32ac-46bf-9486-efe0a46dc949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:16.358884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9302e7eb-44bc-4656-80be-10211b9be229 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:16.360337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9302e7eb-44bc-4656-80be-10211b9be229 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:16.361531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9302e7eb-44bc-4656-80be-10211b9be229 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.220855 Oct 28 20:10:16.362354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 376/740] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:16 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:16.364255 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe5f5d80-32ac-46bf-9486-efe0a46dc949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:16.364733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe5f5d80-32ac-46bf-9486-efe0a46dc949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:16.365164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe5f5d80-32ac-46bf-9486-efe0a46dc949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:16.365872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe5f5d80-32ac-46bf-9486-efe0a46dc949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:16.366355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe5f5d80-32ac-46bf-9486-efe0a46dc949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:16.366773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe5f5d80-32ac-46bf-9486-efe0a46dc949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:16.397278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fe5f5d80-32ac-46bf-9486-efe0a46dc949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Oct 28 20:10:16.397278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 365/741] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:16 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:17.373367 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2fca489a-7331-4ba2-bb15-d10c57c4ea39 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:17.374028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2fca489a-7331-4ba2-bb15-d10c57c4ea39 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:17.380307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fca489a-7331-4ba2-bb15-d10c57c4ea39 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:17.380783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fca489a-7331-4ba2-bb15-d10c57c4ea39 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:17.381257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fca489a-7331-4ba2-bb15-d10c57c4ea39 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:17.381965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fca489a-7331-4ba2-bb15-d10c57c4ea39 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:17.382501 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fca489a-7331-4ba2-bb15-d10c57c4ea39 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:17.382932 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fca489a-7331-4ba2-bb15-d10c57c4ea39 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:17.387369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-75ba2c39-161c-492f-b4c1-6e5d89aa53cc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:17.387978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-75ba2c39-161c-492f-b4c1-6e5d89aa53cc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:17.395227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75ba2c39-161c-492f-b4c1-6e5d89aa53cc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:17.395703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75ba2c39-161c-492f-b4c1-6e5d89aa53cc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:17.396133 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75ba2c39-161c-492f-b4c1-6e5d89aa53cc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:17.396815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75ba2c39-161c-492f-b4c1-6e5d89aa53cc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:17.397298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75ba2c39-161c-492f-b4c1-6e5d89aa53cc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:17.397790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75ba2c39-161c-492f-b4c1-6e5d89aa53cc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:17.575464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2fca489a-7331-4ba2-bb15-d10c57c4ea39 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:17.582776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-75ba2c39-161c-492f-b4c1-6e5d89aa53cc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:17.583818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2fca489a-7331-4ba2-bb15-d10c57c4ea39 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.214319 Oct 28 20:10:17.584395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 377/742] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:17 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:17.589442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8b5c040-bd22-44b0-ae21-6d54a63425ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:17.591550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b8b5c040-bd22-44b0-ae21-6d54a63425ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:17.591857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-75ba2c39-161c-492f-b4c1-6e5d89aa53cc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:17.593613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-75ba2c39-161c-492f-b4c1-6e5d89aa53cc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:17.594971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-75ba2c39-161c-492f-b4c1-6e5d89aa53cc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.211396 Oct 28 20:10:17.595521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 366/743] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:17 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:17.597723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8b5c040-bd22-44b0-ae21-6d54a63425ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:17.598209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8b5c040-bd22-44b0-ae21-6d54a63425ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:17.598649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8b5c040-bd22-44b0-ae21-6d54a63425ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:17.599342 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8b5c040-bd22-44b0-ae21-6d54a63425ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:17.599792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8b5c040-bd22-44b0-ae21-6d54a63425ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:17.600214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8b5c040-bd22-44b0-ae21-6d54a63425ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:17.629767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b8b5c040-bd22-44b0-ae21-6d54a63425ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044277 Oct 28 20:10:17.630234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 378/744] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:17 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:18.614809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c218382f-1d8f-4c88-8c8f-e2003bb424b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:18.615436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c218382f-1d8f-4c88-8c8f-e2003bb424b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:18.617728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=80 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:18.619772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36aab83a-a056-4095-b304-a277c26ad0aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:18.620384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36aab83a-a056-4095-b304-a277c26ad0aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:18.622405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c218382f-1d8f-4c88-8c8f-e2003bb424b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:18.622923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c218382f-1d8f-4c88-8c8f-e2003bb424b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:18.623914 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c218382f-1d8f-4c88-8c8f-e2003bb424b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:18.624614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c218382f-1d8f-4c88-8c8f-e2003bb424b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:18.625069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c218382f-1d8f-4c88-8c8f-e2003bb424b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:18.625525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c218382f-1d8f-4c88-8c8f-e2003bb424b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:18.627269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36aab83a-a056-4095-b304-a277c26ad0aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:18.627753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36aab83a-a056-4095-b304-a277c26ad0aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:18.628377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36aab83a-a056-4095-b304-a277c26ad0aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:18.629074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36aab83a-a056-4095-b304-a277c26ad0aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:18.629571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36aab83a-a056-4095-b304-a277c26ad0aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:18.629993 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36aab83a-a056-4095-b304-a277c26ad0aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:18.823047 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c218382f-1d8f-4c88-8c8f-e2003bb424b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:18.830177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-36aab83a-a056-4095-b304-a277c26ad0aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:18.830744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c218382f-1d8f-4c88-8c8f-e2003bb424b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.219847 Oct 28 20:10:18.831315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 367/745] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:18 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:18.836290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60f1b8d7-8c1a-4c3d-9515-7e7f6b9c881e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:18.838433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60f1b8d7-8c1a-4c3d-9515-7e7f6b9c881e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:18.839665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-36aab83a-a056-4095-b304-a277c26ad0aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:18.841089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-36aab83a-a056-4095-b304-a277c26ad0aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:18.842377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36aab83a-a056-4095-b304-a277c26ad0aa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.226535 Oct 28 20:10:18.843211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 379/746] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:18 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:18.844447 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f1b8d7-8c1a-4c3d-9515-7e7f6b9c881e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:18.844938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f1b8d7-8c1a-4c3d-9515-7e7f6b9c881e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:18.845389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f1b8d7-8c1a-4c3d-9515-7e7f6b9c881e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:18.846264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f1b8d7-8c1a-4c3d-9515-7e7f6b9c881e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:18.846881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f1b8d7-8c1a-4c3d-9515-7e7f6b9c881e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:18.847312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f1b8d7-8c1a-4c3d-9515-7e7f6b9c881e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:18.877427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60f1b8d7-8c1a-4c3d-9515-7e7f6b9c881e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Oct 28 20:10:18.877928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 368/747] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:18 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:19.854444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-df24c767-f4eb-4f84-9018-d0a9ac542c2c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:19.855052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-df24c767-f4eb-4f84-9018-d0a9ac542c2c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:19.861988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df24c767-f4eb-4f84-9018-d0a9ac542c2c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:19.862467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df24c767-f4eb-4f84-9018-d0a9ac542c2c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:19.862986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df24c767-f4eb-4f84-9018-d0a9ac542c2c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:19.863679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df24c767-f4eb-4f84-9018-d0a9ac542c2c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:19.864125 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df24c767-f4eb-4f84-9018-d0a9ac542c2c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:19.864546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df24c767-f4eb-4f84-9018-d0a9ac542c2c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:19.867852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7438652a-b63a-439c-99b8-dfaddfa28bf9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:19.868462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7438652a-b63a-439c-99b8-dfaddfa28bf9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:19.874936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7438652a-b63a-439c-99b8-dfaddfa28bf9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:19.875413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7438652a-b63a-439c-99b8-dfaddfa28bf9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:19.875847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7438652a-b63a-439c-99b8-dfaddfa28bf9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:19.876528 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7438652a-b63a-439c-99b8-dfaddfa28bf9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:19.876986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7438652a-b63a-439c-99b8-dfaddfa28bf9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:19.877427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7438652a-b63a-439c-99b8-dfaddfa28bf9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:20.060886 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7438652a-b63a-439c-99b8-dfaddfa28bf9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:20.065827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-df24c767-f4eb-4f84-9018-d0a9ac542c2c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:20.069631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7438652a-b63a-439c-99b8-dfaddfa28bf9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:20.071077 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7438652a-b63a-439c-99b8-dfaddfa28bf9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:20.072242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7438652a-b63a-439c-99b8-dfaddfa28bf9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.208271 Oct 28 20:10:20.072829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 369/748] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:19 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:20.073300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-df24c767-f4eb-4f84-9018-d0a9ac542c2c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.222679 Oct 28 20:10:20.074641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 380/749] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:19 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:20.077986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-08a165f6-04f7-4ae8-9f83-cc7225c557a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:20.080212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-08a165f6-04f7-4ae8-9f83-cc7225c557a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:20.086268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08a165f6-04f7-4ae8-9f83-cc7225c557a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:20.086756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08a165f6-04f7-4ae8-9f83-cc7225c557a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:20.087199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08a165f6-04f7-4ae8-9f83-cc7225c557a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:20.087894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08a165f6-04f7-4ae8-9f83-cc7225c557a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:20.088354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08a165f6-04f7-4ae8-9f83-cc7225c557a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:20.088782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08a165f6-04f7-4ae8-9f83-cc7225c557a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:20.118243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-08a165f6-04f7-4ae8-9f83-cc7225c557a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044368 Oct 28 20:10:20.118811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 370/750] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:20 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:21.097736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8fc992a2-4240-433f-b036-ca9b9cf5c054 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:21.098357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8fc992a2-4240-433f-b036-ca9b9cf5c054 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:21.098493 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b8b90125-d90f-443b-bd4d-60e2c6d6b872 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:21.099023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b8b90125-d90f-443b-bd4d-60e2c6d6b872 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:21.104692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fc992a2-4240-433f-b036-ca9b9cf5c054 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:21.105175 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fc992a2-4240-433f-b036-ca9b9cf5c054 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:21.105289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8b90125-d90f-443b-bd4d-60e2c6d6b872 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:21.105650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fc992a2-4240-433f-b036-ca9b9cf5c054 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:21.105800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8b90125-d90f-443b-bd4d-60e2c6d6b872 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:21.106108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8b90125-d90f-443b-bd4d-60e2c6d6b872 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:21.106340 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fc992a2-4240-433f-b036-ca9b9cf5c054 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:21.106789 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8b90125-d90f-443b-bd4d-60e2c6d6b872 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:21.106908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fc992a2-4240-433f-b036-ca9b9cf5c054 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:21.107232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fc992a2-4240-433f-b036-ca9b9cf5c054 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:21.107363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8b90125-d90f-443b-bd4d-60e2c6d6b872 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:21.108318 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8b90125-d90f-443b-bd4d-60e2c6d6b872 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:21.312953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8fc992a2-4240-433f-b036-ca9b9cf5c054 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:21.317797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b8b90125-d90f-443b-bd4d-60e2c6d6b872 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:21.322324 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8fc992a2-4240-433f-b036-ca9b9cf5c054 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.228510 Oct 28 20:10:21.323112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 381/751] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:21 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:21.328097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b8b90125-d90f-443b-bd4d-60e2c6d6b872 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:21.328922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ca100d9c-5d94-4f8d-a3b9-670f8b00879b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:21.329889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b8b90125-d90f-443b-bd4d-60e2c6d6b872 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:21.331116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b8b90125-d90f-443b-bd4d-60e2c6d6b872 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.236490 Oct 28 20:10:21.331771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ca100d9c-5d94-4f8d-a3b9-670f8b00879b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:21.345414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 371/752] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:21 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:21.345813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca100d9c-5d94-4f8d-a3b9-670f8b00879b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:21.345813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca100d9c-5d94-4f8d-a3b9-670f8b00879b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:21.345813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca100d9c-5d94-4f8d-a3b9-670f8b00879b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:21.345813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca100d9c-5d94-4f8d-a3b9-670f8b00879b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:21.346149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca100d9c-5d94-4f8d-a3b9-670f8b00879b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:21.346149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca100d9c-5d94-4f8d-a3b9-670f8b00879b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:21.370570 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ca100d9c-5d94-4f8d-a3b9-670f8b00879b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046255 Oct 28 20:10:21.371111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 382/753] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:21 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:22.346334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-857e0da7-d49b-4062-9fef-68aed3cfe813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:22.347023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-857e0da7-d49b-4062-9fef-68aed3cfe813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:22.353637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-857e0da7-d49b-4062-9fef-68aed3cfe813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:22.354211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-857e0da7-d49b-4062-9fef-68aed3cfe813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:22.354716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-857e0da7-d49b-4062-9fef-68aed3cfe813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:22.355494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-857e0da7-d49b-4062-9fef-68aed3cfe813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:22.356022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-857e0da7-d49b-4062-9fef-68aed3cfe813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:22.356452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-857e0da7-d49b-4062-9fef-68aed3cfe813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:22.360130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf5b3414-2f31-4f4e-b7fe-4ce4874badc6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:22.360701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cf5b3414-2f31-4f4e-b7fe-4ce4874badc6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:22.367382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf5b3414-2f31-4f4e-b7fe-4ce4874badc6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:22.367876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf5b3414-2f31-4f4e-b7fe-4ce4874badc6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:22.368317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf5b3414-2f31-4f4e-b7fe-4ce4874badc6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:22.369143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf5b3414-2f31-4f4e-b7fe-4ce4874badc6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:22.369606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf5b3414-2f31-4f4e-b7fe-4ce4874badc6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:22.370033 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf5b3414-2f31-4f4e-b7fe-4ce4874badc6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:22.554649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-857e0da7-d49b-4062-9fef-68aed3cfe813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:22.563125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-857e0da7-d49b-4062-9fef-68aed3cfe813 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.220505 Oct 28 20:10:22.563707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 372/754] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:22 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:22.584143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4de8e8c4-eb10-4f45-bac2-15b4c3055f95 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:22.588099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4de8e8c4-eb10-4f45-bac2-15b4c3055f95 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:22.598518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4de8e8c4-eb10-4f45-bac2-15b4c3055f95 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:22.599416 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4de8e8c4-eb10-4f45-bac2-15b4c3055f95 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:22.600227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4de8e8c4-eb10-4f45-bac2-15b4c3055f95 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:22.601527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4de8e8c4-eb10-4f45-bac2-15b4c3055f95 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:22.602377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4de8e8c4-eb10-4f45-bac2-15b4c3055f95 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:22.603145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4de8e8c4-eb10-4f45-bac2-15b4c3055f95 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:22.609307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cf5b3414-2f31-4f4e-b7fe-4ce4874badc6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:22.618119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cf5b3414-2f31-4f4e-b7fe-4ce4874badc6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:22.619559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cf5b3414-2f31-4f4e-b7fe-4ce4874badc6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:22.620715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cf5b3414-2f31-4f4e-b7fe-4ce4874badc6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.266128 Oct 28 20:10:22.621275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 383/755] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:22 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:22.635937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4de8e8c4-eb10-4f45-bac2-15b4c3055f95 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071225 Oct 28 20:10:22.636486 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 373/756] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:22 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:23.586048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5a90d1ba-0768-4d74-b77a-ca9e3727299c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:23.586579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5a90d1ba-0768-4d74-b77a-ca9e3727299c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:23.593639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a90d1ba-0768-4d74-b77a-ca9e3727299c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:23.594106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a90d1ba-0768-4d74-b77a-ca9e3727299c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:23.594537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a90d1ba-0768-4d74-b77a-ca9e3727299c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:23.595213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a90d1ba-0768-4d74-b77a-ca9e3727299c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:23.595658 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a90d1ba-0768-4d74-b77a-ca9e3727299c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:23.596075 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a90d1ba-0768-4d74-b77a-ca9e3727299c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:23.647669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6330c59b-e395-4a6b-ae2f-72ab6d689c37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:23.648286 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6330c59b-e395-4a6b-ae2f-72ab6d689c37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:23.655778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6330c59b-e395-4a6b-ae2f-72ab6d689c37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:23.656274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6330c59b-e395-4a6b-ae2f-72ab6d689c37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:23.656713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6330c59b-e395-4a6b-ae2f-72ab6d689c37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:23.657444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6330c59b-e395-4a6b-ae2f-72ab6d689c37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:23.657906 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6330c59b-e395-4a6b-ae2f-72ab6d689c37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:23.658335 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6330c59b-e395-4a6b-ae2f-72ab6d689c37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:23.768564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5a90d1ba-0768-4d74-b77a-ca9e3727299c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:23.776408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5a90d1ba-0768-4d74-b77a-ca9e3727299c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.194411 Oct 28 20:10:23.781486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 384/757] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:23 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:23.782971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3a3d7cb5-c2e1-4a77-a4de-afd80f8ffb29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:23.785105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3a3d7cb5-c2e1-4a77-a4de-afd80f8ffb29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:23.790870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a3d7cb5-c2e1-4a77-a4de-afd80f8ffb29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:23.791356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a3d7cb5-c2e1-4a77-a4de-afd80f8ffb29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:23.791795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a3d7cb5-c2e1-4a77-a4de-afd80f8ffb29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:23.792508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a3d7cb5-c2e1-4a77-a4de-afd80f8ffb29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:23.792989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a3d7cb5-c2e1-4a77-a4de-afd80f8ffb29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:23.793444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a3d7cb5-c2e1-4a77-a4de-afd80f8ffb29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:23.813155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6330c59b-e395-4a6b-ae2f-72ab6d689c37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:23.815759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:23.822646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6330c59b-e395-4a6b-ae2f-72ab6d689c37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:23.824104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6330c59b-e395-4a6b-ae2f-72ab6d689c37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:23.825222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3a3d7cb5-c2e1-4a77-a4de-afd80f8ffb29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047196 Oct 28 20:10:23.825379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6330c59b-e395-4a6b-ae2f-72ab6d689c37 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.181506 Oct 28 20:10:23.826434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 374/758] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:23 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:23.829348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 385/759] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:23 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:24.804078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a65511f-bb54-4be1-9496-48758191b9b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:24.804686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a65511f-bb54-4be1-9496-48758191b9b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:24.811310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a65511f-bb54-4be1-9496-48758191b9b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:24.811791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a65511f-bb54-4be1-9496-48758191b9b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:24.812221 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a65511f-bb54-4be1-9496-48758191b9b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:24.812896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a65511f-bb54-4be1-9496-48758191b9b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:24.813379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a65511f-bb54-4be1-9496-48758191b9b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:24.813831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a65511f-bb54-4be1-9496-48758191b9b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:24.838971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-89dc4911-9341-43c3-928b-271c3a5c669f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:24.841155 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-89dc4911-9341-43c3-928b-271c3a5c669f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:24.848151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89dc4911-9341-43c3-928b-271c3a5c669f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:24.848924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89dc4911-9341-43c3-928b-271c3a5c669f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:24.849038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89dc4911-9341-43c3-928b-271c3a5c669f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:24.849758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89dc4911-9341-43c3-928b-271c3a5c669f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:24.850210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89dc4911-9341-43c3-928b-271c3a5c669f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:24.850633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89dc4911-9341-43c3-928b-271c3a5c669f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:24.881393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-89dc4911-9341-43c3-928b-271c3a5c669f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046595 Oct 28 20:10:24.882146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 386/760] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:24 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:10:24.886230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91d86502-1240-4b75-af8a-4518683a8f26 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:24.886827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-91d86502-1240-4b75-af8a-4518683a8f26 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:24.892202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91d86502-1240-4b75-af8a-4518683a8f26 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:24.892672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91d86502-1240-4b75-af8a-4518683a8f26 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:24.893110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91d86502-1240-4b75-af8a-4518683a8f26 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:24.893791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91d86502-1240-4b75-af8a-4518683a8f26 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:24.894238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91d86502-1240-4b75-af8a-4518683a8f26 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:24.894654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91d86502-1240-4b75-af8a-4518683a8f26 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:25.046983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1a65511f-bb54-4be1-9496-48758191b9b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:25.054667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a65511f-bb54-4be1-9496-48758191b9b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.254884 Oct 28 20:10:25.055170 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 375/761] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:24 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:25.073715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-91d86502-1240-4b75-af8a-4518683a8f26 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:25.082524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-91d86502-1240-4b75-af8a-4518683a8f26 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:25.084041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-91d86502-1240-4b75-af8a-4518683a8f26 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:25.085501 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-91d86502-1240-4b75-af8a-4518683a8f26 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.202339 Oct 28 20:10:25.086060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 387/762] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:24 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:25.894321 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d3ed9012-a3c7-4c92-ba48-271b1a1c779f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:25.896438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d3ed9012-a3c7-4c92-ba48-271b1a1c779f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:25.902875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3ed9012-a3c7-4c92-ba48-271b1a1c779f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:25.903355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3ed9012-a3c7-4c92-ba48-271b1a1c779f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:25.903792 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3ed9012-a3c7-4c92-ba48-271b1a1c779f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:25.904472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3ed9012-a3c7-4c92-ba48-271b1a1c779f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:25.905439 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3ed9012-a3c7-4c92-ba48-271b1a1c779f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:25.905863 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3ed9012-a3c7-4c92-ba48-271b1a1c779f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:25.934923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d3ed9012-a3c7-4c92-ba48-271b1a1c779f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044603 Oct 28 20:10:25.935511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 376/763] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:25 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:26.077088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2ee33a6a-d501-4c6e-be85-e1b8399506e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:26.077722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2ee33a6a-d501-4c6e-be85-e1b8399506e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:26.084060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ee33a6a-d501-4c6e-be85-e1b8399506e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:26.084533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ee33a6a-d501-4c6e-be85-e1b8399506e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:26.084967 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ee33a6a-d501-4c6e-be85-e1b8399506e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:26.085932 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ee33a6a-d501-4c6e-be85-e1b8399506e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:26.086384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ee33a6a-d501-4c6e-be85-e1b8399506e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:26.086806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ee33a6a-d501-4c6e-be85-e1b8399506e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:26.111907 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5f5af3b6-3eb1-4598-82ac-ac61c0853e64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:26.112515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5f5af3b6-3eb1-4598-82ac-ac61c0853e64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:26.118314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f5af3b6-3eb1-4598-82ac-ac61c0853e64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:26.118802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f5af3b6-3eb1-4598-82ac-ac61c0853e64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:26.119239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f5af3b6-3eb1-4598-82ac-ac61c0853e64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:26.119926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f5af3b6-3eb1-4598-82ac-ac61c0853e64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:26.120380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f5af3b6-3eb1-4598-82ac-ac61c0853e64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:26.120799 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f5af3b6-3eb1-4598-82ac-ac61c0853e64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:26.273839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ee33a6a-d501-4c6e-be85-e1b8399506e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:26.281473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2ee33a6a-d501-4c6e-be85-e1b8399506e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.208281 Oct 28 20:10:26.282043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 388/764] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:26 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:26.300457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f5af3b6-3eb1-4598-82ac-ac61c0853e64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:26.308829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f5af3b6-3eb1-4598-82ac-ac61c0853e64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:26.310302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f5af3b6-3eb1-4598-82ac-ac61c0853e64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:26.312093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5f5af3b6-3eb1-4598-82ac-ac61c0853e64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.204528 Oct 28 20:10:26.312643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 377/765] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:26 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:26.947836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cca18008-e969-4958-8cb0-d0b29d3fa22c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:26.949960 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cca18008-e969-4958-8cb0-d0b29d3fa22c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:26.955842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cca18008-e969-4958-8cb0-d0b29d3fa22c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:26.956311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cca18008-e969-4958-8cb0-d0b29d3fa22c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:26.956740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cca18008-e969-4958-8cb0-d0b29d3fa22c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:26.957443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cca18008-e969-4958-8cb0-d0b29d3fa22c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:26.957891 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cca18008-e969-4958-8cb0-d0b29d3fa22c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:26.958310 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cca18008-e969-4958-8cb0-d0b29d3fa22c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:26.988056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cca18008-e969-4958-8cb0-d0b29d3fa22c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044164 Oct 28 20:10:26.988608 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 389/766] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:26 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:27.305261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9d75342-1f68-4553-a62f-93b61ebfe42d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:27.305832 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f9d75342-1f68-4553-a62f-93b61ebfe42d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:27.312884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9d75342-1f68-4553-a62f-93b61ebfe42d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:27.313400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9d75342-1f68-4553-a62f-93b61ebfe42d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:27.313846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9d75342-1f68-4553-a62f-93b61ebfe42d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:27.314548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9d75342-1f68-4553-a62f-93b61ebfe42d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:27.315008 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9d75342-1f68-4553-a62f-93b61ebfe42d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:27.315433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9d75342-1f68-4553-a62f-93b61ebfe42d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:27.338049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5801bc29-3c7b-4878-94b1-db855fa1bd71 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:27.338650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5801bc29-3c7b-4878-94b1-db855fa1bd71 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:27.345707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5801bc29-3c7b-4878-94b1-db855fa1bd71 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:27.346181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5801bc29-3c7b-4878-94b1-db855fa1bd71 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:27.346612 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5801bc29-3c7b-4878-94b1-db855fa1bd71 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:27.347292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5801bc29-3c7b-4878-94b1-db855fa1bd71 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:27.347736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5801bc29-3c7b-4878-94b1-db855fa1bd71 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:27.348150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5801bc29-3c7b-4878-94b1-db855fa1bd71 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:27.497123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f9d75342-1f68-4553-a62f-93b61ebfe42d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:27.504781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f9d75342-1f68-4553-a62f-93b61ebfe42d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.204065 Oct 28 20:10:27.505586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 378/767] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:27 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:27.523302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5801bc29-3c7b-4878-94b1-db855fa1bd71 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:27.532383 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5801bc29-3c7b-4878-94b1-db855fa1bd71 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:27.533829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5801bc29-3c7b-4878-94b1-db855fa1bd71 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:27.534969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5801bc29-3c7b-4878-94b1-db855fa1bd71 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.201110 Oct 28 20:10:27.535514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 390/768] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:27 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:28.001036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0479a4d9-574d-4a3e-ae58-c4ae349eb041 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:28.003262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0479a4d9-574d-4a3e-ae58-c4ae349eb041 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:28.009091 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0479a4d9-574d-4a3e-ae58-c4ae349eb041 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:28.009607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0479a4d9-574d-4a3e-ae58-c4ae349eb041 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:28.010054 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0479a4d9-574d-4a3e-ae58-c4ae349eb041 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:28.010752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0479a4d9-574d-4a3e-ae58-c4ae349eb041 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:28.011205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0479a4d9-574d-4a3e-ae58-c4ae349eb041 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:28.011628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0479a4d9-574d-4a3e-ae58-c4ae349eb041 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:28.041609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0479a4d9-574d-4a3e-ae58-c4ae349eb041 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045029 Oct 28 20:10:28.044534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 379/769] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:27 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:28.527776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-99538e02-9ff1-46a2-bdd5-fbd5382f8922 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:28.528392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-99538e02-9ff1-46a2-bdd5-fbd5382f8922 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:28.535753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99538e02-9ff1-46a2-bdd5-fbd5382f8922 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:28.536237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99538e02-9ff1-46a2-bdd5-fbd5382f8922 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:28.536675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99538e02-9ff1-46a2-bdd5-fbd5382f8922 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:28.537384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99538e02-9ff1-46a2-bdd5-fbd5382f8922 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:28.537842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99538e02-9ff1-46a2-bdd5-fbd5382f8922 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:28.538264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99538e02-9ff1-46a2-bdd5-fbd5382f8922 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:28.542211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:28.560469 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c4c3df63-4f6f-4cb5-bdf0-01434d3efac6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:28.561092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c4c3df63-4f6f-4cb5-bdf0-01434d3efac6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:28.567345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c3df63-4f6f-4cb5-bdf0-01434d3efac6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:28.571659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c3df63-4f6f-4cb5-bdf0-01434d3efac6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:28.571659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c3df63-4f6f-4cb5-bdf0-01434d3efac6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:28.571659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c3df63-4f6f-4cb5-bdf0-01434d3efac6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:28.571659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c3df63-4f6f-4cb5-bdf0-01434d3efac6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:28.572034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c3df63-4f6f-4cb5-bdf0-01434d3efac6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:28.724492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-99538e02-9ff1-46a2-bdd5-fbd5382f8922 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:28.732766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-99538e02-9ff1-46a2-bdd5-fbd5382f8922 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.208680 Oct 28 20:10:28.733366 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 391/770] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:28 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:28.745907 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c4c3df63-4f6f-4cb5-bdf0-01434d3efac6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:28.755522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c4c3df63-4f6f-4cb5-bdf0-01434d3efac6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:28.757552 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c4c3df63-4f6f-4cb5-bdf0-01434d3efac6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:28.758367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c4c3df63-4f6f-4cb5-bdf0-01434d3efac6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.202009 Oct 28 20:10:28.759135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 380/771] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:28 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:29.053846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8fe43879-c2f9-49e4-81fa-4375eeef55c2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:29.056080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8fe43879-c2f9-49e4-81fa-4375eeef55c2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:29.062757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe43879-c2f9-49e4-81fa-4375eeef55c2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:29.063241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe43879-c2f9-49e4-81fa-4375eeef55c2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:29.063677 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe43879-c2f9-49e4-81fa-4375eeef55c2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:29.066264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe43879-c2f9-49e4-81fa-4375eeef55c2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:29.066264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe43879-c2f9-49e4-81fa-4375eeef55c2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:29.066264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe43879-c2f9-49e4-81fa-4375eeef55c2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:29.094096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8fe43879-c2f9-49e4-81fa-4375eeef55c2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044204 Oct 28 20:10:29.094640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 392/772] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:29 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:29.756145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f4c265d3-939f-4b58-9bf8-0e9ff3ae4129 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:29.756858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f4c265d3-939f-4b58-9bf8-0e9ff3ae4129 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:29.763265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4c265d3-939f-4b58-9bf8-0e9ff3ae4129 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:29.764601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4c265d3-939f-4b58-9bf8-0e9ff3ae4129 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:29.765216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4c265d3-939f-4b58-9bf8-0e9ff3ae4129 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:29.765934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4c265d3-939f-4b58-9bf8-0e9ff3ae4129 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:29.766396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4c265d3-939f-4b58-9bf8-0e9ff3ae4129 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:29.766820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4c265d3-939f-4b58-9bf8-0e9ff3ae4129 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:29.784977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-50e36671-f768-403b-bf5e-14e3bf0d6293 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:29.792318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-50e36671-f768-403b-bf5e-14e3bf0d6293 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:29.792318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e36671-f768-403b-bf5e-14e3bf0d6293 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:29.792318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e36671-f768-403b-bf5e-14e3bf0d6293 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:29.792659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e36671-f768-403b-bf5e-14e3bf0d6293 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:29.793412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e36671-f768-403b-bf5e-14e3bf0d6293 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:29.793872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e36671-f768-403b-bf5e-14e3bf0d6293 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:29.794561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e36671-f768-403b-bf5e-14e3bf0d6293 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:29.959448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f4c265d3-939f-4b58-9bf8-0e9ff3ae4129 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:29.968666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f4c265d3-939f-4b58-9bf8-0e9ff3ae4129 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.216269 Oct 28 20:10:29.969242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 381/773] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:29 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:10:29.981233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-50e36671-f768-403b-bf5e-14e3bf0d6293 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:29.990816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-50e36671-f768-403b-bf5e-14e3bf0d6293 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:29.992246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-50e36671-f768-403b-bf5e-14e3bf0d6293 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:29.993423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-50e36671-f768-403b-bf5e-14e3bf0d6293 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.212246 Oct 28 20:10:29.994001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 393/774] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:29 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:30.106488 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c809672-b2c8-4fb5-97e6-bb3ed0be6290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:30.109266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8c809672-b2c8-4fb5-97e6-bb3ed0be6290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:30.115169 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c809672-b2c8-4fb5-97e6-bb3ed0be6290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:30.115656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c809672-b2c8-4fb5-97e6-bb3ed0be6290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:30.116089 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c809672-b2c8-4fb5-97e6-bb3ed0be6290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:30.116773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c809672-b2c8-4fb5-97e6-bb3ed0be6290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:30.117231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c809672-b2c8-4fb5-97e6-bb3ed0be6290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:30.117690 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c809672-b2c8-4fb5-97e6-bb3ed0be6290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:30.146785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8c809672-b2c8-4fb5-97e6-bb3ed0be6290 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Oct 28 20:10:30.147330 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 382/775] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:30 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:10:30.991170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0699e300-f2ac-4e76-9dba-1b4cdd9d0e4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:30.991661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0699e300-f2ac-4e76-9dba-1b4cdd9d0e4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:30.997681 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0699e300-f2ac-4e76-9dba-1b4cdd9d0e4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:30.998478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0699e300-f2ac-4e76-9dba-1b4cdd9d0e4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:30.999098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0699e300-f2ac-4e76-9dba-1b4cdd9d0e4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:30.999982 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0699e300-f2ac-4e76-9dba-1b4cdd9d0e4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:31.000582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0699e300-f2ac-4e76-9dba-1b4cdd9d0e4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:31.001164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0699e300-f2ac-4e76-9dba-1b4cdd9d0e4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:31.019968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-70b48b5e-d8bb-4b76-bb99-1c844a9ed136 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:31.020581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-70b48b5e-d8bb-4b76-bb99-1c844a9ed136 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:31.026662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70b48b5e-d8bb-4b76-bb99-1c844a9ed136 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:31.027147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70b48b5e-d8bb-4b76-bb99-1c844a9ed136 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:31.027761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70b48b5e-d8bb-4b76-bb99-1c844a9ed136 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:31.028617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70b48b5e-d8bb-4b76-bb99-1c844a9ed136 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:31.029806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70b48b5e-d8bb-4b76-bb99-1c844a9ed136 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:31.030383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70b48b5e-d8bb-4b76-bb99-1c844a9ed136 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:31.206174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0699e300-f2ac-4e76-9dba-1b4cdd9d0e4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:31.213911 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0699e300-f2ac-4e76-9dba-1b4cdd9d0e4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.226463 Oct 28 20:10:31.221557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 394/776] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:30 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:31.221887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-70b48b5e-d8bb-4b76-bb99-1c844a9ed136 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:31.222023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c4eed2c7-8901-4030-a5b6-0a790c2253c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:31.223143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c4eed2c7-8901-4030-a5b6-0a790c2253c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:31.226800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-70b48b5e-d8bb-4b76-bb99-1c844a9ed136 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:31.228334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-70b48b5e-d8bb-4b76-bb99-1c844a9ed136 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:31.228903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4eed2c7-8901-4030-a5b6-0a790c2253c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:31.229412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4eed2c7-8901-4030-a5b6-0a790c2253c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:31.229854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4eed2c7-8901-4030-a5b6-0a790c2253c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:31.229977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-70b48b5e-d8bb-4b76-bb99-1c844a9ed136 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.213709 Oct 28 20:10:31.230466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 383/777] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:31 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:31.230630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4eed2c7-8901-4030-a5b6-0a790c2253c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:31.230979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4eed2c7-8901-4030-a5b6-0a790c2253c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:31.231475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4eed2c7-8901-4030-a5b6-0a790c2253c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:31.260568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c4eed2c7-8901-4030-a5b6-0a790c2253c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045070 Oct 28 20:10:31.261119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 395/778] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:31 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:32.237581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bb3ce4be-28f2-4a02-93de-38f0203625cf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:32.238098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bb3ce4be-28f2-4a02-93de-38f0203625cf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:32.244346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb3ce4be-28f2-4a02-93de-38f0203625cf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:32.244820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb3ce4be-28f2-4a02-93de-38f0203625cf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:32.245247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb3ce4be-28f2-4a02-93de-38f0203625cf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:32.246066 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb3ce4be-28f2-4a02-93de-38f0203625cf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:32.246510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb3ce4be-28f2-4a02-93de-38f0203625cf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:32.246927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb3ce4be-28f2-4a02-93de-38f0203625cf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:32.255844 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1d6d5cf8-f4e6-456e-9392-675336f0ea6e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:32.256461 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1d6d5cf8-f4e6-456e-9392-675336f0ea6e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:32.262782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d6d5cf8-f4e6-456e-9392-675336f0ea6e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:32.263272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d6d5cf8-f4e6-456e-9392-675336f0ea6e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:32.264658 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d6d5cf8-f4e6-456e-9392-675336f0ea6e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:32.265549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d6d5cf8-f4e6-456e-9392-675336f0ea6e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:32.266011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d6d5cf8-f4e6-456e-9392-675336f0ea6e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:32.266465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d6d5cf8-f4e6-456e-9392-675336f0ea6e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:32.446484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bb3ce4be-28f2-4a02-93de-38f0203625cf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:32.455035 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bb3ce4be-28f2-4a02-93de-38f0203625cf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.221483 Oct 28 20:10:32.469388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 384/779] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:32 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:32.469615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1d6d5cf8-f4e6-456e-9392-675336f0ea6e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:32.469740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-68d5df33-e749-4619-9cc0-1496415f1672 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:32.469740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-68d5df33-e749-4619-9cc0-1496415f1672 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:32.469938 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1d6d5cf8-f4e6-456e-9392-675336f0ea6e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:32.470065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68d5df33-e749-4619-9cc0-1496415f1672 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:32.470065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68d5df33-e749-4619-9cc0-1496415f1672 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:32.470252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1d6d5cf8-f4e6-456e-9392-675336f0ea6e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:32.470358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68d5df33-e749-4619-9cc0-1496415f1672 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:32.470358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68d5df33-e749-4619-9cc0-1496415f1672 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:32.470804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68d5df33-e749-4619-9cc0-1496415f1672 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:32.471497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68d5df33-e749-4619-9cc0-1496415f1672 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:32.471588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1d6d5cf8-f4e6-456e-9392-675336f0ea6e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.219199 Oct 28 20:10:32.471968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 396/780] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:32 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:32.500973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-68d5df33-e749-4619-9cc0-1496415f1672 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044018 Oct 28 20:10:32.501498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 385/781] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:32 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:33.480009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-63baf3da-a1ba-4012-a2da-a1aa68a581de tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:33.480644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-63baf3da-a1ba-4012-a2da-a1aa68a581de tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:33.487436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63baf3da-a1ba-4012-a2da-a1aa68a581de tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:33.487917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63baf3da-a1ba-4012-a2da-a1aa68a581de tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:33.488352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63baf3da-a1ba-4012-a2da-a1aa68a581de tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:33.489082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63baf3da-a1ba-4012-a2da-a1aa68a581de tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:33.489576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63baf3da-a1ba-4012-a2da-a1aa68a581de tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:33.490016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63baf3da-a1ba-4012-a2da-a1aa68a581de tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:33.495758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3c2951b4-9037-4c23-907b-17fec5b0e0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:33.496398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3c2951b4-9037-4c23-907b-17fec5b0e0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:33.503217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c2951b4-9037-4c23-907b-17fec5b0e0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:33.503703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c2951b4-9037-4c23-907b-17fec5b0e0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:33.504132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c2951b4-9037-4c23-907b-17fec5b0e0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:33.504851 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c2951b4-9037-4c23-907b-17fec5b0e0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:33.505305 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c2951b4-9037-4c23-907b-17fec5b0e0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:33.505749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c2951b4-9037-4c23-907b-17fec5b0e0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:33.696219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-63baf3da-a1ba-4012-a2da-a1aa68a581de tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:33.700175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3c2951b4-9037-4c23-907b-17fec5b0e0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:33.703875 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-63baf3da-a1ba-4012-a2da-a1aa68a581de tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.227676 Oct 28 20:10:33.704438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 397/782] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:33 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:33.708918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3c2951b4-9037-4c23-907b-17fec5b0e0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:33.710656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3c2951b4-9037-4c23-907b-17fec5b0e0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:33.711802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3c2951b4-9037-4c23-907b-17fec5b0e0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.219849 Oct 28 20:10:33.712391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 386/783] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:33 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:33.813024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b9d2c350-0902-4377-8a65-9fa2f218c6ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:33.815398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b9d2c350-0902-4377-8a65-9fa2f218c6ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:33.821288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9d2c350-0902-4377-8a65-9fa2f218c6ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:33.821799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9d2c350-0902-4377-8a65-9fa2f218c6ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:33.822236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9d2c350-0902-4377-8a65-9fa2f218c6ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:33.822924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9d2c350-0902-4377-8a65-9fa2f218c6ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:33.823376 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9d2c350-0902-4377-8a65-9fa2f218c6ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:33.823800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9d2c350-0902-4377-8a65-9fa2f218c6ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:33.853040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b9d2c350-0902-4377-8a65-9fa2f218c6ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147583 Oct 28 20:10:33.853552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 398/784] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:33 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:34.727466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ee7c9055-4ae6-4802-88fb-ccefd99efd70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:34.728074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ee7c9055-4ae6-4802-88fb-ccefd99efd70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:34.735094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee7c9055-4ae6-4802-88fb-ccefd99efd70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:34.735582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee7c9055-4ae6-4802-88fb-ccefd99efd70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:34.736056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee7c9055-4ae6-4802-88fb-ccefd99efd70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:34.736285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-349ffff5-136d-49c0-a8e3-608655020172 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:34.736754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee7c9055-4ae6-4802-88fb-ccefd99efd70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:34.737071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-349ffff5-136d-49c0-a8e3-608655020172 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:34.737203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee7c9055-4ae6-4802-88fb-ccefd99efd70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:34.737655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee7c9055-4ae6-4802-88fb-ccefd99efd70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:34.743383 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-349ffff5-136d-49c0-a8e3-608655020172 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:34.743868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-349ffff5-136d-49c0-a8e3-608655020172 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:34.744310 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-349ffff5-136d-49c0-a8e3-608655020172 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:34.744996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-349ffff5-136d-49c0-a8e3-608655020172 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:34.745482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-349ffff5-136d-49c0-a8e3-608655020172 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:34.745908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-349ffff5-136d-49c0-a8e3-608655020172 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:34.901480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ee7c9055-4ae6-4802-88fb-ccefd99efd70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:34.907685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ee7c9055-4ae6-4802-88fb-ccefd99efd70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.184096 Oct 28 20:10:34.908254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 387/785] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:34 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:34.913671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f6ad07cf-b517-4ee5-aede-dfeffcd2aa6e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:34.915878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f6ad07cf-b517-4ee5-aede-dfeffcd2aa6e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:34.921718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6ad07cf-b517-4ee5-aede-dfeffcd2aa6e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:34.922202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6ad07cf-b517-4ee5-aede-dfeffcd2aa6e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:34.922632 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6ad07cf-b517-4ee5-aede-dfeffcd2aa6e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:34.923317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6ad07cf-b517-4ee5-aede-dfeffcd2aa6e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:34.923764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6ad07cf-b517-4ee5-aede-dfeffcd2aa6e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:34.924184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6ad07cf-b517-4ee5-aede-dfeffcd2aa6e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:34.955573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f6ad07cf-b517-4ee5-aede-dfeffcd2aa6e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045487 Oct 28 20:10:34.956131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-349ffff5-136d-49c0-a8e3-608655020172 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:34.956264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 388/786] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:34 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:34.965057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-349ffff5-136d-49c0-a8e3-608655020172 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:34.966523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-349ffff5-136d-49c0-a8e3-608655020172 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:34.968029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-349ffff5-136d-49c0-a8e3-608655020172 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.236007 Oct 28 20:10:34.968583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 399/787] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:34 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:35.930689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3ae54666-2845-4cce-87ed-e70529d852ba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:35.931303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3ae54666-2845-4cce-87ed-e70529d852ba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:35.937900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ae54666-2845-4cce-87ed-e70529d852ba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:35.938385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ae54666-2845-4cce-87ed-e70529d852ba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:35.938821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ae54666-2845-4cce-87ed-e70529d852ba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:35.939509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ae54666-2845-4cce-87ed-e70529d852ba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:35.939967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ae54666-2845-4cce-87ed-e70529d852ba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:35.940393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ae54666-2845-4cce-87ed-e70529d852ba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:35.969004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c8d5a5bf-80f8-49f6-8d0a-ee18d696e0c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:35.971375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c8d5a5bf-80f8-49f6-8d0a-ee18d696e0c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:35.977842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d5a5bf-80f8-49f6-8d0a-ee18d696e0c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:35.978328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d5a5bf-80f8-49f6-8d0a-ee18d696e0c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:35.978755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d5a5bf-80f8-49f6-8d0a-ee18d696e0c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:35.979443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d5a5bf-80f8-49f6-8d0a-ee18d696e0c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:35.979917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d5a5bf-80f8-49f6-8d0a-ee18d696e0c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:35.980334 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d5a5bf-80f8-49f6-8d0a-ee18d696e0c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:36.010555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c8d5a5bf-80f8-49f6-8d0a-ee18d696e0c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046207 Oct 28 20:10:36.016039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 400/788] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:35 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:10:36.016609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8cd1a746-cdc8-4272-b2c8-c2d48422843d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:36.017304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8cd1a746-cdc8-4272-b2c8-c2d48422843d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:36.023060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cd1a746-cdc8-4272-b2c8-c2d48422843d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:36.023542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cd1a746-cdc8-4272-b2c8-c2d48422843d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:36.023980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cd1a746-cdc8-4272-b2c8-c2d48422843d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:36.024673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cd1a746-cdc8-4272-b2c8-c2d48422843d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:36.025130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cd1a746-cdc8-4272-b2c8-c2d48422843d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:36.025586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cd1a746-cdc8-4272-b2c8-c2d48422843d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:36.082426 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3ae54666-2845-4cce-87ed-e70529d852ba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:36.090275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3ae54666-2845-4cce-87ed-e70529d852ba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.163455 Oct 28 20:10:36.090845 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 389/789] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:35 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:36.163816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8cd1a746-cdc8-4272-b2c8-c2d48422843d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:36.172413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8cd1a746-cdc8-4272-b2c8-c2d48422843d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:36.173889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8cd1a746-cdc8-4272-b2c8-c2d48422843d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:36.175037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8cd1a746-cdc8-4272-b2c8-c2d48422843d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.163005 Oct 28 20:10:36.175590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 401/790] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:36 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:37.024114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9cf0e2a7-4720-4aae-b027-7ce18f59191e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:37.026292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9cf0e2a7-4720-4aae-b027-7ce18f59191e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:37.033570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cf0e2a7-4720-4aae-b027-7ce18f59191e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:37.034075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cf0e2a7-4720-4aae-b027-7ce18f59191e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:37.034492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cf0e2a7-4720-4aae-b027-7ce18f59191e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:37.035184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cf0e2a7-4720-4aae-b027-7ce18f59191e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:37.035635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cf0e2a7-4720-4aae-b027-7ce18f59191e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:37.036061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cf0e2a7-4720-4aae-b027-7ce18f59191e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:37.065131 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9cf0e2a7-4720-4aae-b027-7ce18f59191e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045199 Oct 28 20:10:37.065708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 390/791] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:37 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:37.114342 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9444c15-0fb6-485c-9d6a-9d8a6157f8ee tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:37.114982 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f9444c15-0fb6-485c-9d6a-9d8a6157f8ee tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:37.121387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9444c15-0fb6-485c-9d6a-9d8a6157f8ee tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:37.121866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9444c15-0fb6-485c-9d6a-9d8a6157f8ee tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:37.122300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9444c15-0fb6-485c-9d6a-9d8a6157f8ee tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:37.122980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9444c15-0fb6-485c-9d6a-9d8a6157f8ee tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:37.123621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9444c15-0fb6-485c-9d6a-9d8a6157f8ee tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:37.124011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9444c15-0fb6-485c-9d6a-9d8a6157f8ee tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:37.200591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ff9a0b4-234c-470d-9f27-06d12b1dfc5d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:37.200591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ff9a0b4-234c-470d-9f27-06d12b1dfc5d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:37.206440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ff9a0b4-234c-470d-9f27-06d12b1dfc5d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:37.206915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ff9a0b4-234c-470d-9f27-06d12b1dfc5d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:37.207342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ff9a0b4-234c-470d-9f27-06d12b1dfc5d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:37.208022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ff9a0b4-234c-470d-9f27-06d12b1dfc5d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:37.208469 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ff9a0b4-234c-470d-9f27-06d12b1dfc5d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:37.208884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ff9a0b4-234c-470d-9f27-06d12b1dfc5d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:37.224424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:37.265312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f9444c15-0fb6-485c-9d6a-9d8a6157f8ee tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:37.273006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f9444c15-0fb6-485c-9d6a-9d8a6157f8ee tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.162416 Oct 28 20:10:37.273603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 402/792] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:37 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:37.352316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0ff9a0b4-234c-470d-9f27-06d12b1dfc5d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:37.361050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0ff9a0b4-234c-470d-9f27-06d12b1dfc5d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:37.362536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0ff9a0b4-234c-470d-9f27-06d12b1dfc5d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:37.363695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ff9a0b4-234c-470d-9f27-06d12b1dfc5d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.167572 Oct 28 20:10:37.364249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 391/793] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:37 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:38.078088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6c2f95a9-ca7b-418b-aaac-03b7e2c06cac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:38.080381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6c2f95a9-ca7b-418b-aaac-03b7e2c06cac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:38.087500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c2f95a9-ca7b-418b-aaac-03b7e2c06cac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:38.088080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c2f95a9-ca7b-418b-aaac-03b7e2c06cac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:38.088520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c2f95a9-ca7b-418b-aaac-03b7e2c06cac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:38.089229 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c2f95a9-ca7b-418b-aaac-03b7e2c06cac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:38.089824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c2f95a9-ca7b-418b-aaac-03b7e2c06cac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:38.090321 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c2f95a9-ca7b-418b-aaac-03b7e2c06cac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:38.122210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6c2f95a9-ca7b-418b-aaac-03b7e2c06cac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048405 Oct 28 20:10:38.123759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 403/794] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:38 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:38.296943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a18b36ec-666c-4458-818b-b75410e1517d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:38.297625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a18b36ec-666c-4458-818b-b75410e1517d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:38.304232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a18b36ec-666c-4458-818b-b75410e1517d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:38.304728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a18b36ec-666c-4458-818b-b75410e1517d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:38.305172 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a18b36ec-666c-4458-818b-b75410e1517d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:38.305895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a18b36ec-666c-4458-818b-b75410e1517d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:38.306354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a18b36ec-666c-4458-818b-b75410e1517d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:38.306781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a18b36ec-666c-4458-818b-b75410e1517d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:38.393395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fcd448ab-1f57-4455-b38e-78c1f44a9dfa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:38.394119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fcd448ab-1f57-4455-b38e-78c1f44a9dfa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:38.401174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcd448ab-1f57-4455-b38e-78c1f44a9dfa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:38.401174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcd448ab-1f57-4455-b38e-78c1f44a9dfa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:38.401174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcd448ab-1f57-4455-b38e-78c1f44a9dfa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:38.401951 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcd448ab-1f57-4455-b38e-78c1f44a9dfa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:38.402481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcd448ab-1f57-4455-b38e-78c1f44a9dfa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:38.403418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcd448ab-1f57-4455-b38e-78c1f44a9dfa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:38.440396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a18b36ec-666c-4458-818b-b75410e1517d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:38.448159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a18b36ec-666c-4458-818b-b75410e1517d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.155550 Oct 28 20:10:38.463547 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 392/795] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:38 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:10:38.551831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fcd448ab-1f57-4455-b38e-78c1f44a9dfa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:38.560696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fcd448ab-1f57-4455-b38e-78c1f44a9dfa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:38.562238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fcd448ab-1f57-4455-b38e-78c1f44a9dfa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:38.563468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fcd448ab-1f57-4455-b38e-78c1f44a9dfa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.173939 Oct 28 20:10:38.564123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 404/796] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:38 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:39.135550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9713e66b-3081-45d1-bd69-8aa8a584d475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:39.138805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9713e66b-3081-45d1-bd69-8aa8a584d475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:39.144605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9713e66b-3081-45d1-bd69-8aa8a584d475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:39.145084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9713e66b-3081-45d1-bd69-8aa8a584d475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:39.145632 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9713e66b-3081-45d1-bd69-8aa8a584d475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:39.146264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9713e66b-3081-45d1-bd69-8aa8a584d475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:39.146713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9713e66b-3081-45d1-bd69-8aa8a584d475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:39.147136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9713e66b-3081-45d1-bd69-8aa8a584d475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:39.177502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9713e66b-3081-45d1-bd69-8aa8a584d475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045829 Oct 28 20:10:39.178059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 393/797] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:39 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:39.472245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ebbd0fd5-052c-4b41-b959-4dac954ee62a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:39.472855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ebbd0fd5-052c-4b41-b959-4dac954ee62a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:39.475598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:10:39.475740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:10:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 (ip 10.222.0.66) !!! Oct 28 20:10:39.488476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebbd0fd5-052c-4b41-b959-4dac954ee62a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:39.488968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebbd0fd5-052c-4b41-b959-4dac954ee62a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:39.489436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebbd0fd5-052c-4b41-b959-4dac954ee62a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:39.490192 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebbd0fd5-052c-4b41-b959-4dac954ee62a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:39.490656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebbd0fd5-052c-4b41-b959-4dac954ee62a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:39.491084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebbd0fd5-052c-4b41-b959-4dac954ee62a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:39.589285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5b403cf2-7c1b-45b7-a11e-a0c392922f82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:39.589924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5b403cf2-7c1b-45b7-a11e-a0c392922f82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:39.596788 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b403cf2-7c1b-45b7-a11e-a0c392922f82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:39.597273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b403cf2-7c1b-45b7-a11e-a0c392922f82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:39.597755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b403cf2-7c1b-45b7-a11e-a0c392922f82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:39.598476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b403cf2-7c1b-45b7-a11e-a0c392922f82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:39.598935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b403cf2-7c1b-45b7-a11e-a0c392922f82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:39.599362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b403cf2-7c1b-45b7-a11e-a0c392922f82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:39.623553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ebbd0fd5-052c-4b41-b959-4dac954ee62a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:39.631097 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ebbd0fd5-052c-4b41-b959-4dac954ee62a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.162729 Oct 28 20:10:39.631671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 405/798] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:39 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:39.730710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5b403cf2-7c1b-45b7-a11e-a0c392922f82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:39.740156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5b403cf2-7c1b-45b7-a11e-a0c392922f82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:39.741624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5b403cf2-7c1b-45b7-a11e-a0c392922f82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:39.742769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5b403cf2-7c1b-45b7-a11e-a0c392922f82 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.157603 Oct 28 20:10:39.743318 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 394/799] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:39 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:40.189931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5fa90570-bedf-4425-bb8d-c141fc647c6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:40.192201 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5fa90570-bedf-4425-bb8d-c141fc647c6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:40.198172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fa90570-bedf-4425-bb8d-c141fc647c6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:40.198652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fa90570-bedf-4425-bb8d-c141fc647c6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:40.199092 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fa90570-bedf-4425-bb8d-c141fc647c6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:40.199780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fa90570-bedf-4425-bb8d-c141fc647c6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:40.200233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fa90570-bedf-4425-bb8d-c141fc647c6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:40.200658 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fa90570-bedf-4425-bb8d-c141fc647c6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:40.230044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5fa90570-bedf-4425-bb8d-c141fc647c6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044004 Oct 28 20:10:40.230592 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 406/800] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:40 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:40.654958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a3256809-6b7e-40d0-a294-f05c87b628c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:40.655577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a3256809-6b7e-40d0-a294-f05c87b628c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:40.661989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3256809-6b7e-40d0-a294-f05c87b628c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:40.662472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3256809-6b7e-40d0-a294-f05c87b628c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:40.662912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3256809-6b7e-40d0-a294-f05c87b628c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:40.663628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3256809-6b7e-40d0-a294-f05c87b628c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:40.664081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3256809-6b7e-40d0-a294-f05c87b628c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:40.664504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3256809-6b7e-40d0-a294-f05c87b628c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:40.799521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a3256809-6b7e-40d0-a294-f05c87b628c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:40.807379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a3256809-6b7e-40d0-a294-f05c87b628c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.157026 Oct 28 20:10:40.808423 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 395/801] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:40 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:40.880092 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3a209428-ff50-415f-8346-879fbf3c6dfc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:40.880705 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3a209428-ff50-415f-8346-879fbf3c6dfc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:40.886573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a209428-ff50-415f-8346-879fbf3c6dfc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:40.887049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a209428-ff50-415f-8346-879fbf3c6dfc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:40.887484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a209428-ff50-415f-8346-879fbf3c6dfc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:40.888830 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a209428-ff50-415f-8346-879fbf3c6dfc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:40.889401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a209428-ff50-415f-8346-879fbf3c6dfc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:40.889831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a209428-ff50-415f-8346-879fbf3c6dfc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:41.014480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3a209428-ff50-415f-8346-879fbf3c6dfc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:41.017822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:41.023263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3a209428-ff50-415f-8346-879fbf3c6dfc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:41.024698 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3a209428-ff50-415f-8346-879fbf3c6dfc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:41.032506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3a209428-ff50-415f-8346-879fbf3c6dfc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.259688 Oct 28 20:10:41.032506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 407/802] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:40 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:41.243712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d6eb6604-c666-4eb6-b99e-d1e7483d610d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:41.245885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d6eb6604-c666-4eb6-b99e-d1e7483d610d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:41.252579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6eb6604-c666-4eb6-b99e-d1e7483d610d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:41.253057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6eb6604-c666-4eb6-b99e-d1e7483d610d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:41.253528 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6eb6604-c666-4eb6-b99e-d1e7483d610d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:41.254204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6eb6604-c666-4eb6-b99e-d1e7483d610d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:41.254649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6eb6604-c666-4eb6-b99e-d1e7483d610d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:41.255062 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6eb6604-c666-4eb6-b99e-d1e7483d610d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:41.284755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d6eb6604-c666-4eb6-b99e-d1e7483d610d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044957 Oct 28 20:10:41.285298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 396/803] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:41 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:41.838541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40b182ad-ae5b-4421-a5fd-dd1365f1c66b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:41.839156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40b182ad-ae5b-4421-a5fd-dd1365f1c66b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:41.846347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40b182ad-ae5b-4421-a5fd-dd1365f1c66b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:41.846826 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40b182ad-ae5b-4421-a5fd-dd1365f1c66b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:41.847260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40b182ad-ae5b-4421-a5fd-dd1365f1c66b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:41.847953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40b182ad-ae5b-4421-a5fd-dd1365f1c66b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:41.848404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40b182ad-ae5b-4421-a5fd-dd1365f1c66b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:41.848824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40b182ad-ae5b-4421-a5fd-dd1365f1c66b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:41.979880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-40b182ad-ae5b-4421-a5fd-dd1365f1c66b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:41.988031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40b182ad-ae5b-4421-a5fd-dd1365f1c66b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.153636 Oct 28 20:10:41.988584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 408/804] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:41 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:10:42.054346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7a0b1408-74aa-40d4-81ae-a256dea6859f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:42.054959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7a0b1408-74aa-40d4-81ae-a256dea6859f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:42.062052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a0b1408-74aa-40d4-81ae-a256dea6859f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:42.062536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a0b1408-74aa-40d4-81ae-a256dea6859f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:42.062976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a0b1408-74aa-40d4-81ae-a256dea6859f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:42.063662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a0b1408-74aa-40d4-81ae-a256dea6859f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:42.064117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a0b1408-74aa-40d4-81ae-a256dea6859f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:42.064542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a0b1408-74aa-40d4-81ae-a256dea6859f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:42.193972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7a0b1408-74aa-40d4-81ae-a256dea6859f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:42.202805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7a0b1408-74aa-40d4-81ae-a256dea6859f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:42.204251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7a0b1408-74aa-40d4-81ae-a256dea6859f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:42.205442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7a0b1408-74aa-40d4-81ae-a256dea6859f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.155018 Oct 28 20:10:42.206000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 397/805] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:42 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:42.298012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f612a85f-f5bd-405b-86bd-817500123626 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:42.300278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f612a85f-f5bd-405b-86bd-817500123626 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:42.306244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f612a85f-f5bd-405b-86bd-817500123626 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:42.306720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f612a85f-f5bd-405b-86bd-817500123626 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:42.307153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f612a85f-f5bd-405b-86bd-817500123626 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:42.307831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f612a85f-f5bd-405b-86bd-817500123626 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:42.308278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f612a85f-f5bd-405b-86bd-817500123626 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:42.308701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f612a85f-f5bd-405b-86bd-817500123626 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:42.340226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f612a85f-f5bd-405b-86bd-817500123626 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046875 Oct 28 20:10:42.340785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 409/806] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:42 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:10:43.010774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c988f74f-3a42-4e3c-ba8e-6b66ed4aafa6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:43.011715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c988f74f-3a42-4e3c-ba8e-6b66ed4aafa6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:43.019230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c988f74f-3a42-4e3c-ba8e-6b66ed4aafa6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:43.019710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c988f74f-3a42-4e3c-ba8e-6b66ed4aafa6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:43.020142 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c988f74f-3a42-4e3c-ba8e-6b66ed4aafa6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:43.020912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c988f74f-3a42-4e3c-ba8e-6b66ed4aafa6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:43.021272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c988f74f-3a42-4e3c-ba8e-6b66ed4aafa6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:43.021740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c988f74f-3a42-4e3c-ba8e-6b66ed4aafa6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:43.159370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c988f74f-3a42-4e3c-ba8e-6b66ed4aafa6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:43.166967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c988f74f-3a42-4e3c-ba8e-6b66ed4aafa6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.159948 Oct 28 20:10:43.167527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 398/807] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:43 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:43.231247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1223531c-4ed4-4d9f-8acf-8c3eed1b37a3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:43.232944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1223531c-4ed4-4d9f-8acf-8c3eed1b37a3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:43.238912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1223531c-4ed4-4d9f-8acf-8c3eed1b37a3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:43.239392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1223531c-4ed4-4d9f-8acf-8c3eed1b37a3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:43.239818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1223531c-4ed4-4d9f-8acf-8c3eed1b37a3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:43.240498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1223531c-4ed4-4d9f-8acf-8c3eed1b37a3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:43.240990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1223531c-4ed4-4d9f-8acf-8c3eed1b37a3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:43.241379 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1223531c-4ed4-4d9f-8acf-8c3eed1b37a3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:43.353793 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f358358c-5089-4dac-83e9-7da80d208bb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:43.356005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f358358c-5089-4dac-83e9-7da80d208bb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:43.362835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f358358c-5089-4dac-83e9-7da80d208bb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:43.363328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f358358c-5089-4dac-83e9-7da80d208bb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:43.363768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f358358c-5089-4dac-83e9-7da80d208bb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:43.364482 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f358358c-5089-4dac-83e9-7da80d208bb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:43.364941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f358358c-5089-4dac-83e9-7da80d208bb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:43.365388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f358358c-5089-4dac-83e9-7da80d208bb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:43.398728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f358358c-5089-4dac-83e9-7da80d208bb4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049108 Oct 28 20:10:43.399348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 399/808] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:43 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:10:43.598717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1223531c-4ed4-4d9f-8acf-8c3eed1b37a3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:43.607131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1223531c-4ed4-4d9f-8acf-8c3eed1b37a3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:43.608550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1223531c-4ed4-4d9f-8acf-8c3eed1b37a3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:43.609724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1223531c-4ed4-4d9f-8acf-8c3eed1b37a3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.382373 Oct 28 20:10:43.610271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 410/809] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:43 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:44.191526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-64ff3fda-3cf7-4c79-9353-41c493ee364d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:44.192137 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-64ff3fda-3cf7-4c79-9353-41c493ee364d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:44.198630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ff3fda-3cf7-4c79-9353-41c493ee364d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:44.199109 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ff3fda-3cf7-4c79-9353-41c493ee364d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:44.199536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ff3fda-3cf7-4c79-9353-41c493ee364d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:44.200215 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ff3fda-3cf7-4c79-9353-41c493ee364d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:44.200755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ff3fda-3cf7-4c79-9353-41c493ee364d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:44.201177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ff3fda-3cf7-4c79-9353-41c493ee364d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:44.332547 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-64ff3fda-3cf7-4c79-9353-41c493ee364d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:44.340328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-64ff3fda-3cf7-4c79-9353-41c493ee364d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.152705 Oct 28 20:10:44.340881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 400/810] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:44 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:44.411906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f99f521d-5b99-49b6-8f70-ca3c2c1b58ba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:44.414071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f99f521d-5b99-49b6-8f70-ca3c2c1b58ba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:44.420951 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f99f521d-5b99-49b6-8f70-ca3c2c1b58ba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:44.421443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f99f521d-5b99-49b6-8f70-ca3c2c1b58ba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:44.421872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f99f521d-5b99-49b6-8f70-ca3c2c1b58ba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:44.422547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f99f521d-5b99-49b6-8f70-ca3c2c1b58ba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:44.422991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f99f521d-5b99-49b6-8f70-ca3c2c1b58ba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:44.423406 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f99f521d-5b99-49b6-8f70-ca3c2c1b58ba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:44.451474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f99f521d-5b99-49b6-8f70-ca3c2c1b58ba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043436 Oct 28 20:10:44.452015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 411/811] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:44 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:44.635239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-33be99cf-77e7-4b19-aa82-789a3ce73b54 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:44.635765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-33be99cf-77e7-4b19-aa82-789a3ce73b54 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:44.641761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33be99cf-77e7-4b19-aa82-789a3ce73b54 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:44.642241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33be99cf-77e7-4b19-aa82-789a3ce73b54 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:44.642677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33be99cf-77e7-4b19-aa82-789a3ce73b54 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:44.643359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33be99cf-77e7-4b19-aa82-789a3ce73b54 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:44.643811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33be99cf-77e7-4b19-aa82-789a3ce73b54 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:44.644230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33be99cf-77e7-4b19-aa82-789a3ce73b54 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:44.771322 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-33be99cf-77e7-4b19-aa82-789a3ce73b54 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:44.783036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-33be99cf-77e7-4b19-aa82-789a3ce73b54 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:44.784478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-33be99cf-77e7-4b19-aa82-789a3ce73b54 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:44.785671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-33be99cf-77e7-4b19-aa82-789a3ce73b54 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.154397 Oct 28 20:10:44.786218 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 401/812] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:44 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:45.363357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ea34e3ae-7312-4e9a-95aa-21ca7aa0e803 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:45.363965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ea34e3ae-7312-4e9a-95aa-21ca7aa0e803 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:45.369918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea34e3ae-7312-4e9a-95aa-21ca7aa0e803 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:45.370391 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea34e3ae-7312-4e9a-95aa-21ca7aa0e803 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:45.370820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea34e3ae-7312-4e9a-95aa-21ca7aa0e803 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:45.371500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea34e3ae-7312-4e9a-95aa-21ca7aa0e803 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:45.371945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea34e3ae-7312-4e9a-95aa-21ca7aa0e803 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:45.372362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea34e3ae-7312-4e9a-95aa-21ca7aa0e803 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:45.463976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-14dc63c1-185c-46f2-81e8-3903704475f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:45.466334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-14dc63c1-185c-46f2-81e8-3903704475f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:45.473577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14dc63c1-185c-46f2-81e8-3903704475f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:45.484554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14dc63c1-185c-46f2-81e8-3903704475f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:45.484554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14dc63c1-185c-46f2-81e8-3903704475f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:45.484554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14dc63c1-185c-46f2-81e8-3903704475f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:45.484554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14dc63c1-185c-46f2-81e8-3903704475f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:45.484918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14dc63c1-185c-46f2-81e8-3903704475f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:45.502965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ea34e3ae-7312-4e9a-95aa-21ca7aa0e803 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:45.506741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-14dc63c1-185c-46f2-81e8-3903704475f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047023 Oct 28 20:10:45.508864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 402/813] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:45 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:10:45.510929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ea34e3ae-7312-4e9a-95aa-21ca7aa0e803 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.151392 Oct 28 20:10:45.511654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 412/814] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:45 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:45.811293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9d11e17d-ddae-4058-9dc8-9369fdf2e335 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:45.811943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9d11e17d-ddae-4058-9dc8-9369fdf2e335 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:45.817813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d11e17d-ddae-4058-9dc8-9369fdf2e335 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:45.818299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d11e17d-ddae-4058-9dc8-9369fdf2e335 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:45.818723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d11e17d-ddae-4058-9dc8-9369fdf2e335 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:45.819399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d11e17d-ddae-4058-9dc8-9369fdf2e335 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:45.819847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d11e17d-ddae-4058-9dc8-9369fdf2e335 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:45.820267 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d11e17d-ddae-4058-9dc8-9369fdf2e335 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:45.947594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9d11e17d-ddae-4058-9dc8-9369fdf2e335 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:45.958086 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9d11e17d-ddae-4058-9dc8-9369fdf2e335 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:45.959521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9d11e17d-ddae-4058-9dc8-9369fdf2e335 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:45.960952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9d11e17d-ddae-4058-9dc8-9369fdf2e335 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.153723 Oct 28 20:10:45.961525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 403/815] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:45 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:46.519628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85a71fba-95f8-4652-975e-47391907dbec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:46.521771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-85a71fba-95f8-4652-975e-47391907dbec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:46.523745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:10:46.523893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:10:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments (ip 10.222.0.66) !!! Oct 28 20:10:46.525477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=74 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:46.530894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85a71fba-95f8-4652-975e-47391907dbec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:46.531402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85a71fba-95f8-4652-975e-47391907dbec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:46.531840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85a71fba-95f8-4652-975e-47391907dbec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:46.532512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85a71fba-95f8-4652-975e-47391907dbec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:46.532959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85a71fba-95f8-4652-975e-47391907dbec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:46.533397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85a71fba-95f8-4652-975e-47391907dbec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:46.533876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c3d5c44e-eaec-480e-80f1-e7090bde2fcc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:46.534498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c3d5c44e-eaec-480e-80f1-e7090bde2fcc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:46.541226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3d5c44e-eaec-480e-80f1-e7090bde2fcc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:46.541754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3d5c44e-eaec-480e-80f1-e7090bde2fcc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:46.542197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3d5c44e-eaec-480e-80f1-e7090bde2fcc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:46.542893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3d5c44e-eaec-480e-80f1-e7090bde2fcc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:46.543353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3d5c44e-eaec-480e-80f1-e7090bde2fcc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:46.543783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3d5c44e-eaec-480e-80f1-e7090bde2fcc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:46.566675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-85a71fba-95f8-4652-975e-47391907dbec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051172 Oct 28 20:10:46.567236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 413/816] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:46 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:46.674494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c3d5c44e-eaec-480e-80f1-e7090bde2fcc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:46.682094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c3d5c44e-eaec-480e-80f1-e7090bde2fcc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.152123 Oct 28 20:10:46.682681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 404/817] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:46 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:46.987113 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-10b32df5-81e2-4fc5-872e-5de19fb4aba6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:46.987746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-10b32df5-81e2-4fc5-872e-5de19fb4aba6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:46.993849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10b32df5-81e2-4fc5-872e-5de19fb4aba6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:46.994329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10b32df5-81e2-4fc5-872e-5de19fb4aba6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:46.994762 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10b32df5-81e2-4fc5-872e-5de19fb4aba6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:46.995444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10b32df5-81e2-4fc5-872e-5de19fb4aba6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:46.995894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10b32df5-81e2-4fc5-872e-5de19fb4aba6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:46.996318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10b32df5-81e2-4fc5-872e-5de19fb4aba6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:47.284356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-10b32df5-81e2-4fc5-872e-5de19fb4aba6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:47.292759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-10b32df5-81e2-4fc5-872e-5de19fb4aba6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:47.294288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-10b32df5-81e2-4fc5-872e-5de19fb4aba6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:47.295505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-10b32df5-81e2-4fc5-872e-5de19fb4aba6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.312518 Oct 28 20:10:47.296725 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 414/818] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:46 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:47.579392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dbf5a05a-533d-4e37-82ce-fa222b22585f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:47.581623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dbf5a05a-533d-4e37-82ce-fa222b22585f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:47.588268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbf5a05a-533d-4e37-82ce-fa222b22585f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:47.588750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbf5a05a-533d-4e37-82ce-fa222b22585f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:47.589184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbf5a05a-533d-4e37-82ce-fa222b22585f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:47.589909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbf5a05a-533d-4e37-82ce-fa222b22585f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:47.590369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbf5a05a-533d-4e37-82ce-fa222b22585f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:47.590795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbf5a05a-533d-4e37-82ce-fa222b22585f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:47.620794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dbf5a05a-533d-4e37-82ce-fa222b22585f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Oct 28 20:10:47.621364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 405/819] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:47 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:47.704462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-65443015-271d-4a8e-bde5-723ae042d9bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:47.705069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-65443015-271d-4a8e-bde5-723ae042d9bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:47.711632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65443015-271d-4a8e-bde5-723ae042d9bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:47.712106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65443015-271d-4a8e-bde5-723ae042d9bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:47.712537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65443015-271d-4a8e-bde5-723ae042d9bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:47.713215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65443015-271d-4a8e-bde5-723ae042d9bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:47.713692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65443015-271d-4a8e-bde5-723ae042d9bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:47.714112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65443015-271d-4a8e-bde5-723ae042d9bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:47.842040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-65443015-271d-4a8e-bde5-723ae042d9bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:47.850762 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-65443015-271d-4a8e-bde5-723ae042d9bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.150644 Oct 28 20:10:47.851322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 415/820] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:47 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:48.322869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d4f3556f-7a58-429f-a773-6bde9b378526 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:48.323470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d4f3556f-7a58-429f-a773-6bde9b378526 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:48.330195 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4f3556f-7a58-429f-a773-6bde9b378526 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:48.330671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4f3556f-7a58-429f-a773-6bde9b378526 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:48.331106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4f3556f-7a58-429f-a773-6bde9b378526 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:48.331788 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4f3556f-7a58-429f-a773-6bde9b378526 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:48.332226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4f3556f-7a58-429f-a773-6bde9b378526 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:48.332651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4f3556f-7a58-429f-a773-6bde9b378526 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:48.457913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d4f3556f-7a58-429f-a773-6bde9b378526 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:48.468339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d4f3556f-7a58-429f-a773-6bde9b378526 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:48.468339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d4f3556f-7a58-429f-a773-6bde9b378526 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:48.469160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d4f3556f-7a58-429f-a773-6bde9b378526 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.150137 Oct 28 20:10:48.469751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 406/821] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:48 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:48.632894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-45b790db-3a9f-4a89-b4ee-9f12d6f57a5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:48.635065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-45b790db-3a9f-4a89-b4ee-9f12d6f57a5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:48.641500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45b790db-3a9f-4a89-b4ee-9f12d6f57a5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:48.641986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45b790db-3a9f-4a89-b4ee-9f12d6f57a5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:48.642424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45b790db-3a9f-4a89-b4ee-9f12d6f57a5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:48.643107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45b790db-3a9f-4a89-b4ee-9f12d6f57a5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:48.643558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45b790db-3a9f-4a89-b4ee-9f12d6f57a5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:48.643979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45b790db-3a9f-4a89-b4ee-9f12d6f57a5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:48.674392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-45b790db-3a9f-4a89-b4ee-9f12d6f57a5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045680 Oct 28 20:10:48.674860 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 416/822] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:48 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:48.873358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9240b6a-30d5-4ad6-8afd-d9ac62cbc848 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:48.873993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f9240b6a-30d5-4ad6-8afd-d9ac62cbc848 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:48.876411 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=80 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:48.880992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9240b6a-30d5-4ad6-8afd-d9ac62cbc848 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:48.881506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9240b6a-30d5-4ad6-8afd-d9ac62cbc848 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:48.881950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9240b6a-30d5-4ad6-8afd-d9ac62cbc848 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:48.882627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9240b6a-30d5-4ad6-8afd-d9ac62cbc848 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:48.883077 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9240b6a-30d5-4ad6-8afd-d9ac62cbc848 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:48.883514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9240b6a-30d5-4ad6-8afd-d9ac62cbc848 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:49.017027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f9240b6a-30d5-4ad6-8afd-d9ac62cbc848 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:49.025190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f9240b6a-30d5-4ad6-8afd-d9ac62cbc848 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.155244 Oct 28 20:10:49.025791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 407/823] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:48 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:49.494705 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-caec4980-c3aa-44bc-84ae-eac93c6f61f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:49.495246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-caec4980-c3aa-44bc-84ae-eac93c6f61f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:49.502229 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caec4980-c3aa-44bc-84ae-eac93c6f61f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:49.502718 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caec4980-c3aa-44bc-84ae-eac93c6f61f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:49.503154 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caec4980-c3aa-44bc-84ae-eac93c6f61f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:49.503845 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caec4980-c3aa-44bc-84ae-eac93c6f61f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:49.504301 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caec4980-c3aa-44bc-84ae-eac93c6f61f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:49.504726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caec4980-c3aa-44bc-84ae-eac93c6f61f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:49.630405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-caec4980-c3aa-44bc-84ae-eac93c6f61f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:49.638782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-caec4980-c3aa-44bc-84ae-eac93c6f61f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:49.640902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-caec4980-c3aa-44bc-84ae-eac93c6f61f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:49.642086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-caec4980-c3aa-44bc-84ae-eac93c6f61f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.151376 Oct 28 20:10:49.642633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 417/824] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:49 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:49.687519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1e0dbcb9-198f-4e35-854f-18670f3fbbf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:49.689691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1e0dbcb9-198f-4e35-854f-18670f3fbbf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:49.695624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e0dbcb9-198f-4e35-854f-18670f3fbbf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:49.696105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e0dbcb9-198f-4e35-854f-18670f3fbbf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:49.696543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e0dbcb9-198f-4e35-854f-18670f3fbbf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:49.697224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e0dbcb9-198f-4e35-854f-18670f3fbbf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:49.697703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e0dbcb9-198f-4e35-854f-18670f3fbbf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:49.698130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e0dbcb9-198f-4e35-854f-18670f3fbbf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:49.700479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:49.728194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1e0dbcb9-198f-4e35-854f-18670f3fbbf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045247 Oct 28 20:10:49.728774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 408/825] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:49 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:50.048914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0d335280-e44f-4afb-a8b2-ddf52fce9337 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:50.049577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0d335280-e44f-4afb-a8b2-ddf52fce9337 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:50.055435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d335280-e44f-4afb-a8b2-ddf52fce9337 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:50.055918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d335280-e44f-4afb-a8b2-ddf52fce9337 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:50.056358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d335280-e44f-4afb-a8b2-ddf52fce9337 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:50.057047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d335280-e44f-4afb-a8b2-ddf52fce9337 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:50.057533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d335280-e44f-4afb-a8b2-ddf52fce9337 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:50.057960 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d335280-e44f-4afb-a8b2-ddf52fce9337 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:50.190653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0d335280-e44f-4afb-a8b2-ddf52fce9337 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:50.198169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0d335280-e44f-4afb-a8b2-ddf52fce9337 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.153654 Oct 28 20:10:50.198722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 418/826] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:50 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:50.667359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7d2c600f-193f-4782-8e25-1cd477268626 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:50.667895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7d2c600f-193f-4782-8e25-1cd477268626 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:50.675715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d2c600f-193f-4782-8e25-1cd477268626 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:50.676204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d2c600f-193f-4782-8e25-1cd477268626 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:50.676652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d2c600f-193f-4782-8e25-1cd477268626 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:50.677368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d2c600f-193f-4782-8e25-1cd477268626 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:50.677830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d2c600f-193f-4782-8e25-1cd477268626 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:50.678253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d2c600f-193f-4782-8e25-1cd477268626 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:50.740176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-625e652e-d363-4c00-9c26-600501a9b622 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:50.742395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-625e652e-d363-4c00-9c26-600501a9b622 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:50.748841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625e652e-d363-4c00-9c26-600501a9b622 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:50.749460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625e652e-d363-4c00-9c26-600501a9b622 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:50.749900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625e652e-d363-4c00-9c26-600501a9b622 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:50.750591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625e652e-d363-4c00-9c26-600501a9b622 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:50.751040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625e652e-d363-4c00-9c26-600501a9b622 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:50.751459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625e652e-d363-4c00-9c26-600501a9b622 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:50.788533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-625e652e-d363-4c00-9c26-600501a9b622 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052293 Oct 28 20:10:50.789089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 419/827] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:50 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:10:50.806985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7d2c600f-193f-4782-8e25-1cd477268626 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:50.815673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7d2c600f-193f-4782-8e25-1cd477268626 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:50.817123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7d2c600f-193f-4782-8e25-1cd477268626 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:50.818302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7d2c600f-193f-4782-8e25-1cd477268626 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.154932 Oct 28 20:10:50.818888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 409/828] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:50 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:51.221076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ac5809d6-97d9-4951-b25a-b07b5c7bae90 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:51.221729 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ac5809d6-97d9-4951-b25a-b07b5c7bae90 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:51.227609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac5809d6-97d9-4951-b25a-b07b5c7bae90 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:51.228095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac5809d6-97d9-4951-b25a-b07b5c7bae90 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:51.228536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac5809d6-97d9-4951-b25a-b07b5c7bae90 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:51.229225 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac5809d6-97d9-4951-b25a-b07b5c7bae90 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:51.229708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac5809d6-97d9-4951-b25a-b07b5c7bae90 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:51.230131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac5809d6-97d9-4951-b25a-b07b5c7bae90 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:51.364262 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac5809d6-97d9-4951-b25a-b07b5c7bae90 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:51.372156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ac5809d6-97d9-4951-b25a-b07b5c7bae90 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.155163 Oct 28 20:10:51.372707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 420/829] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:51 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:51.801677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-87c89fe4-c1f2-4164-942f-9386e84631e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:51.803846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-87c89fe4-c1f2-4164-942f-9386e84631e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:51.810216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87c89fe4-c1f2-4164-942f-9386e84631e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:51.810697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87c89fe4-c1f2-4164-942f-9386e84631e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:51.811132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87c89fe4-c1f2-4164-942f-9386e84631e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:51.812624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87c89fe4-c1f2-4164-942f-9386e84631e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:51.813069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87c89fe4-c1f2-4164-942f-9386e84631e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:51.813532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87c89fe4-c1f2-4164-942f-9386e84631e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:51.845193 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-87c89fe4-c1f2-4164-942f-9386e84631e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047394 Oct 28 20:10:51.845552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ccac1e9b-eee7-40d9-8c21-2eb42aa54c4a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:51.845997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 410/830] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:51 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:51.846485 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ccac1e9b-eee7-40d9-8c21-2eb42aa54c4a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:51.852991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccac1e9b-eee7-40d9-8c21-2eb42aa54c4a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:51.853512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccac1e9b-eee7-40d9-8c21-2eb42aa54c4a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:51.853953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccac1e9b-eee7-40d9-8c21-2eb42aa54c4a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:51.854646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccac1e9b-eee7-40d9-8c21-2eb42aa54c4a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:51.855102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccac1e9b-eee7-40d9-8c21-2eb42aa54c4a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:51.855530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccac1e9b-eee7-40d9-8c21-2eb42aa54c4a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:51.981557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ccac1e9b-eee7-40d9-8c21-2eb42aa54c4a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:51.990250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ccac1e9b-eee7-40d9-8c21-2eb42aa54c4a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:51.991687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ccac1e9b-eee7-40d9-8c21-2eb42aa54c4a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:51.992848 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ccac1e9b-eee7-40d9-8c21-2eb42aa54c4a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.151899 Oct 28 20:10:51.993416 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 421/831] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:51 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:52.395161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-913286e6-5dd1-4d4b-a323-91afca3886c8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:52.395769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-913286e6-5dd1-4d4b-a323-91afca3886c8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:52.401690 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-913286e6-5dd1-4d4b-a323-91afca3886c8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:52.402196 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-913286e6-5dd1-4d4b-a323-91afca3886c8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:52.402615 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-913286e6-5dd1-4d4b-a323-91afca3886c8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:52.403306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-913286e6-5dd1-4d4b-a323-91afca3886c8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:52.403756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-913286e6-5dd1-4d4b-a323-91afca3886c8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:52.404178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-913286e6-5dd1-4d4b-a323-91afca3886c8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:52.537810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-913286e6-5dd1-4d4b-a323-91afca3886c8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:52.546129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-913286e6-5dd1-4d4b-a323-91afca3886c8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.154237 Oct 28 20:10:52.546869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 411/832] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:52 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:52.857605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c87843b6-2b96-47f1-952e-2aaac2ceb800 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:52.860459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c87843b6-2b96-47f1-952e-2aaac2ceb800 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:52.866858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c87843b6-2b96-47f1-952e-2aaac2ceb800 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:52.867339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c87843b6-2b96-47f1-952e-2aaac2ceb800 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:52.867773 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c87843b6-2b96-47f1-952e-2aaac2ceb800 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:52.868460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c87843b6-2b96-47f1-952e-2aaac2ceb800 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:52.868916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c87843b6-2b96-47f1-952e-2aaac2ceb800 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:52.869353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c87843b6-2b96-47f1-952e-2aaac2ceb800 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:52.897721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c87843b6-2b96-47f1-952e-2aaac2ceb800 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044092 Oct 28 20:10:52.898269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 422/833] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:52 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:53.018876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5f8d0834-aa16-4d3f-86df-4db258006399 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:53.019421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5f8d0834-aa16-4d3f-86df-4db258006399 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:53.026027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f8d0834-aa16-4d3f-86df-4db258006399 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:53.026514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f8d0834-aa16-4d3f-86df-4db258006399 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:53.027124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f8d0834-aa16-4d3f-86df-4db258006399 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:53.027823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f8d0834-aa16-4d3f-86df-4db258006399 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:53.028287 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f8d0834-aa16-4d3f-86df-4db258006399 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:53.028715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f8d0834-aa16-4d3f-86df-4db258006399 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:53.160931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f8d0834-aa16-4d3f-86df-4db258006399 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:53.169515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f8d0834-aa16-4d3f-86df-4db258006399 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:53.171034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f8d0834-aa16-4d3f-86df-4db258006399 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:53.172191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5f8d0834-aa16-4d3f-86df-4db258006399 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.157808 Oct 28 20:10:53.172746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 412/834] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:53 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:53.568240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d2954ac7-0fdd-4de3-a439-2e286c10c520 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:53.568840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d2954ac7-0fdd-4de3-a439-2e286c10c520 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:53.574541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2954ac7-0fdd-4de3-a439-2e286c10c520 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:53.575227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2954ac7-0fdd-4de3-a439-2e286c10c520 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:53.575438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2954ac7-0fdd-4de3-a439-2e286c10c520 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:53.576114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2954ac7-0fdd-4de3-a439-2e286c10c520 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:53.576557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2954ac7-0fdd-4de3-a439-2e286c10c520 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:53.577589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2954ac7-0fdd-4de3-a439-2e286c10c520 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:53.718070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d2954ac7-0fdd-4de3-a439-2e286c10c520 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:53.725645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d2954ac7-0fdd-4de3-a439-2e286c10c520 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.161045 Oct 28 20:10:53.726266 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 423/835] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:53 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:53.909599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d1eb4ea5-760b-452c-b837-e02fcb1034c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:53.912003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d1eb4ea5-760b-452c-b837-e02fcb1034c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:53.918133 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1eb4ea5-760b-452c-b837-e02fcb1034c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:53.918609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1eb4ea5-760b-452c-b837-e02fcb1034c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:53.919036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1eb4ea5-760b-452c-b837-e02fcb1034c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:53.919711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1eb4ea5-760b-452c-b837-e02fcb1034c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:53.920157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1eb4ea5-760b-452c-b837-e02fcb1034c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:53.921068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1eb4ea5-760b-452c-b837-e02fcb1034c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:53.949481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d1eb4ea5-760b-452c-b837-e02fcb1034c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043759 Oct 28 20:10:53.950018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 413/836] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:53 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:54.201786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b37f0eb9-b721-4bf4-87b6-c8943869d32c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:54.202422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b37f0eb9-b721-4bf4-87b6-c8943869d32c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:54.208685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b37f0eb9-b721-4bf4-87b6-c8943869d32c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:54.209164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b37f0eb9-b721-4bf4-87b6-c8943869d32c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:54.209637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b37f0eb9-b721-4bf4-87b6-c8943869d32c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:54.210585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b37f0eb9-b721-4bf4-87b6-c8943869d32c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:54.211037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b37f0eb9-b721-4bf4-87b6-c8943869d32c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:54.211460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b37f0eb9-b721-4bf4-87b6-c8943869d32c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:54.231108 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:54.340831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b37f0eb9-b721-4bf4-87b6-c8943869d32c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:54.349926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b37f0eb9-b721-4bf4-87b6-c8943869d32c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:54.351369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b37f0eb9-b721-4bf4-87b6-c8943869d32c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:54.352522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b37f0eb9-b721-4bf4-87b6-c8943869d32c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.154700 Oct 28 20:10:54.353071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 424/837] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:54 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:54.747857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9705195b-58da-4c49-baca-57814c6b8cf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:54.748463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9705195b-58da-4c49-baca-57814c6b8cf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:54.754735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9705195b-58da-4c49-baca-57814c6b8cf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:54.755217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9705195b-58da-4c49-baca-57814c6b8cf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:54.755648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9705195b-58da-4c49-baca-57814c6b8cf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:54.756322 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9705195b-58da-4c49-baca-57814c6b8cf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:54.756769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9705195b-58da-4c49-baca-57814c6b8cf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:54.757225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9705195b-58da-4c49-baca-57814c6b8cf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:54.888150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9705195b-58da-4c49-baca-57814c6b8cf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:54.896903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9705195b-58da-4c49-baca-57814c6b8cf2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.152859 Oct 28 20:10:54.897550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 414/838] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:54 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:54.961885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-97b7b64d-07c8-4431-8e98-287e4f6be54e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:54.964017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-97b7b64d-07c8-4431-8e98-287e4f6be54e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:54.970356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97b7b64d-07c8-4431-8e98-287e4f6be54e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:54.970839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97b7b64d-07c8-4431-8e98-287e4f6be54e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:54.971277 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97b7b64d-07c8-4431-8e98-287e4f6be54e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:54.971968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97b7b64d-07c8-4431-8e98-287e4f6be54e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:54.972425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97b7b64d-07c8-4431-8e98-287e4f6be54e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:54.972853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97b7b64d-07c8-4431-8e98-287e4f6be54e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:55.002461 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-97b7b64d-07c8-4431-8e98-287e4f6be54e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044786 Oct 28 20:10:55.003004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 425/839] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:54 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:55.379016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c835e891-cdf1-4a7b-922f-69fcfdc2a235 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:55.379617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c835e891-cdf1-4a7b-922f-69fcfdc2a235 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:55.385472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c835e891-cdf1-4a7b-922f-69fcfdc2a235 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:55.385957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c835e891-cdf1-4a7b-922f-69fcfdc2a235 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:55.386405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c835e891-cdf1-4a7b-922f-69fcfdc2a235 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:55.387061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c835e891-cdf1-4a7b-922f-69fcfdc2a235 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:55.387512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c835e891-cdf1-4a7b-922f-69fcfdc2a235 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:55.387929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c835e891-cdf1-4a7b-922f-69fcfdc2a235 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:55.519055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c835e891-cdf1-4a7b-922f-69fcfdc2a235 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:55.527629 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c835e891-cdf1-4a7b-922f-69fcfdc2a235 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:55.529071 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c835e891-cdf1-4a7b-922f-69fcfdc2a235 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:55.530241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c835e891-cdf1-4a7b-922f-69fcfdc2a235 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.155146 Oct 28 20:10:55.530791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 415/840] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:55 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:55.918822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-21dd9e30-ad61-41e8-a164-f3e33d1dd80e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:55.919372 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-21dd9e30-ad61-41e8-a164-f3e33d1dd80e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:55.926610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21dd9e30-ad61-41e8-a164-f3e33d1dd80e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:55.927098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21dd9e30-ad61-41e8-a164-f3e33d1dd80e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:55.927539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21dd9e30-ad61-41e8-a164-f3e33d1dd80e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:55.928262 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21dd9e30-ad61-41e8-a164-f3e33d1dd80e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:55.928717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21dd9e30-ad61-41e8-a164-f3e33d1dd80e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:55.929139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21dd9e30-ad61-41e8-a164-f3e33d1dd80e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:56.015754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f02aeb95-fc23-4dad-9d5c-11de21b4b570 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:56.018217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f02aeb95-fc23-4dad-9d5c-11de21b4b570 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:56.024749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02aeb95-fc23-4dad-9d5c-11de21b4b570 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:56.025443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02aeb95-fc23-4dad-9d5c-11de21b4b570 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:56.025826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02aeb95-fc23-4dad-9d5c-11de21b4b570 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:56.026557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02aeb95-fc23-4dad-9d5c-11de21b4b570 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:56.027023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02aeb95-fc23-4dad-9d5c-11de21b4b570 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:56.027451 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02aeb95-fc23-4dad-9d5c-11de21b4b570 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:56.058607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f02aeb95-fc23-4dad-9d5c-11de21b4b570 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047577 Oct 28 20:10:56.059377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 416/841] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:56 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:10:56.064640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-21dd9e30-ad61-41e8-a164-f3e33d1dd80e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:56.072166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-21dd9e30-ad61-41e8-a164-f3e33d1dd80e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.157336 Oct 28 20:10:56.072709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 426/842] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:55 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:56.556217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e1d86b38-9586-4a98-b79d-726503c9e36a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:56.556946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e1d86b38-9586-4a98-b79d-726503c9e36a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:56.563075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d86b38-9586-4a98-b79d-726503c9e36a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:56.563549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d86b38-9586-4a98-b79d-726503c9e36a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:56.564015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d86b38-9586-4a98-b79d-726503c9e36a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:56.564693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d86b38-9586-4a98-b79d-726503c9e36a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:56.565138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d86b38-9586-4a98-b79d-726503c9e36a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:56.565584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d86b38-9586-4a98-b79d-726503c9e36a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:56.691828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e1d86b38-9586-4a98-b79d-726503c9e36a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:56.700283 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e1d86b38-9586-4a98-b79d-726503c9e36a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:56.702336 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e1d86b38-9586-4a98-b79d-726503c9e36a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:56.703784 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e1d86b38-9586-4a98-b79d-726503c9e36a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.151539 Oct 28 20:10:56.704337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 417/843] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:56 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:57.071130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-09c03242-0377-42ea-95c7-b321030a3475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:57.073194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-09c03242-0377-42ea-95c7-b321030a3475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:57.080092 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09c03242-0377-42ea-95c7-b321030a3475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:57.080570 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09c03242-0377-42ea-95c7-b321030a3475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:57.081004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09c03242-0377-42ea-95c7-b321030a3475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:57.081729 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09c03242-0377-42ea-95c7-b321030a3475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:57.082180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09c03242-0377-42ea-95c7-b321030a3475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:57.082597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09c03242-0377-42ea-95c7-b321030a3475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:57.094734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d53cac6e-65eb-47fe-94f4-25d5cd219d89 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:57.095340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d53cac6e-65eb-47fe-94f4-25d5cd219d89 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:57.101604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d53cac6e-65eb-47fe-94f4-25d5cd219d89 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:57.102088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d53cac6e-65eb-47fe-94f4-25d5cd219d89 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:57.102524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d53cac6e-65eb-47fe-94f4-25d5cd219d89 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:57.103210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d53cac6e-65eb-47fe-94f4-25d5cd219d89 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:57.103660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d53cac6e-65eb-47fe-94f4-25d5cd219d89 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:57.104082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d53cac6e-65eb-47fe-94f4-25d5cd219d89 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:57.113714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-09c03242-0377-42ea-95c7-b321030a3475 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046539 Oct 28 20:10:57.114304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 427/844] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:57 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:57.246297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d53cac6e-65eb-47fe-94f4-25d5cd219d89 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:57.254547 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d53cac6e-65eb-47fe-94f4-25d5cd219d89 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.164131 Oct 28 20:10:57.255104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 418/845] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:57 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:10:57.730559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-68ecd830-deb8-4877-ba2c-22ea38a0eba0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:57.731168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-68ecd830-deb8-4877-ba2c-22ea38a0eba0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:57.737608 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68ecd830-deb8-4877-ba2c-22ea38a0eba0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:57.738087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68ecd830-deb8-4877-ba2c-22ea38a0eba0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:57.738518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68ecd830-deb8-4877-ba2c-22ea38a0eba0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:57.739202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68ecd830-deb8-4877-ba2c-22ea38a0eba0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:57.739651 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68ecd830-deb8-4877-ba2c-22ea38a0eba0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:57.740070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68ecd830-deb8-4877-ba2c-22ea38a0eba0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:57.870792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-68ecd830-deb8-4877-ba2c-22ea38a0eba0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:57.879605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-68ecd830-deb8-4877-ba2c-22ea38a0eba0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:57.881051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-68ecd830-deb8-4877-ba2c-22ea38a0eba0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:57.882255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-68ecd830-deb8-4877-ba2c-22ea38a0eba0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.155735 Oct 28 20:10:57.882803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 428/846] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:57 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:10:58.125913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60421ccd-653c-4ede-a005-de9c4f2b3e7e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:58.128070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60421ccd-653c-4ede-a005-de9c4f2b3e7e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:58.134415 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60421ccd-653c-4ede-a005-de9c4f2b3e7e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:58.134893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60421ccd-653c-4ede-a005-de9c4f2b3e7e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:58.135323 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60421ccd-653c-4ede-a005-de9c4f2b3e7e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:58.136001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60421ccd-653c-4ede-a005-de9c4f2b3e7e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:58.136457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60421ccd-653c-4ede-a005-de9c4f2b3e7e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:58.136875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60421ccd-653c-4ede-a005-de9c4f2b3e7e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:58.166294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60421ccd-653c-4ede-a005-de9c4f2b3e7e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044324 Oct 28 20:10:58.166911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 419/847] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:58 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:58.277671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ea4ee74e-7f05-4d53-9226-c9bfaafbe142 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:58.278289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ea4ee74e-7f05-4d53-9226-c9bfaafbe142 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:58.284829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea4ee74e-7f05-4d53-9226-c9bfaafbe142 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:58.285257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea4ee74e-7f05-4d53-9226-c9bfaafbe142 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:58.285759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea4ee74e-7f05-4d53-9226-c9bfaafbe142 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:58.286446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea4ee74e-7f05-4d53-9226-c9bfaafbe142 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:58.286933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea4ee74e-7f05-4d53-9226-c9bfaafbe142 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:58.287357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea4ee74e-7f05-4d53-9226-c9bfaafbe142 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:58.429043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ea4ee74e-7f05-4d53-9226-c9bfaafbe142 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:58.438364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ea4ee74e-7f05-4d53-9226-c9bfaafbe142 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1275 microversion: 2.1 time: 0.164570 Oct 28 20:10:58.438932 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 429/848] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:58 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:58.919076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3039e856-2e2a-432d-a554-102a2ee8e475 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:58.919700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3039e856-2e2a-432d-a554-102a2ee8e475 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:58.929587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3039e856-2e2a-432d-a554-102a2ee8e475 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:58.930081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3039e856-2e2a-432d-a554-102a2ee8e475 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:58.930513 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3039e856-2e2a-432d-a554-102a2ee8e475 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:58.931202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3039e856-2e2a-432d-a554-102a2ee8e475 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:58.931647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3039e856-2e2a-432d-a554-102a2ee8e475 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:58.932232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3039e856-2e2a-432d-a554-102a2ee8e475 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:59.067441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3039e856-2e2a-432d-a554-102a2ee8e475 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:59.075846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3039e856-2e2a-432d-a554-102a2ee8e475 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:59.077965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3039e856-2e2a-432d-a554-102a2ee8e475 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:59.079116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3039e856-2e2a-432d-a554-102a2ee8e475 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.175351 Oct 28 20:10:59.079677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 420/849] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:10:58 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:10:59.179003 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2da53856-4335-42a5-b878-20e66d939aee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:59.181147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2da53856-4335-42a5-b878-20e66d939aee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:59.187419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2da53856-4335-42a5-b878-20e66d939aee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:59.187901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2da53856-4335-42a5-b878-20e66d939aee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:59.188337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2da53856-4335-42a5-b878-20e66d939aee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:59.189036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2da53856-4335-42a5-b878-20e66d939aee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:59.189550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2da53856-4335-42a5-b878-20e66d939aee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:59.189976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2da53856-4335-42a5-b878-20e66d939aee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:59.221047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2da53856-4335-42a5-b878-20e66d939aee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046127 Oct 28 20:10:59.221842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 430/850] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:10:59 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:59.462092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-18d9d3bc-c553-4e01-9ebc-8e1ac491e116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:59.462710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-18d9d3bc-c553-4e01-9ebc-8e1ac491e116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:59.470058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18d9d3bc-c553-4e01-9ebc-8e1ac491e116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:59.470908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18d9d3bc-c553-4e01-9ebc-8e1ac491e116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:59.471666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18d9d3bc-c553-4e01-9ebc-8e1ac491e116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:59.472729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18d9d3bc-c553-4e01-9ebc-8e1ac491e116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:59.473571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18d9d3bc-c553-4e01-9ebc-8e1ac491e116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:59.474346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18d9d3bc-c553-4e01-9ebc-8e1ac491e116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:59.608862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-18d9d3bc-c553-4e01-9ebc-8e1ac491e116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:59.616485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-18d9d3bc-c553-4e01-9ebc-8e1ac491e116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1219 microversion: 2.1 time: 0.158507 Oct 28 20:10:59.617070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 421/851] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:59 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:10:59.786808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-9bd73c1b-dc50-46c6-96cf-7f5749f6b3b5 req-20a669c4-beca-4f5a-b649-2cec05b81f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e001ad32-8419-44e8-a8dd-a05eb16202b4", "name": "network-vif-deleted", "tag": "63c31b66-9fda-4d9a-bf7c-8d8c402bc47a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:10:59.797790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9bd73c1b-dc50-46c6-96cf-7f5749f6b3b5 req-20a669c4-beca-4f5a-b649-2cec05b81f32 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:59.798273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9bd73c1b-dc50-46c6-96cf-7f5749f6b3b5 req-20a669c4-beca-4f5a-b649-2cec05b81f32 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:59.798711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9bd73c1b-dc50-46c6-96cf-7f5749f6b3b5 req-20a669c4-beca-4f5a-b649-2cec05b81f32 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:59.811969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.compute.server_external_events [req-9bd73c1b-dc50-46c6-96cf-7f5749f6b3b5 req-20a669c4-beca-4f5a-b649-2cec05b81f32 service nova] Unable to find a host for instance e001ad32-8419-44e8-a8dd-a05eb16202b4. Dropping event network-vif-deleted {{(pid=119407) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 20:10:59.813247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-9bd73c1b-dc50-46c6-96cf-7f5749f6b3b5 req-20a669c4-beca-4f5a-b649-2cec05b81f32 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.085798 Oct 28 20:10:59.813879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 431/852] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 20:11:00.104483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4588ccd2-4fe8-46a2-a399-5454a7b574b1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:00.105097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4588ccd2-4fe8-46a2-a399-5454a7b574b1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:00.112092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4588ccd2-4fe8-46a2-a399-5454a7b574b1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:00.112574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4588ccd2-4fe8-46a2-a399-5454a7b574b1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:00.113049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4588ccd2-4fe8-46a2-a399-5454a7b574b1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:00.113850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4588ccd2-4fe8-46a2-a399-5454a7b574b1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:00.114955 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4588ccd2-4fe8-46a2-a399-5454a7b574b1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:00.115393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4588ccd2-4fe8-46a2-a399-5454a7b574b1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:00.232934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-43508130-3095-4068-b025-02cffed303b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:00.235262 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-43508130-3095-4068-b025-02cffed303b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:00.241272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43508130-3095-4068-b025-02cffed303b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:00.241790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43508130-3095-4068-b025-02cffed303b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:00.242226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43508130-3095-4068-b025-02cffed303b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:00.242933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43508130-3095-4068-b025-02cffed303b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:00.243385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43508130-3095-4068-b025-02cffed303b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:00.243810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43508130-3095-4068-b025-02cffed303b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:00.266132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4588ccd2-4fe8-46a2-a399-5454a7b574b1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:00.274634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4588ccd2-4fe8-46a2-a399-5454a7b574b1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:00.274935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-43508130-3095-4068-b025-02cffed303b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046188 Oct 28 20:11:00.275494 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 432/853] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:00 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:11:00.276095 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4588ccd2-4fe8-46a2-a399-5454a7b574b1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:00.277510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4588ccd2-4fe8-46a2-a399-5454a7b574b1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.176873 Oct 28 20:11:00.278052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 422/854] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:00 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:00.638702 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-45551f8c-2b98-4cc7-aeed-cd13163a8927 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:00.639400 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-45551f8c-2b98-4cc7-aeed-cd13163a8927 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:00.646146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45551f8c-2b98-4cc7-aeed-cd13163a8927 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:00.646625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45551f8c-2b98-4cc7-aeed-cd13163a8927 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:00.647060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45551f8c-2b98-4cc7-aeed-cd13163a8927 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:00.647745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45551f8c-2b98-4cc7-aeed-cd13163a8927 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:00.648199 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45551f8c-2b98-4cc7-aeed-cd13163a8927 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:00.648638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45551f8c-2b98-4cc7-aeed-cd13163a8927 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:00.709022 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-45551f8c-2b98-4cc7-aeed-cd13163a8927 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:00.716908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-45551f8c-2b98-4cc7-aeed-cd13163a8927 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082125 Oct 28 20:11:00.717649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 433/855] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:00 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:01.288050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40e0a863-9c1d-4222-a026-2b872e8fd333 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:01.290185 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-40e0a863-9c1d-4222-a026-2b872e8fd333 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:01.296604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e0a863-9c1d-4222-a026-2b872e8fd333 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:01.297087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e0a863-9c1d-4222-a026-2b872e8fd333 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:01.297560 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e0a863-9c1d-4222-a026-2b872e8fd333 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:01.298248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e0a863-9c1d-4222-a026-2b872e8fd333 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:01.298704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e0a863-9c1d-4222-a026-2b872e8fd333 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:01.299130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e0a863-9c1d-4222-a026-2b872e8fd333 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:01.309617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4f53ad25-eac3-4784-82cd-2aacf9ce01fc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:01.310232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4f53ad25-eac3-4784-82cd-2aacf9ce01fc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:01.316953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f53ad25-eac3-4784-82cd-2aacf9ce01fc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:01.317465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f53ad25-eac3-4784-82cd-2aacf9ce01fc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:01.317909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f53ad25-eac3-4784-82cd-2aacf9ce01fc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:01.318605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f53ad25-eac3-4784-82cd-2aacf9ce01fc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:01.319236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f53ad25-eac3-4784-82cd-2aacf9ce01fc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:01.319820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f53ad25-eac3-4784-82cd-2aacf9ce01fc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:01.329500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-40e0a863-9c1d-4222-a026-2b872e8fd333 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045404 Oct 28 20:11:01.330065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 423/856] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:01 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:01.447934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f53ad25-eac3-4784-82cd-2aacf9ce01fc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:01.456290 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f53ad25-eac3-4784-82cd-2aacf9ce01fc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:01.457767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f53ad25-eac3-4784-82cd-2aacf9ce01fc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:01.460084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4f53ad25-eac3-4784-82cd-2aacf9ce01fc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.154132 Oct 28 20:11:01.460641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 434/857] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:01 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:11:01.739989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fc863a30-0944-44b2-bf58-4a4c6a031246 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:01.740600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fc863a30-0944-44b2-bf58-4a4c6a031246 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:01.746541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc863a30-0944-44b2-bf58-4a4c6a031246 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:01.747021 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc863a30-0944-44b2-bf58-4a4c6a031246 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:01.747455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc863a30-0944-44b2-bf58-4a4c6a031246 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:01.748129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc863a30-0944-44b2-bf58-4a4c6a031246 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:01.748608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc863a30-0944-44b2-bf58-4a4c6a031246 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:01.749138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc863a30-0944-44b2-bf58-4a4c6a031246 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:01.812202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fc863a30-0944-44b2-bf58-4a4c6a031246 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:01.814471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:01.820716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fc863a30-0944-44b2-bf58-4a4c6a031246 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084659 Oct 28 20:11:01.823250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 424/858] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:01 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:02.342580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b9d1a4f-f4f2-4cca-bc42-c851c3e770d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:02.345105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0b9d1a4f-f4f2-4cca-bc42-c851c3e770d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:02.351484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b9d1a4f-f4f2-4cca-bc42-c851c3e770d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:02.351969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b9d1a4f-f4f2-4cca-bc42-c851c3e770d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:02.352400 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b9d1a4f-f4f2-4cca-bc42-c851c3e770d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:02.353088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b9d1a4f-f4f2-4cca-bc42-c851c3e770d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:02.353566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b9d1a4f-f4f2-4cca-bc42-c851c3e770d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:02.353992 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b9d1a4f-f4f2-4cca-bc42-c851c3e770d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:02.383717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0b9d1a4f-f4f2-4cca-bc42-c851c3e770d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045640 Oct 28 20:11:02.384390 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 435/859] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:02 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:02.485367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-045015e3-f6a1-4b71-8215-c55e0d534164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:02.485973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-045015e3-f6a1-4b71-8215-c55e0d534164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:02.492664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-045015e3-f6a1-4b71-8215-c55e0d534164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:02.493146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-045015e3-f6a1-4b71-8215-c55e0d534164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:02.493611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-045015e3-f6a1-4b71-8215-c55e0d534164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:02.494294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-045015e3-f6a1-4b71-8215-c55e0d534164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:02.494793 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-045015e3-f6a1-4b71-8215-c55e0d534164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:02.495218 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-045015e3-f6a1-4b71-8215-c55e0d534164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:02.622918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-045015e3-f6a1-4b71-8215-c55e0d534164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:02.632398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-045015e3-f6a1-4b71-8215-c55e0d534164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:02.633878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-045015e3-f6a1-4b71-8215-c55e0d534164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:02.635035 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-045015e3-f6a1-4b71-8215-c55e0d534164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.153680 Oct 28 20:11:02.635593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 425/860] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:02 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:02.843887 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f3823865-8770-40fd-9c8c-2b831957537d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:02.844405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f3823865-8770-40fd-9c8c-2b831957537d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:02.850223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3823865-8770-40fd-9c8c-2b831957537d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:02.850697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3823865-8770-40fd-9c8c-2b831957537d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:02.851125 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3823865-8770-40fd-9c8c-2b831957537d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:02.851806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3823865-8770-40fd-9c8c-2b831957537d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:02.852250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3823865-8770-40fd-9c8c-2b831957537d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:02.852667 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3823865-8770-40fd-9c8c-2b831957537d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:02.912719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f3823865-8770-40fd-9c8c-2b831957537d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:02.921252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f3823865-8770-40fd-9c8c-2b831957537d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.080462 Oct 28 20:11:02.921901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 436/861] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:02 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:03.396432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c3399857-ac54-4717-b12e-eb03fe7c522b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:03.398601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c3399857-ac54-4717-b12e-eb03fe7c522b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:03.404518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3399857-ac54-4717-b12e-eb03fe7c522b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:03.405385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3399857-ac54-4717-b12e-eb03fe7c522b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:03.405971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3399857-ac54-4717-b12e-eb03fe7c522b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:03.406658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3399857-ac54-4717-b12e-eb03fe7c522b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:03.407109 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3399857-ac54-4717-b12e-eb03fe7c522b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:03.407550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3399857-ac54-4717-b12e-eb03fe7c522b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:03.437623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c3399857-ac54-4717-b12e-eb03fe7c522b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045007 Oct 28 20:11:03.443320 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 426/862] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:03 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:11:03.661490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49481c8e-4485-498c-a159-ad66a1d88d57 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:03.662044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-49481c8e-4485-498c-a159-ad66a1d88d57 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:03.668278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49481c8e-4485-498c-a159-ad66a1d88d57 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:03.668756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49481c8e-4485-498c-a159-ad66a1d88d57 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:03.669187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49481c8e-4485-498c-a159-ad66a1d88d57 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:03.669897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49481c8e-4485-498c-a159-ad66a1d88d57 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:03.670924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49481c8e-4485-498c-a159-ad66a1d88d57 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:03.671348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49481c8e-4485-498c-a159-ad66a1d88d57 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:03.800834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-49481c8e-4485-498c-a159-ad66a1d88d57 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:03.809229 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-49481c8e-4485-498c-a159-ad66a1d88d57 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:03.811340 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-49481c8e-4485-498c-a159-ad66a1d88d57 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:03.812549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-49481c8e-4485-498c-a159-ad66a1d88d57 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.155013 Oct 28 20:11:03.813094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 437/863] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:03 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:03.944600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e875c787-cd26-46c9-8042-589da7db1fba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:03.945213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e875c787-cd26-46c9-8042-589da7db1fba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:03.951608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e875c787-cd26-46c9-8042-589da7db1fba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:03.952092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e875c787-cd26-46c9-8042-589da7db1fba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:03.952530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e875c787-cd26-46c9-8042-589da7db1fba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:03.953221 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e875c787-cd26-46c9-8042-589da7db1fba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:03.953701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e875c787-cd26-46c9-8042-589da7db1fba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:03.954126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e875c787-cd26-46c9-8042-589da7db1fba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:04.014215 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e875c787-cd26-46c9-8042-589da7db1fba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:04.021869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e875c787-cd26-46c9-8042-589da7db1fba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081150 Oct 28 20:11:04.022428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 427/864] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:03 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:04.449891 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c0ea8088-b2d4-4213-bcd9-9bbf60a6dc80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:04.452535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c0ea8088-b2d4-4213-bcd9-9bbf60a6dc80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:04.458359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0ea8088-b2d4-4213-bcd9-9bbf60a6dc80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:04.458835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0ea8088-b2d4-4213-bcd9-9bbf60a6dc80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:04.459265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0ea8088-b2d4-4213-bcd9-9bbf60a6dc80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:04.460199 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0ea8088-b2d4-4213-bcd9-9bbf60a6dc80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:04.460644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0ea8088-b2d4-4213-bcd9-9bbf60a6dc80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:04.461063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0ea8088-b2d4-4213-bcd9-9bbf60a6dc80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:04.490514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c0ea8088-b2d4-4213-bcd9-9bbf60a6dc80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044410 Oct 28 20:11:04.490999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 438/865] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:04 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:04.837974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3187d137-d302-41e6-adc8-5da00cc377b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:04.838503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3187d137-d302-41e6-adc8-5da00cc377b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:04.844391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3187d137-d302-41e6-adc8-5da00cc377b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:04.844876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3187d137-d302-41e6-adc8-5da00cc377b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:04.845314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3187d137-d302-41e6-adc8-5da00cc377b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:04.846026 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3187d137-d302-41e6-adc8-5da00cc377b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:04.846481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3187d137-d302-41e6-adc8-5da00cc377b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:04.846903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3187d137-d302-41e6-adc8-5da00cc377b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:04.971669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3187d137-d302-41e6-adc8-5da00cc377b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:04.980126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3187d137-d302-41e6-adc8-5da00cc377b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:04.981611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3187d137-d302-41e6-adc8-5da00cc377b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:04.983399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3187d137-d302-41e6-adc8-5da00cc377b7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.149178 Oct 28 20:11:04.983952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 428/866] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:04 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:05.044059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2eda4dcf-8c1f-4627-9358-b1ca9ff4b3f8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:05.044680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2eda4dcf-8c1f-4627-9358-b1ca9ff4b3f8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:05.051741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eda4dcf-8c1f-4627-9358-b1ca9ff4b3f8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:05.052228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eda4dcf-8c1f-4627-9358-b1ca9ff4b3f8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:05.052672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eda4dcf-8c1f-4627-9358-b1ca9ff4b3f8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:05.053389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eda4dcf-8c1f-4627-9358-b1ca9ff4b3f8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:05.053851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eda4dcf-8c1f-4627-9358-b1ca9ff4b3f8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:05.054278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eda4dcf-8c1f-4627-9358-b1ca9ff4b3f8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:05.118115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2eda4dcf-8c1f-4627-9358-b1ca9ff4b3f8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:05.126307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2eda4dcf-8c1f-4627-9358-b1ca9ff4b3f8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.086244 Oct 28 20:11:05.126886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 439/867] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:05 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:05.503689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0d93c88a-174f-418e-ad3b-950b8b958eaf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:05.505943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0d93c88a-174f-418e-ad3b-950b8b958eaf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:05.511757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d93c88a-174f-418e-ad3b-950b8b958eaf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:05.512244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d93c88a-174f-418e-ad3b-950b8b958eaf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:05.512685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d93c88a-174f-418e-ad3b-950b8b958eaf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:05.513411 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d93c88a-174f-418e-ad3b-950b8b958eaf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:05.515636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d93c88a-174f-418e-ad3b-950b8b958eaf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:05.516083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d93c88a-174f-418e-ad3b-950b8b958eaf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:05.546824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0d93c88a-174f-418e-ad3b-950b8b958eaf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047278 Oct 28 20:11:05.547370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 429/868] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:05 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:06.009899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1c14f05d-e9c4-4479-a6ea-0366b37ce93b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:06.010519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1c14f05d-e9c4-4479-a6ea-0366b37ce93b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:06.017553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c14f05d-e9c4-4479-a6ea-0366b37ce93b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:06.018045 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c14f05d-e9c4-4479-a6ea-0366b37ce93b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:06.018488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c14f05d-e9c4-4479-a6ea-0366b37ce93b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:06.019185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c14f05d-e9c4-4479-a6ea-0366b37ce93b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:06.019655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c14f05d-e9c4-4479-a6ea-0366b37ce93b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:06.020082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c14f05d-e9c4-4479-a6ea-0366b37ce93b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:06.147605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1c14f05d-e9c4-4479-a6ea-0366b37ce93b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:06.148108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d25109bf-10c0-4ad4-8f1a-5c3aa26add04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:06.148531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d25109bf-10c0-4ad4-8f1a-5c3aa26add04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:06.155272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d25109bf-10c0-4ad4-8f1a-5c3aa26add04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:06.155750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d25109bf-10c0-4ad4-8f1a-5c3aa26add04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:06.156184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d25109bf-10c0-4ad4-8f1a-5c3aa26add04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:06.156938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d25109bf-10c0-4ad4-8f1a-5c3aa26add04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:06.157207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1c14f05d-e9c4-4479-a6ea-0366b37ce93b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:06.157419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d25109bf-10c0-4ad4-8f1a-5c3aa26add04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:06.157849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d25109bf-10c0-4ad4-8f1a-5c3aa26add04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:06.158684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1c14f05d-e9c4-4479-a6ea-0366b37ce93b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:06.159903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1c14f05d-e9c4-4479-a6ea-0366b37ce93b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.153918 Oct 28 20:11:06.160408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 440/869] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:06 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:06.218440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d25109bf-10c0-4ad4-8f1a-5c3aa26add04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:06.225821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d25109bf-10c0-4ad4-8f1a-5c3aa26add04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081753 Oct 28 20:11:06.226380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 430/870] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:06 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:11:06.558989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-95e92906-9a7f-495e-9d7a-b1c63d4bea2e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:06.561372 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-95e92906-9a7f-495e-9d7a-b1c63d4bea2e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:06.567113 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95e92906-9a7f-495e-9d7a-b1c63d4bea2e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:06.567592 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95e92906-9a7f-495e-9d7a-b1c63d4bea2e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:06.568090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95e92906-9a7f-495e-9d7a-b1c63d4bea2e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:06.568778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95e92906-9a7f-495e-9d7a-b1c63d4bea2e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:06.569233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95e92906-9a7f-495e-9d7a-b1c63d4bea2e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:06.569690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95e92906-9a7f-495e-9d7a-b1c63d4bea2e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:06.595431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:06.599964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-95e92906-9a7f-495e-9d7a-b1c63d4bea2e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044935 Oct 28 20:11:06.601452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 441/871] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:06 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:07.186237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6022f493-3d88-4bbb-b5c4-a24f0d0f96d5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:07.187114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6022f493-3d88-4bbb-b5c4-a24f0d0f96d5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:07.193214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6022f493-3d88-4bbb-b5c4-a24f0d0f96d5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:07.193733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6022f493-3d88-4bbb-b5c4-a24f0d0f96d5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:07.194175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6022f493-3d88-4bbb-b5c4-a24f0d0f96d5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:07.194858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6022f493-3d88-4bbb-b5c4-a24f0d0f96d5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:07.195313 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6022f493-3d88-4bbb-b5c4-a24f0d0f96d5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:07.195737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6022f493-3d88-4bbb-b5c4-a24f0d0f96d5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:07.250613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ef49ef70-fad5-479a-a3e3-ba14f0a16565 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:07.251341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ef49ef70-fad5-479a-a3e3-ba14f0a16565 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:07.257727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef49ef70-fad5-479a-a3e3-ba14f0a16565 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:07.258233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef49ef70-fad5-479a-a3e3-ba14f0a16565 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:07.258665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef49ef70-fad5-479a-a3e3-ba14f0a16565 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:07.259354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef49ef70-fad5-479a-a3e3-ba14f0a16565 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:07.259803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef49ef70-fad5-479a-a3e3-ba14f0a16565 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:07.260221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef49ef70-fad5-479a-a3e3-ba14f0a16565 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:07.330876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ef49ef70-fad5-479a-a3e3-ba14f0a16565 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:07.338855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ef49ef70-fad5-479a-a3e3-ba14f0a16565 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.093119 Oct 28 20:11:07.339589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 442/872] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:07 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:11:07.351829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6022f493-3d88-4bbb-b5c4-a24f0d0f96d5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:07.361174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6022f493-3d88-4bbb-b5c4-a24f0d0f96d5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:07.362627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6022f493-3d88-4bbb-b5c4-a24f0d0f96d5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:07.363764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6022f493-3d88-4bbb-b5c4-a24f0d0f96d5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.181983 Oct 28 20:11:07.364307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 431/873] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:07 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:07.612885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe8a9f1a-2835-4f62-9db2-e8fa72c32acb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:07.615170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fe8a9f1a-2835-4f62-9db2-e8fa72c32acb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:07.621008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe8a9f1a-2835-4f62-9db2-e8fa72c32acb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:07.621587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe8a9f1a-2835-4f62-9db2-e8fa72c32acb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:07.622016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe8a9f1a-2835-4f62-9db2-e8fa72c32acb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:07.622692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe8a9f1a-2835-4f62-9db2-e8fa72c32acb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:07.623167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe8a9f1a-2835-4f62-9db2-e8fa72c32acb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:07.623577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe8a9f1a-2835-4f62-9db2-e8fa72c32acb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:07.651994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fe8a9f1a-2835-4f62-9db2-e8fa72c32acb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043210 Oct 28 20:11:07.652537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 443/874] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:07 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:08.362898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a4bda644-039f-4d68-9e48-f2fe4b460387 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:08.363517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a4bda644-039f-4d68-9e48-f2fe4b460387 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:08.369787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4bda644-039f-4d68-9e48-f2fe4b460387 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:08.370271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4bda644-039f-4d68-9e48-f2fe4b460387 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:08.370712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4bda644-039f-4d68-9e48-f2fe4b460387 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:08.371393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4bda644-039f-4d68-9e48-f2fe4b460387 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:08.371847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4bda644-039f-4d68-9e48-f2fe4b460387 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:08.372268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4bda644-039f-4d68-9e48-f2fe4b460387 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:08.389546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-18614d6a-ad1d-4c59-9177-471a439953ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:08.390193 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-18614d6a-ad1d-4c59-9177-471a439953ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:08.396516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18614d6a-ad1d-4c59-9177-471a439953ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:08.396999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18614d6a-ad1d-4c59-9177-471a439953ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:08.397473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18614d6a-ad1d-4c59-9177-471a439953ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:08.398201 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18614d6a-ad1d-4c59-9177-471a439953ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:08.398625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18614d6a-ad1d-4c59-9177-471a439953ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:08.399049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18614d6a-ad1d-4c59-9177-471a439953ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:08.447367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a4bda644-039f-4d68-9e48-f2fe4b460387 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:08.447367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a4bda644-039f-4d68-9e48-f2fe4b460387 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085054 Oct 28 20:11:08.447367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 432/875] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:08 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:08.536335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-18614d6a-ad1d-4c59-9177-471a439953ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:08.545950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-18614d6a-ad1d-4c59-9177-471a439953ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:08.547589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-18614d6a-ad1d-4c59-9177-471a439953ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:08.548796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-18614d6a-ad1d-4c59-9177-471a439953ba tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.163284 Oct 28 20:11:08.549370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 444/876] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:08 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:11:08.664390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ad55cc9c-d1f7-4672-af20-e2bc66c305dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:08.666698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ad55cc9c-d1f7-4672-af20-e2bc66c305dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:08.676946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad55cc9c-d1f7-4672-af20-e2bc66c305dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:08.676946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad55cc9c-d1f7-4672-af20-e2bc66c305dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:08.676946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad55cc9c-d1f7-4672-af20-e2bc66c305dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:08.676946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad55cc9c-d1f7-4672-af20-e2bc66c305dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:08.677303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad55cc9c-d1f7-4672-af20-e2bc66c305dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:08.677303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad55cc9c-d1f7-4672-af20-e2bc66c305dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:08.706265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ad55cc9c-d1f7-4672-af20-e2bc66c305dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045822 Oct 28 20:11:08.707243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 433/877] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:08 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:09.466429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d0e2c153-f20c-43a0-bc35-7f2f2d938fc4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:09.467619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d0e2c153-f20c-43a0-bc35-7f2f2d938fc4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:09.474112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e2c153-f20c-43a0-bc35-7f2f2d938fc4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:09.474591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e2c153-f20c-43a0-bc35-7f2f2d938fc4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:09.475027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e2c153-f20c-43a0-bc35-7f2f2d938fc4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:09.475714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e2c153-f20c-43a0-bc35-7f2f2d938fc4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:09.476164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e2c153-f20c-43a0-bc35-7f2f2d938fc4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:09.476586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e2c153-f20c-43a0-bc35-7f2f2d938fc4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:09.536912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0e2c153-f20c-43a0-bc35-7f2f2d938fc4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:09.544617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d0e2c153-f20c-43a0-bc35-7f2f2d938fc4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082028 Oct 28 20:11:09.545447 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 445/878] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:09 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:09.574556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5632d9b6-c118-417b-8729-3af1c8f8d693 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:09.575167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5632d9b6-c118-417b-8729-3af1c8f8d693 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:09.582170 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5632d9b6-c118-417b-8729-3af1c8f8d693 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:09.582651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5632d9b6-c118-417b-8729-3af1c8f8d693 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:09.583089 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5632d9b6-c118-417b-8729-3af1c8f8d693 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:09.583771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5632d9b6-c118-417b-8729-3af1c8f8d693 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:09.584223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5632d9b6-c118-417b-8729-3af1c8f8d693 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:09.584907 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5632d9b6-c118-417b-8729-3af1c8f8d693 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:09.718677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5632d9b6-c118-417b-8729-3af1c8f8d693 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:09.721595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed57e34f-5b58-4440-a565-001dff92985b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:09.723821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ed57e34f-5b58-4440-a565-001dff92985b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:09.727929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5632d9b6-c118-417b-8729-3af1c8f8d693 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:09.729557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5632d9b6-c118-417b-8729-3af1c8f8d693 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:09.730034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed57e34f-5b58-4440-a565-001dff92985b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:09.730492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed57e34f-5b58-4440-a565-001dff92985b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:09.730713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5632d9b6-c118-417b-8729-3af1c8f8d693 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.160052 Oct 28 20:11:09.730931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed57e34f-5b58-4440-a565-001dff92985b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:09.731626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 434/879] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:09 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:09.742031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed57e34f-5b58-4440-a565-001dff92985b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:09.742397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed57e34f-5b58-4440-a565-001dff92985b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:09.742846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed57e34f-5b58-4440-a565-001dff92985b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:09.780274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ed57e34f-5b58-4440-a565-001dff92985b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065289 Oct 28 20:11:09.780972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 446/880] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:09 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:10.574830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4ebd1086-268a-4ec4-8a45-dbd936c6306f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:10.575483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4ebd1086-268a-4ec4-8a45-dbd936c6306f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:10.581947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ebd1086-268a-4ec4-8a45-dbd936c6306f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:10.582436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ebd1086-268a-4ec4-8a45-dbd936c6306f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:10.582878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ebd1086-268a-4ec4-8a45-dbd936c6306f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:10.583566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ebd1086-268a-4ec4-8a45-dbd936c6306f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:10.584024 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ebd1086-268a-4ec4-8a45-dbd936c6306f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:10.584450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ebd1086-268a-4ec4-8a45-dbd936c6306f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:10.645443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4ebd1086-268a-4ec4-8a45-dbd936c6306f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:10.652891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4ebd1086-268a-4ec4-8a45-dbd936c6306f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081914 Oct 28 20:11:10.653476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 435/881] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:10 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:10.759973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0fbc852b-b85d-422f-be32-6b48e623d433 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:10.760608 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0fbc852b-b85d-422f-be32-6b48e623d433 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:10.767598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fbc852b-b85d-422f-be32-6b48e623d433 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:10.768072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fbc852b-b85d-422f-be32-6b48e623d433 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:10.768508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fbc852b-b85d-422f-be32-6b48e623d433 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:10.769206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fbc852b-b85d-422f-be32-6b48e623d433 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:10.769690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fbc852b-b85d-422f-be32-6b48e623d433 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:10.770113 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fbc852b-b85d-422f-be32-6b48e623d433 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:10.794055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b30e1b63-9bad-4752-99ec-1a6baebbf1af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:10.797041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b30e1b63-9bad-4752-99ec-1a6baebbf1af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:10.808531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b30e1b63-9bad-4752-99ec-1a6baebbf1af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:10.808531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b30e1b63-9bad-4752-99ec-1a6baebbf1af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:10.808531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b30e1b63-9bad-4752-99ec-1a6baebbf1af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:10.808531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b30e1b63-9bad-4752-99ec-1a6baebbf1af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:10.808833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b30e1b63-9bad-4752-99ec-1a6baebbf1af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:10.808833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b30e1b63-9bad-4752-99ec-1a6baebbf1af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:10.837302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b30e1b63-9bad-4752-99ec-1a6baebbf1af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048473 Oct 28 20:11:10.838084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 436/882] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:10 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:10.906167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0fbc852b-b85d-422f-be32-6b48e623d433 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:10.914568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0fbc852b-b85d-422f-be32-6b48e623d433 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:10.915987 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0fbc852b-b85d-422f-be32-6b48e623d433 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:10.917137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0fbc852b-b85d-422f-be32-6b48e623d433 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.161287 Oct 28 20:11:10.917719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 447/883] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:10 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:11.677840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-995ff4ff-2a49-409f-9c76-65f4160ab506 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:11.678448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-995ff4ff-2a49-409f-9c76-65f4160ab506 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:11.684767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-995ff4ff-2a49-409f-9c76-65f4160ab506 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:11.685802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-995ff4ff-2a49-409f-9c76-65f4160ab506 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:11.686324 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-995ff4ff-2a49-409f-9c76-65f4160ab506 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:11.687020 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-995ff4ff-2a49-409f-9c76-65f4160ab506 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:11.687471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-995ff4ff-2a49-409f-9c76-65f4160ab506 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:11.687896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-995ff4ff-2a49-409f-9c76-65f4160ab506 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:11.749717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-995ff4ff-2a49-409f-9c76-65f4160ab506 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:11.757460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-995ff4ff-2a49-409f-9c76-65f4160ab506 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.083378 Oct 28 20:11:11.758022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 437/884] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:11 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:11.850368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-211ef2ff-b472-4d27-aa5a-580488f4b61d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:11.852656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-211ef2ff-b472-4d27-aa5a-580488f4b61d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:11.859760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-211ef2ff-b472-4d27-aa5a-580488f4b61d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:11.860444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-211ef2ff-b472-4d27-aa5a-580488f4b61d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:11.860880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-211ef2ff-b472-4d27-aa5a-580488f4b61d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:11.861598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-211ef2ff-b472-4d27-aa5a-580488f4b61d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:11.862052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-211ef2ff-b472-4d27-aa5a-580488f4b61d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:11.862474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-211ef2ff-b472-4d27-aa5a-580488f4b61d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:11.894785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-211ef2ff-b472-4d27-aa5a-580488f4b61d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048276 Oct 28 20:11:11.895338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 448/885] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:11 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:11.943026 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ceb75e7c-9872-41cc-80e3-eed5a9cf34be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:11.943698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ceb75e7c-9872-41cc-80e3-eed5a9cf34be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:11.949595 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ceb75e7c-9872-41cc-80e3-eed5a9cf34be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:11.950080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ceb75e7c-9872-41cc-80e3-eed5a9cf34be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:11.950519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ceb75e7c-9872-41cc-80e3-eed5a9cf34be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:11.951727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ceb75e7c-9872-41cc-80e3-eed5a9cf34be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:11.952192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ceb75e7c-9872-41cc-80e3-eed5a9cf34be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:11.952621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ceb75e7c-9872-41cc-80e3-eed5a9cf34be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:12.083719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ceb75e7c-9872-41cc-80e3-eed5a9cf34be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:12.093073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ceb75e7c-9872-41cc-80e3-eed5a9cf34be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:12.094550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ceb75e7c-9872-41cc-80e3-eed5a9cf34be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:12.095694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ceb75e7c-9872-41cc-80e3-eed5a9cf34be tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.156517 Oct 28 20:11:12.096242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 438/886] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:11 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:12.779980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6b46081c-c045-42bd-bc1a-96e63064bc2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:12.783699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6b46081c-c045-42bd-bc1a-96e63064bc2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:12.786690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b46081c-c045-42bd-bc1a-96e63064bc2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:12.787167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b46081c-c045-42bd-bc1a-96e63064bc2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:12.787599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b46081c-c045-42bd-bc1a-96e63064bc2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:12.788277 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b46081c-c045-42bd-bc1a-96e63064bc2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:12.788727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b46081c-c045-42bd-bc1a-96e63064bc2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:12.789146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b46081c-c045-42bd-bc1a-96e63064bc2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:12.850408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6b46081c-c045-42bd-bc1a-96e63064bc2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:12.859055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6b46081c-c045-42bd-bc1a-96e63064bc2a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082915 Oct 28 20:11:12.859625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 449/887] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:12 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:12.906726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-15aabdd0-c6a2-46b3-a7c7-5924d29a8dd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:12.908893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-15aabdd0-c6a2-46b3-a7c7-5924d29a8dd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:12.915207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15aabdd0-c6a2-46b3-a7c7-5924d29a8dd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:12.915687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15aabdd0-c6a2-46b3-a7c7-5924d29a8dd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:12.916118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15aabdd0-c6a2-46b3-a7c7-5924d29a8dd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:12.916885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15aabdd0-c6a2-46b3-a7c7-5924d29a8dd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:12.917355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15aabdd0-c6a2-46b3-a7c7-5924d29a8dd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:12.917778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15aabdd0-c6a2-46b3-a7c7-5924d29a8dd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:12.947668 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-15aabdd0-c6a2-46b3-a7c7-5924d29a8dd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045302 Oct 28 20:11:12.948229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 439/888] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:12 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:13.121749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d353c747-b00e-44fb-9148-1479056dd852 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:13.122362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d353c747-b00e-44fb-9148-1479056dd852 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:13.128654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d353c747-b00e-44fb-9148-1479056dd852 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:13.129135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d353c747-b00e-44fb-9148-1479056dd852 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:13.129611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d353c747-b00e-44fb-9148-1479056dd852 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:13.130295 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d353c747-b00e-44fb-9148-1479056dd852 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:13.130746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d353c747-b00e-44fb-9148-1479056dd852 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:13.131170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d353c747-b00e-44fb-9148-1479056dd852 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:13.258716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d353c747-b00e-44fb-9148-1479056dd852 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:13.267195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d353c747-b00e-44fb-9148-1479056dd852 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:13.268632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d353c747-b00e-44fb-9148-1479056dd852 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:13.269846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d353c747-b00e-44fb-9148-1479056dd852 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.151988 Oct 28 20:11:13.270398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 450/889] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:13 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:13.881139 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be855093-26e2-4a27-87d0-c71c228024bd tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:13.881780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-be855093-26e2-4a27-87d0-c71c228024bd tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:13.887813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be855093-26e2-4a27-87d0-c71c228024bd tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:13.888295 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be855093-26e2-4a27-87d0-c71c228024bd tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:13.888740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be855093-26e2-4a27-87d0-c71c228024bd tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:13.889450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be855093-26e2-4a27-87d0-c71c228024bd tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:13.889915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be855093-26e2-4a27-87d0-c71c228024bd tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:13.890345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be855093-26e2-4a27-87d0-c71c228024bd tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:13.954881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-be855093-26e2-4a27-87d0-c71c228024bd tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:13.961253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3a83f053-ab71-4809-86b2-83e3e8dade3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:13.973855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-be855093-26e2-4a27-87d0-c71c228024bd tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085778 Oct 28 20:11:13.973968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3a83f053-ab71-4809-86b2-83e3e8dade3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:13.973968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a83f053-ab71-4809-86b2-83e3e8dade3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:13.974141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 440/890] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:13 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:13.974228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a83f053-ab71-4809-86b2-83e3e8dade3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:13.974571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a83f053-ab71-4809-86b2-83e3e8dade3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:13.975401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a83f053-ab71-4809-86b2-83e3e8dade3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:13.975868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a83f053-ab71-4809-86b2-83e3e8dade3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:13.976298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a83f053-ab71-4809-86b2-83e3e8dade3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:14.007133 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3a83f053-ab71-4809-86b2-83e3e8dade3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050569 Oct 28 20:11:14.007701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 451/891] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:13 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:14.296010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a04e2653-3616-4f34-89d9-3629b8ffed76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:14.296623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a04e2653-3616-4f34-89d9-3629b8ffed76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:14.302800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a04e2653-3616-4f34-89d9-3629b8ffed76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:14.303285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a04e2653-3616-4f34-89d9-3629b8ffed76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:14.303747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a04e2653-3616-4f34-89d9-3629b8ffed76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:14.304435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a04e2653-3616-4f34-89d9-3629b8ffed76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:14.304894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a04e2653-3616-4f34-89d9-3629b8ffed76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:14.305342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a04e2653-3616-4f34-89d9-3629b8ffed76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:14.320114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:14.433898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a04e2653-3616-4f34-89d9-3629b8ffed76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:14.442967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a04e2653-3616-4f34-89d9-3629b8ffed76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:14.444409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a04e2653-3616-4f34-89d9-3629b8ffed76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:14.445583 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a04e2653-3616-4f34-89d9-3629b8ffed76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.154101 Oct 28 20:11:14.446140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 441/892] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:14 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:14.986736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5a312917-64d1-4e5d-9a0b-f911908b976a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:14.987341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5a312917-64d1-4e5d-9a0b-f911908b976a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:14.994706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a312917-64d1-4e5d-9a0b-f911908b976a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:14.995192 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a312917-64d1-4e5d-9a0b-f911908b976a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:14.995751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a312917-64d1-4e5d-9a0b-f911908b976a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:14.996449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a312917-64d1-4e5d-9a0b-f911908b976a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:14.996903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a312917-64d1-4e5d-9a0b-f911908b976a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:14.997352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a312917-64d1-4e5d-9a0b-f911908b976a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:15.024374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3cb2b6f9-bcb3-4e5e-ab8a-7822f1acc176 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:15.028585 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3cb2b6f9-bcb3-4e5e-ab8a-7822f1acc176 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:15.035967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cb2b6f9-bcb3-4e5e-ab8a-7822f1acc176 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:15.036748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cb2b6f9-bcb3-4e5e-ab8a-7822f1acc176 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:15.037188 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cb2b6f9-bcb3-4e5e-ab8a-7822f1acc176 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:15.037941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cb2b6f9-bcb3-4e5e-ab8a-7822f1acc176 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:15.038575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cb2b6f9-bcb3-4e5e-ab8a-7822f1acc176 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:15.039001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cb2b6f9-bcb3-4e5e-ab8a-7822f1acc176 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:15.079768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5a312917-64d1-4e5d-9a0b-f911908b976a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:15.081563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3cb2b6f9-bcb3-4e5e-ab8a-7822f1acc176 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061043 Oct 28 20:11:15.085391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 442/893] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:15 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:15.088283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5a312917-64d1-4e5d-9a0b-f911908b976a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.105313 Oct 28 20:11:15.089098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 452/894] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:14 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:15.471983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-747662c9-a6b5-49a3-95fa-76d6a8c31bbe tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:15.472586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-747662c9-a6b5-49a3-95fa-76d6a8c31bbe tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:15.478498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-747662c9-a6b5-49a3-95fa-76d6a8c31bbe tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:15.478973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-747662c9-a6b5-49a3-95fa-76d6a8c31bbe tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:15.479405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-747662c9-a6b5-49a3-95fa-76d6a8c31bbe tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:15.480110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-747662c9-a6b5-49a3-95fa-76d6a8c31bbe tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:15.480556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-747662c9-a6b5-49a3-95fa-76d6a8c31bbe tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:15.480972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-747662c9-a6b5-49a3-95fa-76d6a8c31bbe tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:15.611847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-747662c9-a6b5-49a3-95fa-76d6a8c31bbe tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:15.620305 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-747662c9-a6b5-49a3-95fa-76d6a8c31bbe tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:15.621782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-747662c9-a6b5-49a3-95fa-76d6a8c31bbe tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:15.623600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-747662c9-a6b5-49a3-95fa-76d6a8c31bbe tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.155435 Oct 28 20:11:15.624154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 443/895] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:15 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:16.094433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-811cc365-1b24-42fb-9033-a34b957181ed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:16.096794 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-811cc365-1b24-42fb-9033-a34b957181ed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:16.103091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-811cc365-1b24-42fb-9033-a34b957181ed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:16.103575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-811cc365-1b24-42fb-9033-a34b957181ed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:16.104012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-811cc365-1b24-42fb-9033-a34b957181ed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:16.104710 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-811cc365-1b24-42fb-9033-a34b957181ed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:16.105168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-811cc365-1b24-42fb-9033-a34b957181ed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:16.105619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-811cc365-1b24-42fb-9033-a34b957181ed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:16.111935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ec1bd269-cb11-46e5-a45e-11e6b11b1dce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:16.112745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ec1bd269-cb11-46e5-a45e-11e6b11b1dce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:16.124205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1bd269-cb11-46e5-a45e-11e6b11b1dce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:16.124205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1bd269-cb11-46e5-a45e-11e6b11b1dce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:16.124205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1bd269-cb11-46e5-a45e-11e6b11b1dce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:16.124205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1bd269-cb11-46e5-a45e-11e6b11b1dce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:16.124513 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1bd269-cb11-46e5-a45e-11e6b11b1dce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:16.124513 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1bd269-cb11-46e5-a45e-11e6b11b1dce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:16.146512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-811cc365-1b24-42fb-9033-a34b957181ed tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056394 Oct 28 20:11:16.147629 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 453/896] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:16 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:16.191924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ec1bd269-cb11-46e5-a45e-11e6b11b1dce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:16.199807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ec1bd269-cb11-46e5-a45e-11e6b11b1dce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.091714 Oct 28 20:11:16.200372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 444/897] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:16 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:11:16.650322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-410f7716-4747-4b29-8e1c-a4f40c6dca0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:16.650933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-410f7716-4747-4b29-8e1c-a4f40c6dca0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:16.657868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-410f7716-4747-4b29-8e1c-a4f40c6dca0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:16.658357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-410f7716-4747-4b29-8e1c-a4f40c6dca0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:16.658799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-410f7716-4747-4b29-8e1c-a4f40c6dca0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:16.659486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-410f7716-4747-4b29-8e1c-a4f40c6dca0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:16.659941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-410f7716-4747-4b29-8e1c-a4f40c6dca0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:16.660373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-410f7716-4747-4b29-8e1c-a4f40c6dca0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:16.785920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-410f7716-4747-4b29-8e1c-a4f40c6dca0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:16.795128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-410f7716-4747-4b29-8e1c-a4f40c6dca0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:16.796892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-410f7716-4747-4b29-8e1c-a4f40c6dca0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:16.798103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-410f7716-4747-4b29-8e1c-a4f40c6dca0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.151887 Oct 28 20:11:16.798659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 454/898] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:16 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:17.159779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f2a6320c-a22d-4346-8ea9-e05ce42aa46a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:17.161945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f2a6320c-a22d-4346-8ea9-e05ce42aa46a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:17.168150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2a6320c-a22d-4346-8ea9-e05ce42aa46a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:17.168626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2a6320c-a22d-4346-8ea9-e05ce42aa46a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:17.169075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2a6320c-a22d-4346-8ea9-e05ce42aa46a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:17.170538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2a6320c-a22d-4346-8ea9-e05ce42aa46a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:17.171096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2a6320c-a22d-4346-8ea9-e05ce42aa46a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:17.171520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2a6320c-a22d-4346-8ea9-e05ce42aa46a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:17.211055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f2a6320c-a22d-4346-8ea9-e05ce42aa46a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046945 Oct 28 20:11:17.211055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 445/899] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:17 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:17.222889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ad9ef2f-c766-418b-b06a-c06c28ac74d8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:17.223536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ad9ef2f-c766-418b-b06a-c06c28ac74d8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:17.230554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=84 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:17.231023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad9ef2f-c766-418b-b06a-c06c28ac74d8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:17.231205 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad9ef2f-c766-418b-b06a-c06c28ac74d8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:17.231645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad9ef2f-c766-418b-b06a-c06c28ac74d8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:17.233141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad9ef2f-c766-418b-b06a-c06c28ac74d8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:17.233623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad9ef2f-c766-418b-b06a-c06c28ac74d8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:17.234205 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad9ef2f-c766-418b-b06a-c06c28ac74d8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:17.306624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ad9ef2f-c766-418b-b06a-c06c28ac74d8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:17.314901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ad9ef2f-c766-418b-b06a-c06c28ac74d8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.095547 Oct 28 20:11:17.316513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 455/900] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:17 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:17.823939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-db80bd20-8e03-4f67-9345-8382d77c7e36 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:17.824549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-db80bd20-8e03-4f67-9345-8382d77c7e36 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:17.830617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db80bd20-8e03-4f67-9345-8382d77c7e36 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:17.831100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db80bd20-8e03-4f67-9345-8382d77c7e36 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:17.831536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db80bd20-8e03-4f67-9345-8382d77c7e36 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:17.832215 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db80bd20-8e03-4f67-9345-8382d77c7e36 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:17.832666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db80bd20-8e03-4f67-9345-8382d77c7e36 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:17.833087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db80bd20-8e03-4f67-9345-8382d77c7e36 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:17.961090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-db80bd20-8e03-4f67-9345-8382d77c7e36 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:17.970171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-db80bd20-8e03-4f67-9345-8382d77c7e36 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:17.971623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-db80bd20-8e03-4f67-9345-8382d77c7e36 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:17.972771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-db80bd20-8e03-4f67-9345-8382d77c7e36 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.152758 Oct 28 20:11:17.973353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 446/901] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:17 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:18.215253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3f23a45e-54c1-44fd-b6f9-5d7e276b46eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:18.217482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3f23a45e-54c1-44fd-b6f9-5d7e276b46eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:18.223913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f23a45e-54c1-44fd-b6f9-5d7e276b46eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:18.224401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f23a45e-54c1-44fd-b6f9-5d7e276b46eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:18.224904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f23a45e-54c1-44fd-b6f9-5d7e276b46eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:18.225531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f23a45e-54c1-44fd-b6f9-5d7e276b46eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:18.225986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f23a45e-54c1-44fd-b6f9-5d7e276b46eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:18.226409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f23a45e-54c1-44fd-b6f9-5d7e276b46eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:18.256462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3f23a45e-54c1-44fd-b6f9-5d7e276b46eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Oct 28 20:11:18.257037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 456/902] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:18 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:18.339638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-832b0b42-60c9-4e91-8bbb-09eaff37ea20 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:18.340444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-832b0b42-60c9-4e91-8bbb-09eaff37ea20 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:18.347512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-832b0b42-60c9-4e91-8bbb-09eaff37ea20 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:18.348066 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-832b0b42-60c9-4e91-8bbb-09eaff37ea20 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:18.348577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-832b0b42-60c9-4e91-8bbb-09eaff37ea20 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:18.349358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-832b0b42-60c9-4e91-8bbb-09eaff37ea20 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:18.349896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-832b0b42-60c9-4e91-8bbb-09eaff37ea20 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:18.350419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-832b0b42-60c9-4e91-8bbb-09eaff37ea20 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:18.413079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-832b0b42-60c9-4e91-8bbb-09eaff37ea20 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:18.421275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-832b0b42-60c9-4e91-8bbb-09eaff37ea20 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085598 Oct 28 20:11:18.421864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 447/903] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:18 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:18.999107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9a23bb80-098f-47ec-9b11-d75448d4d358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:18.999711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9a23bb80-098f-47ec-9b11-d75448d4d358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:19.005567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a23bb80-098f-47ec-9b11-d75448d4d358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:19.006042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a23bb80-098f-47ec-9b11-d75448d4d358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:19.006474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a23bb80-098f-47ec-9b11-d75448d4d358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:19.007147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a23bb80-098f-47ec-9b11-d75448d4d358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:19.007591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a23bb80-098f-47ec-9b11-d75448d4d358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:19.008009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a23bb80-098f-47ec-9b11-d75448d4d358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:19.133889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9a23bb80-098f-47ec-9b11-d75448d4d358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:19.142890 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9a23bb80-098f-47ec-9b11-d75448d4d358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:19.144312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9a23bb80-098f-47ec-9b11-d75448d4d358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:19.145493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9a23bb80-098f-47ec-9b11-d75448d4d358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.150549 Oct 28 20:11:19.146075 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 457/904] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:18 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:19.268800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ec0de5b-d608-457c-b7b7-872fcb09bab6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:19.270881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5ec0de5b-d608-457c-b7b7-872fcb09bab6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:19.275694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=82 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:19.277370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec0de5b-d608-457c-b7b7-872fcb09bab6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:19.277856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec0de5b-d608-457c-b7b7-872fcb09bab6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:19.278292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec0de5b-d608-457c-b7b7-872fcb09bab6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:19.278998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec0de5b-d608-457c-b7b7-872fcb09bab6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:19.279448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec0de5b-d608-457c-b7b7-872fcb09bab6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:19.279872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec0de5b-d608-457c-b7b7-872fcb09bab6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:19.310865 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5ec0de5b-d608-457c-b7b7-872fcb09bab6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045292 Oct 28 20:11:19.311498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 448/905] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:19 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:11:19.444460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-610d0d72-b4af-4a94-80a5-4cac4be7d12d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:19.445076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-610d0d72-b4af-4a94-80a5-4cac4be7d12d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:19.451735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-610d0d72-b4af-4a94-80a5-4cac4be7d12d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:19.452223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-610d0d72-b4af-4a94-80a5-4cac4be7d12d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:19.452663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-610d0d72-b4af-4a94-80a5-4cac4be7d12d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:19.453388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-610d0d72-b4af-4a94-80a5-4cac4be7d12d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:19.453847 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-610d0d72-b4af-4a94-80a5-4cac4be7d12d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:19.454272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-610d0d72-b4af-4a94-80a5-4cac4be7d12d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:19.473623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:19.520454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-610d0d72-b4af-4a94-80a5-4cac4be7d12d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:19.527882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-610d0d72-b4af-4a94-80a5-4cac4be7d12d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.087346 Oct 28 20:11:19.528450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 458/906] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:19 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:20.171459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3915be57-11cb-41fb-94ab-79c3803bb24f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:20.172067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3915be57-11cb-41fb-94ab-79c3803bb24f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:20.178758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3915be57-11cb-41fb-94ab-79c3803bb24f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:20.179246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3915be57-11cb-41fb-94ab-79c3803bb24f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:20.179683 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3915be57-11cb-41fb-94ab-79c3803bb24f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:20.180365 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3915be57-11cb-41fb-94ab-79c3803bb24f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:20.180823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3915be57-11cb-41fb-94ab-79c3803bb24f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:20.181251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3915be57-11cb-41fb-94ab-79c3803bb24f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:20.313391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3915be57-11cb-41fb-94ab-79c3803bb24f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:20.322126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3915be57-11cb-41fb-94ab-79c3803bb24f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:20.323151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c9e70773-d5bd-4e1e-90ce-49f3edc82011 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:20.323580 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3915be57-11cb-41fb-94ab-79c3803bb24f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:20.324739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3915be57-11cb-41fb-94ab-79c3803bb24f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.157212 Oct 28 20:11:20.325885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 449/907] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:20 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:20.326005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c9e70773-d5bd-4e1e-90ce-49f3edc82011 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:20.331774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9e70773-d5bd-4e1e-90ce-49f3edc82011 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:20.332251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9e70773-d5bd-4e1e-90ce-49f3edc82011 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:20.332690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9e70773-d5bd-4e1e-90ce-49f3edc82011 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:20.333406 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9e70773-d5bd-4e1e-90ce-49f3edc82011 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:20.333858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9e70773-d5bd-4e1e-90ce-49f3edc82011 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:20.334280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9e70773-d5bd-4e1e-90ce-49f3edc82011 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:20.363828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c9e70773-d5bd-4e1e-90ce-49f3edc82011 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044530 Oct 28 20:11:20.364373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 459/908] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:20 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:20.550352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1bef658e-ad09-4dce-a9ba-094818b2f480 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:20.550969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1bef658e-ad09-4dce-a9ba-094818b2f480 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:20.556801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bef658e-ad09-4dce-a9ba-094818b2f480 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:20.557287 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bef658e-ad09-4dce-a9ba-094818b2f480 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:20.557755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bef658e-ad09-4dce-a9ba-094818b2f480 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:20.558435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bef658e-ad09-4dce-a9ba-094818b2f480 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:20.558896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bef658e-ad09-4dce-a9ba-094818b2f480 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:20.559320 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bef658e-ad09-4dce-a9ba-094818b2f480 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:20.618907 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1bef658e-ad09-4dce-a9ba-094818b2f480 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:20.626991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1bef658e-ad09-4dce-a9ba-094818b2f480 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.080407 Oct 28 20:11:20.627550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 450/909] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:20 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:21.351653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0e683346-48eb-4423-9a06-72eaf7a82569 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:21.352168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0e683346-48eb-4423-9a06-72eaf7a82569 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:21.359245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e683346-48eb-4423-9a06-72eaf7a82569 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:21.359721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e683346-48eb-4423-9a06-72eaf7a82569 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:21.360157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e683346-48eb-4423-9a06-72eaf7a82569 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:21.360846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e683346-48eb-4423-9a06-72eaf7a82569 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:21.361296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e683346-48eb-4423-9a06-72eaf7a82569 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:21.361752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e683346-48eb-4423-9a06-72eaf7a82569 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:21.376255 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2ebf5688-add1-4610-abb5-5a4615cdd3d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:21.378437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2ebf5688-add1-4610-abb5-5a4615cdd3d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:21.388423 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ebf5688-add1-4610-abb5-5a4615cdd3d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:21.389344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ebf5688-add1-4610-abb5-5a4615cdd3d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:21.390130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ebf5688-add1-4610-abb5-5a4615cdd3d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:21.391404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ebf5688-add1-4610-abb5-5a4615cdd3d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:21.392246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ebf5688-add1-4610-abb5-5a4615cdd3d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:21.393040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ebf5688-add1-4610-abb5-5a4615cdd3d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:21.424409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2ebf5688-add1-4610-abb5-5a4615cdd3d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052144 Oct 28 20:11:21.424985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 451/910] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:21 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:11:21.494719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0e683346-48eb-4423-9a06-72eaf7a82569 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:21.504431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0e683346-48eb-4423-9a06-72eaf7a82569 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:21.506181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0e683346-48eb-4423-9a06-72eaf7a82569 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:21.507526 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0e683346-48eb-4423-9a06-72eaf7a82569 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.159875 Oct 28 20:11:21.508342 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 460/911] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:21 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:21.649693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b8ff2a2-a7dc-4967-8c2d-1a07214ffa8a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:21.650300 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9b8ff2a2-a7dc-4967-8c2d-1a07214ffa8a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:21.657424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b8ff2a2-a7dc-4967-8c2d-1a07214ffa8a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:21.657909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b8ff2a2-a7dc-4967-8c2d-1a07214ffa8a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:21.658346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b8ff2a2-a7dc-4967-8c2d-1a07214ffa8a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:21.659030 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b8ff2a2-a7dc-4967-8c2d-1a07214ffa8a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:21.659479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b8ff2a2-a7dc-4967-8c2d-1a07214ffa8a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:21.659899 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b8ff2a2-a7dc-4967-8c2d-1a07214ffa8a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:21.721948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9b8ff2a2-a7dc-4967-8c2d-1a07214ffa8a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:21.729514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b8ff2a2-a7dc-4967-8c2d-1a07214ffa8a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.083689 Oct 28 20:11:21.730072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 452/912] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:21 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:22.437630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-838ef004-5cc1-49fa-ab3b-6f85aaeef782 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:22.439676 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-838ef004-5cc1-49fa-ab3b-6f85aaeef782 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:22.446006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838ef004-5cc1-49fa-ab3b-6f85aaeef782 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:22.446481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838ef004-5cc1-49fa-ab3b-6f85aaeef782 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:22.446907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838ef004-5cc1-49fa-ab3b-6f85aaeef782 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:22.447592 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838ef004-5cc1-49fa-ab3b-6f85aaeef782 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:22.448048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838ef004-5cc1-49fa-ab3b-6f85aaeef782 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:22.448464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838ef004-5cc1-49fa-ab3b-6f85aaeef782 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:22.477527 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-838ef004-5cc1-49fa-ab3b-6f85aaeef782 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044530 Oct 28 20:11:22.478069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 461/913] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:22 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:22.533749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e36dabe-f607-42de-a5d9-7c94e85b3ee3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:22.534448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4e36dabe-f607-42de-a5d9-7c94e85b3ee3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:22.540756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e36dabe-f607-42de-a5d9-7c94e85b3ee3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:22.541243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e36dabe-f607-42de-a5d9-7c94e85b3ee3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:22.541721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e36dabe-f607-42de-a5d9-7c94e85b3ee3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:22.542417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e36dabe-f607-42de-a5d9-7c94e85b3ee3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:22.542873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e36dabe-f607-42de-a5d9-7c94e85b3ee3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:22.543299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e36dabe-f607-42de-a5d9-7c94e85b3ee3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:22.676640 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e36dabe-f607-42de-a5d9-7c94e85b3ee3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:22.685293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e36dabe-f607-42de-a5d9-7c94e85b3ee3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:22.687245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e36dabe-f607-42de-a5d9-7c94e85b3ee3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:22.688470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4e36dabe-f607-42de-a5d9-7c94e85b3ee3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.158756 Oct 28 20:11:22.688963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 453/914] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:22 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:22.752001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a25d5548-929e-4617-8562-97c972a1776b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:22.752656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a25d5548-929e-4617-8562-97c972a1776b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:22.758464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a25d5548-929e-4617-8562-97c972a1776b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:22.758939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a25d5548-929e-4617-8562-97c972a1776b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:22.759400 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a25d5548-929e-4617-8562-97c972a1776b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:22.760069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a25d5548-929e-4617-8562-97c972a1776b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:22.760513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a25d5548-929e-4617-8562-97c972a1776b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:22.760927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a25d5548-929e-4617-8562-97c972a1776b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:22.823344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a25d5548-929e-4617-8562-97c972a1776b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:22.831526 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a25d5548-929e-4617-8562-97c972a1776b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.083495 Oct 28 20:11:22.832089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 462/915] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:22 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:23.490138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-83de5f08-90fa-41cd-9554-d850836d2ca0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:23.492278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-83de5f08-90fa-41cd-9554-d850836d2ca0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:23.498300 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83de5f08-90fa-41cd-9554-d850836d2ca0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:23.498778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83de5f08-90fa-41cd-9554-d850836d2ca0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:23.499204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83de5f08-90fa-41cd-9554-d850836d2ca0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:23.499878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83de5f08-90fa-41cd-9554-d850836d2ca0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:23.500324 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83de5f08-90fa-41cd-9554-d850836d2ca0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:23.500740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83de5f08-90fa-41cd-9554-d850836d2ca0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:23.528933 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-83de5f08-90fa-41cd-9554-d850836d2ca0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042767 Oct 28 20:11:23.530099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 454/916] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:23 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:23.713496 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-de44cbc4-5b01-4cdc-9f13-f113622b9525 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:23.714146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-de44cbc4-5b01-4cdc-9f13-f113622b9525 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:23.721969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de44cbc4-5b01-4cdc-9f13-f113622b9525 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:23.722460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de44cbc4-5b01-4cdc-9f13-f113622b9525 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:23.722898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de44cbc4-5b01-4cdc-9f13-f113622b9525 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:23.723597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de44cbc4-5b01-4cdc-9f13-f113622b9525 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:23.724052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de44cbc4-5b01-4cdc-9f13-f113622b9525 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:23.724585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de44cbc4-5b01-4cdc-9f13-f113622b9525 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:23.854774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1b29cc6e-5ffa-47e3-afb5-87be768f2cc0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:23.855200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-de44cbc4-5b01-4cdc-9f13-f113622b9525 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:23.855512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1b29cc6e-5ffa-47e3-afb5-87be768f2cc0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:23.862661 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b29cc6e-5ffa-47e3-afb5-87be768f2cc0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:23.863283 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b29cc6e-5ffa-47e3-afb5-87be768f2cc0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:23.863780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b29cc6e-5ffa-47e3-afb5-87be768f2cc0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:23.864172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-de44cbc4-5b01-4cdc-9f13-f113622b9525 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:23.864651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b29cc6e-5ffa-47e3-afb5-87be768f2cc0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:23.865166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b29cc6e-5ffa-47e3-afb5-87be768f2cc0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:23.865631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-de44cbc4-5b01-4cdc-9f13-f113622b9525 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:23.865757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b29cc6e-5ffa-47e3-afb5-87be768f2cc0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:23.866793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-de44cbc4-5b01-4cdc-9f13-f113622b9525 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.157464 Oct 28 20:11:23.867341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 463/917] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:23 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:23.926313 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1b29cc6e-5ffa-47e3-afb5-87be768f2cc0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:23.933856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1b29cc6e-5ffa-47e3-afb5-87be768f2cc0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.083058 Oct 28 20:11:23.934426 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 455/918] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:23 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:11:24.542172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a0e0c1eb-5fa0-4269-9002-5375f9d7f0a9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:24.544315 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a0e0c1eb-5fa0-4269-9002-5375f9d7f0a9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:24.550341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e0c1eb-5fa0-4269-9002-5375f9d7f0a9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:24.550816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e0c1eb-5fa0-4269-9002-5375f9d7f0a9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:24.551251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e0c1eb-5fa0-4269-9002-5375f9d7f0a9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:24.551926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e0c1eb-5fa0-4269-9002-5375f9d7f0a9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:24.552374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e0c1eb-5fa0-4269-9002-5375f9d7f0a9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:24.552790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e0c1eb-5fa0-4269-9002-5375f9d7f0a9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:24.583026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a0e0c1eb-5fa0-4269-9002-5375f9d7f0a9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044786 Oct 28 20:11:24.583585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 464/919] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:24 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:24.892727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d21f3a96-e2fc-47ea-9cc5-8de7508a0485 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:24.893345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d21f3a96-e2fc-47ea-9cc5-8de7508a0485 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:24.899337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d21f3a96-e2fc-47ea-9cc5-8de7508a0485 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:24.899818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d21f3a96-e2fc-47ea-9cc5-8de7508a0485 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:24.900252 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d21f3a96-e2fc-47ea-9cc5-8de7508a0485 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:24.900928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d21f3a96-e2fc-47ea-9cc5-8de7508a0485 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:24.901401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d21f3a96-e2fc-47ea-9cc5-8de7508a0485 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:24.901825 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d21f3a96-e2fc-47ea-9cc5-8de7508a0485 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:24.956127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-89df53b9-af0b-435b-953c-a89bbca84ef6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:24.956730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-89df53b9-af0b-435b-953c-a89bbca84ef6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:24.963292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89df53b9-af0b-435b-953c-a89bbca84ef6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:24.963771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89df53b9-af0b-435b-953c-a89bbca84ef6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:24.964202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89df53b9-af0b-435b-953c-a89bbca84ef6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:24.964880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89df53b9-af0b-435b-953c-a89bbca84ef6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:24.965372 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89df53b9-af0b-435b-953c-a89bbca84ef6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:24.965765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89df53b9-af0b-435b-953c-a89bbca84ef6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:25.035715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-89df53b9-af0b-435b-953c-a89bbca84ef6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:25.043267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-89df53b9-af0b-435b-953c-a89bbca84ef6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.090963 Oct 28 20:11:25.044070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 465/920] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:24 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:11:25.062351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d21f3a96-e2fc-47ea-9cc5-8de7508a0485 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:25.070787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d21f3a96-e2fc-47ea-9cc5-8de7508a0485 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:25.072207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d21f3a96-e2fc-47ea-9cc5-8de7508a0485 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:25.073371 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d21f3a96-e2fc-47ea-9cc5-8de7508a0485 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.184466 Oct 28 20:11:25.073953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 456/921] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:24 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:25.596380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-275801b8-c7ad-4108-baa0-6909d96e161c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:25.598586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-275801b8-c7ad-4108-baa0-6909d96e161c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:25.604673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-275801b8-c7ad-4108-baa0-6909d96e161c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:25.605143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-275801b8-c7ad-4108-baa0-6909d96e161c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:25.605611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-275801b8-c7ad-4108-baa0-6909d96e161c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:25.606289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-275801b8-c7ad-4108-baa0-6909d96e161c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:25.606731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-275801b8-c7ad-4108-baa0-6909d96e161c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:25.607200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-275801b8-c7ad-4108-baa0-6909d96e161c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:25.636519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-275801b8-c7ad-4108-baa0-6909d96e161c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044880 Oct 28 20:11:25.637384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 466/922] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:25 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:26.067306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-61878144-4db0-47ed-b027-96828f0d2363 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:26.067934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-61878144-4db0-47ed-b027-96828f0d2363 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:26.074494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61878144-4db0-47ed-b027-96828f0d2363 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:26.074981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61878144-4db0-47ed-b027-96828f0d2363 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:26.075426 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61878144-4db0-47ed-b027-96828f0d2363 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:26.076827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61878144-4db0-47ed-b027-96828f0d2363 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:26.077356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61878144-4db0-47ed-b027-96828f0d2363 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:26.077795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61878144-4db0-47ed-b027-96828f0d2363 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:26.098901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-066ee468-956b-4436-a5bd-6b9ccf7ab060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:26.099473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-066ee468-956b-4436-a5bd-6b9ccf7ab060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:26.105696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-066ee468-956b-4436-a5bd-6b9ccf7ab060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:26.106180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-066ee468-956b-4436-a5bd-6b9ccf7ab060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:26.106613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-066ee468-956b-4436-a5bd-6b9ccf7ab060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:26.107322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-066ee468-956b-4436-a5bd-6b9ccf7ab060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:26.107776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-066ee468-956b-4436-a5bd-6b9ccf7ab060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:26.108200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-066ee468-956b-4436-a5bd-6b9ccf7ab060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:26.139712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-61878144-4db0-47ed-b027-96828f0d2363 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:26.147402 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-61878144-4db0-47ed-b027-96828f0d2363 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084100 Oct 28 20:11:26.148166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 457/923] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:26 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:26.237655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-066ee468-956b-4436-a5bd-6b9ccf7ab060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:26.246060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-066ee468-956b-4436-a5bd-6b9ccf7ab060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:26.247515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-066ee468-956b-4436-a5bd-6b9ccf7ab060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:26.249488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-066ee468-956b-4436-a5bd-6b9ccf7ab060 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.154567 Oct 28 20:11:26.250045 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 467/924] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:26 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:11:26.648491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8e6980f3-84c3-4f75-b38e-8380f71666a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:26.650712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8e6980f3-84c3-4f75-b38e-8380f71666a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:26.657582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e6980f3-84c3-4f75-b38e-8380f71666a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:26.658068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e6980f3-84c3-4f75-b38e-8380f71666a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:26.658505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e6980f3-84c3-4f75-b38e-8380f71666a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:26.659197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e6980f3-84c3-4f75-b38e-8380f71666a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:26.659656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e6980f3-84c3-4f75-b38e-8380f71666a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:26.660086 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e6980f3-84c3-4f75-b38e-8380f71666a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:26.662452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:26.691390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8e6980f3-84c3-4f75-b38e-8380f71666a5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046822 Oct 28 20:11:26.691943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 458/925] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:26 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:27.170969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc94c2ec-f356-44ff-b63c-965046dcbf04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:27.171533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bc94c2ec-f356-44ff-b63c-965046dcbf04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:27.177879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc94c2ec-f356-44ff-b63c-965046dcbf04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:27.178357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc94c2ec-f356-44ff-b63c-965046dcbf04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:27.178785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc94c2ec-f356-44ff-b63c-965046dcbf04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:27.179462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc94c2ec-f356-44ff-b63c-965046dcbf04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:27.179908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc94c2ec-f356-44ff-b63c-965046dcbf04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:27.180326 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc94c2ec-f356-44ff-b63c-965046dcbf04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:27.240816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bc94c2ec-f356-44ff-b63c-965046dcbf04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:27.248355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bc94c2ec-f356-44ff-b63c-965046dcbf04 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081880 Oct 28 20:11:27.248906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 468/926] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:27 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:27.275013 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0fb80977-79c2-49a1-a0b6-cb48c0577986 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:27.275624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0fb80977-79c2-49a1-a0b6-cb48c0577986 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:27.282642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fb80977-79c2-49a1-a0b6-cb48c0577986 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:27.283132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fb80977-79c2-49a1-a0b6-cb48c0577986 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:27.283604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fb80977-79c2-49a1-a0b6-cb48c0577986 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:27.284289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fb80977-79c2-49a1-a0b6-cb48c0577986 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:27.284742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fb80977-79c2-49a1-a0b6-cb48c0577986 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:27.285164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fb80977-79c2-49a1-a0b6-cb48c0577986 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:27.411057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0fb80977-79c2-49a1-a0b6-cb48c0577986 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:27.419457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0fb80977-79c2-49a1-a0b6-cb48c0577986 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:27.422188 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0fb80977-79c2-49a1-a0b6-cb48c0577986 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:27.423281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0fb80977-79c2-49a1-a0b6-cb48c0577986 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.152416 Oct 28 20:11:27.423834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 459/927] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:27 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:11:27.703642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-707f48fe-e2d0-4bc9-bb4e-5844ce8c2247 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:27.705820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-707f48fe-e2d0-4bc9-bb4e-5844ce8c2247 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:27.711890 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-707f48fe-e2d0-4bc9-bb4e-5844ce8c2247 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:27.712370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-707f48fe-e2d0-4bc9-bb4e-5844ce8c2247 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:27.712795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-707f48fe-e2d0-4bc9-bb4e-5844ce8c2247 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:27.713502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-707f48fe-e2d0-4bc9-bb4e-5844ce8c2247 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:27.713945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-707f48fe-e2d0-4bc9-bb4e-5844ce8c2247 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:27.714360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-707f48fe-e2d0-4bc9-bb4e-5844ce8c2247 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:27.743694 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-707f48fe-e2d0-4bc9-bb4e-5844ce8c2247 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044495 Oct 28 20:11:27.744231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 469/928] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:27 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:11:28.270084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7364f7e-c496-485f-894a-cb1b0e73ad15 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:28.270617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7364f7e-c496-485f-894a-cb1b0e73ad15 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:28.276564 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7364f7e-c496-485f-894a-cb1b0e73ad15 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:28.277122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7364f7e-c496-485f-894a-cb1b0e73ad15 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:28.277496 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7364f7e-c496-485f-894a-cb1b0e73ad15 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:28.278171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7364f7e-c496-485f-894a-cb1b0e73ad15 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:28.278620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7364f7e-c496-485f-894a-cb1b0e73ad15 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:28.279080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7364f7e-c496-485f-894a-cb1b0e73ad15 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:28.342801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7364f7e-c496-485f-894a-cb1b0e73ad15 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:28.350310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7364f7e-c496-485f-894a-cb1b0e73ad15 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084117 Oct 28 20:11:28.350862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 460/929] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:28 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:28.448759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-640b7422-c129-4e17-aa8a-c9160fc825b9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:28.449393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-640b7422-c129-4e17-aa8a-c9160fc825b9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:28.455981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-640b7422-c129-4e17-aa8a-c9160fc825b9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:28.456460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-640b7422-c129-4e17-aa8a-c9160fc825b9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:28.456897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-640b7422-c129-4e17-aa8a-c9160fc825b9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:28.457609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-640b7422-c129-4e17-aa8a-c9160fc825b9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:28.458066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-640b7422-c129-4e17-aa8a-c9160fc825b9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:28.458520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-640b7422-c129-4e17-aa8a-c9160fc825b9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:28.587117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-640b7422-c129-4e17-aa8a-c9160fc825b9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:28.595972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-640b7422-c129-4e17-aa8a-c9160fc825b9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:28.597417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-640b7422-c129-4e17-aa8a-c9160fc825b9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:28.598559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-640b7422-c129-4e17-aa8a-c9160fc825b9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.153730 Oct 28 20:11:28.599104 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 470/930] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:28 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:28.756213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b81aecdc-1bc9-4961-8f0b-180eb079f5ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:28.758383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b81aecdc-1bc9-4961-8f0b-180eb079f5ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:28.764338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b81aecdc-1bc9-4961-8f0b-180eb079f5ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:28.764823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b81aecdc-1bc9-4961-8f0b-180eb079f5ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:28.765257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b81aecdc-1bc9-4961-8f0b-180eb079f5ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:28.765967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b81aecdc-1bc9-4961-8f0b-180eb079f5ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:28.766424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b81aecdc-1bc9-4961-8f0b-180eb079f5ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:28.766882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b81aecdc-1bc9-4961-8f0b-180eb079f5ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:28.796810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b81aecdc-1bc9-4961-8f0b-180eb079f5ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044453 Oct 28 20:11:28.797288 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 461/931] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:28 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:29.373846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-413c3311-0181-41cb-926c-ceec19869f9f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:29.374406 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-413c3311-0181-41cb-926c-ceec19869f9f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:29.380316 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-413c3311-0181-41cb-926c-ceec19869f9f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:29.380805 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-413c3311-0181-41cb-926c-ceec19869f9f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:29.381244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-413c3311-0181-41cb-926c-ceec19869f9f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:29.381954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-413c3311-0181-41cb-926c-ceec19869f9f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:29.382408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-413c3311-0181-41cb-926c-ceec19869f9f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:29.382834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-413c3311-0181-41cb-926c-ceec19869f9f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:29.446841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-413c3311-0181-41cb-926c-ceec19869f9f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:29.455058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-413c3311-0181-41cb-926c-ceec19869f9f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085462 Oct 28 20:11:29.455791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 471/932] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:29 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:29.624758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5cd85bcd-5ce5-4c52-a5d4-552fffe4c286 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:29.625281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5cd85bcd-5ce5-4c52-a5d4-552fffe4c286 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:29.631593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cd85bcd-5ce5-4c52-a5d4-552fffe4c286 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:29.632073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cd85bcd-5ce5-4c52-a5d4-552fffe4c286 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:29.632512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cd85bcd-5ce5-4c52-a5d4-552fffe4c286 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:29.633193 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cd85bcd-5ce5-4c52-a5d4-552fffe4c286 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:29.633678 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cd85bcd-5ce5-4c52-a5d4-552fffe4c286 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:29.634099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cd85bcd-5ce5-4c52-a5d4-552fffe4c286 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:29.766599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5cd85bcd-5ce5-4c52-a5d4-552fffe4c286 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:29.775012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5cd85bcd-5ce5-4c52-a5d4-552fffe4c286 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:29.776447 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5cd85bcd-5ce5-4c52-a5d4-552fffe4c286 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:29.777709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5cd85bcd-5ce5-4c52-a5d4-552fffe4c286 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.156797 Oct 28 20:11:29.778253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 462/933] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:29 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:29.808110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-25976b82-0859-455d-ae2e-bc40b91cf843 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:29.810866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-25976b82-0859-455d-ae2e-bc40b91cf843 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:29.816965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25976b82-0859-455d-ae2e-bc40b91cf843 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:29.817484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25976b82-0859-455d-ae2e-bc40b91cf843 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:29.817921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25976b82-0859-455d-ae2e-bc40b91cf843 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:29.818600 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25976b82-0859-455d-ae2e-bc40b91cf843 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:29.819050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25976b82-0859-455d-ae2e-bc40b91cf843 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:29.819470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25976b82-0859-455d-ae2e-bc40b91cf843 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:29.849036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-25976b82-0859-455d-ae2e-bc40b91cf843 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045015 Oct 28 20:11:29.849614 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 472/934] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:29 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:30.478154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dc92c4e1-e5fa-4519-b499-771c7019297b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:30.478771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dc92c4e1-e5fa-4519-b499-771c7019297b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:30.484758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc92c4e1-e5fa-4519-b499-771c7019297b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:30.485236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc92c4e1-e5fa-4519-b499-771c7019297b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:30.485700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc92c4e1-e5fa-4519-b499-771c7019297b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:30.486387 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc92c4e1-e5fa-4519-b499-771c7019297b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:30.486841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc92c4e1-e5fa-4519-b499-771c7019297b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:30.487266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc92c4e1-e5fa-4519-b499-771c7019297b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:30.548358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-dc92c4e1-e5fa-4519-b499-771c7019297b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:30.555808 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dc92c4e1-e5fa-4519-b499-771c7019297b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081484 Oct 28 20:11:30.556364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 463/935] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:30 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:30.802947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8c14812-f17f-4fe6-815f-56af71b419b3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:30.803489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b8c14812-f17f-4fe6-815f-56af71b419b3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:30.809946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8c14812-f17f-4fe6-815f-56af71b419b3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:30.811124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8c14812-f17f-4fe6-815f-56af71b419b3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:30.811554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8c14812-f17f-4fe6-815f-56af71b419b3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:30.812230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8c14812-f17f-4fe6-815f-56af71b419b3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:30.812679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8c14812-f17f-4fe6-815f-56af71b419b3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:30.813093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8c14812-f17f-4fe6-815f-56af71b419b3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:30.869737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9ad7d51d-2a60-42d2-931b-97b8873f85c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:30.871987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9ad7d51d-2a60-42d2-931b-97b8873f85c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:30.879100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ad7d51d-2a60-42d2-931b-97b8873f85c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:30.879589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ad7d51d-2a60-42d2-931b-97b8873f85c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:30.880027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ad7d51d-2a60-42d2-931b-97b8873f85c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:30.880730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ad7d51d-2a60-42d2-931b-97b8873f85c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:30.881186 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ad7d51d-2a60-42d2-931b-97b8873f85c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:30.881647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ad7d51d-2a60-42d2-931b-97b8873f85c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:30.913163 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9ad7d51d-2a60-42d2-931b-97b8873f85c8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047492 Oct 28 20:11:30.913763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 464/936] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:30 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:11:30.948147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8c14812-f17f-4fe6-815f-56af71b419b3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:30.956984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8c14812-f17f-4fe6-815f-56af71b419b3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:30.958436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8c14812-f17f-4fe6-815f-56af71b419b3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:30.959838 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b8c14812-f17f-4fe6-815f-56af71b419b3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.160772 Oct 28 20:11:30.960385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 473/937] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:30 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:31.577708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ad2ee006-5cc7-4ed4-86fc-ae7e54c4a83f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:31.578326 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ad2ee006-5cc7-4ed4-86fc-ae7e54c4a83f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:31.584212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad2ee006-5cc7-4ed4-86fc-ae7e54c4a83f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:31.584959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad2ee006-5cc7-4ed4-86fc-ae7e54c4a83f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:31.585420 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad2ee006-5cc7-4ed4-86fc-ae7e54c4a83f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:31.586121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad2ee006-5cc7-4ed4-86fc-ae7e54c4a83f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:31.586572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad2ee006-5cc7-4ed4-86fc-ae7e54c4a83f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:31.586994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad2ee006-5cc7-4ed4-86fc-ae7e54c4a83f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:31.650957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ad2ee006-5cc7-4ed4-86fc-ae7e54c4a83f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:31.659540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ad2ee006-5cc7-4ed4-86fc-ae7e54c4a83f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085825 Oct 28 20:11:31.660105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 465/938] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:31 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:31.926701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-95d194aa-4f5c-4e1d-a032-27ed7cbfd568 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:31.928771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-95d194aa-4f5c-4e1d-a032-27ed7cbfd568 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:31.935101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95d194aa-4f5c-4e1d-a032-27ed7cbfd568 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:31.935581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95d194aa-4f5c-4e1d-a032-27ed7cbfd568 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:31.936018 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95d194aa-4f5c-4e1d-a032-27ed7cbfd568 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:31.936703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95d194aa-4f5c-4e1d-a032-27ed7cbfd568 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:31.937153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95d194aa-4f5c-4e1d-a032-27ed7cbfd568 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:31.937599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95d194aa-4f5c-4e1d-a032-27ed7cbfd568 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:31.967592 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-95d194aa-4f5c-4e1d-a032-27ed7cbfd568 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044937 Oct 28 20:11:31.968134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 474/939] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:31 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:31.985885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e785f77e-6718-4e95-ac0a-6888341c50ff tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:31.986539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e785f77e-6718-4e95-ac0a-6888341c50ff tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:31.992974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e785f77e-6718-4e95-ac0a-6888341c50ff tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:31.993498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e785f77e-6718-4e95-ac0a-6888341c50ff tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:31.993934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e785f77e-6718-4e95-ac0a-6888341c50ff tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:31.994617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e785f77e-6718-4e95-ac0a-6888341c50ff tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:31.995066 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e785f77e-6718-4e95-ac0a-6888341c50ff tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:31.995515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e785f77e-6718-4e95-ac0a-6888341c50ff tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:32.122069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e785f77e-6718-4e95-ac0a-6888341c50ff tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:32.130932 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e785f77e-6718-4e95-ac0a-6888341c50ff tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:32.132414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e785f77e-6718-4e95-ac0a-6888341c50ff tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:32.133682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e785f77e-6718-4e95-ac0a-6888341c50ff tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.151925 Oct 28 20:11:32.134238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 466/940] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:31 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:32.690110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dfe53b33-eee8-4d48-83f8-7d98127f2735 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:32.690641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dfe53b33-eee8-4d48-83f8-7d98127f2735 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:32.696490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfe53b33-eee8-4d48-83f8-7d98127f2735 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:32.696967 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfe53b33-eee8-4d48-83f8-7d98127f2735 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:32.697432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfe53b33-eee8-4d48-83f8-7d98127f2735 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:32.698111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfe53b33-eee8-4d48-83f8-7d98127f2735 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:32.698562 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfe53b33-eee8-4d48-83f8-7d98127f2735 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:32.698985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfe53b33-eee8-4d48-83f8-7d98127f2735 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:32.703427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:32.762309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dfe53b33-eee8-4d48-83f8-7d98127f2735 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:32.770050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dfe53b33-eee8-4d48-83f8-7d98127f2735 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.083862 Oct 28 20:11:32.770610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 475/941] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:32 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:32.979931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4dad91cf-3408-4394-a455-07ff74c964ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:32.982857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4dad91cf-3408-4394-a455-07ff74c964ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:32.988759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4dad91cf-3408-4394-a455-07ff74c964ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:32.989309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4dad91cf-3408-4394-a455-07ff74c964ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:32.989704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4dad91cf-3408-4394-a455-07ff74c964ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:32.990395 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4dad91cf-3408-4394-a455-07ff74c964ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:32.990853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4dad91cf-3408-4394-a455-07ff74c964ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:32.991281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4dad91cf-3408-4394-a455-07ff74c964ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:33.021186 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4dad91cf-3408-4394-a455-07ff74c964ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045196 Oct 28 20:11:33.021777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 467/942] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:32 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:33.160564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e6bfa12-1a4d-403f-ac30-f0e94d6151df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:33.161176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4e6bfa12-1a4d-403f-ac30-f0e94d6151df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:33.167579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e6bfa12-1a4d-403f-ac30-f0e94d6151df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:33.168090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e6bfa12-1a4d-403f-ac30-f0e94d6151df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:33.168526 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e6bfa12-1a4d-403f-ac30-f0e94d6151df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:33.169923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e6bfa12-1a4d-403f-ac30-f0e94d6151df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:33.170439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e6bfa12-1a4d-403f-ac30-f0e94d6151df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:33.170910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e6bfa12-1a4d-403f-ac30-f0e94d6151df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:33.302663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e6bfa12-1a4d-403f-ac30-f0e94d6151df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:33.311200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e6bfa12-1a4d-403f-ac30-f0e94d6151df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:33.312732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e6bfa12-1a4d-403f-ac30-f0e94d6151df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:33.313946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4e6bfa12-1a4d-403f-ac30-f0e94d6151df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.157265 Oct 28 20:11:33.314862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 476/943] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:33 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:33.791984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1af5f186-d3d3-4372-af88-dec9fa188a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:33.792595 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1af5f186-d3d3-4372-af88-dec9fa188a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:33.799123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af5f186-d3d3-4372-af88-dec9fa188a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:33.799599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af5f186-d3d3-4372-af88-dec9fa188a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:33.800031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af5f186-d3d3-4372-af88-dec9fa188a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:33.800707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af5f186-d3d3-4372-af88-dec9fa188a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:33.801155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af5f186-d3d3-4372-af88-dec9fa188a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:33.801597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af5f186-d3d3-4372-af88-dec9fa188a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:33.861454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1af5f186-d3d3-4372-af88-dec9fa188a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:33.868835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1af5f186-d3d3-4372-af88-dec9fa188a0e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.080696 Oct 28 20:11:33.869403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 468/944] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:33 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:34.033352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9895e4fe-c3c8-48ad-aa28-4ce3c15ace70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:34.035505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9895e4fe-c3c8-48ad-aa28-4ce3c15ace70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:34.041369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9895e4fe-c3c8-48ad-aa28-4ce3c15ace70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:34.041853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9895e4fe-c3c8-48ad-aa28-4ce3c15ace70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:34.042334 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9895e4fe-c3c8-48ad-aa28-4ce3c15ace70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:34.042977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9895e4fe-c3c8-48ad-aa28-4ce3c15ace70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:34.043428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9895e4fe-c3c8-48ad-aa28-4ce3c15ace70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:34.043849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9895e4fe-c3c8-48ad-aa28-4ce3c15ace70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:34.072439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9895e4fe-c3c8-48ad-aa28-4ce3c15ace70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043586 Oct 28 20:11:34.072976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 477/945] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:34 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:34.340279 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c7ff3e01-7bce-46fa-98b2-3c4ffe3e3935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:34.340823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c7ff3e01-7bce-46fa-98b2-3c4ffe3e3935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:34.348231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7ff3e01-7bce-46fa-98b2-3c4ffe3e3935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:34.348719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7ff3e01-7bce-46fa-98b2-3c4ffe3e3935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:34.349160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7ff3e01-7bce-46fa-98b2-3c4ffe3e3935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:34.349882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7ff3e01-7bce-46fa-98b2-3c4ffe3e3935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:34.350336 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7ff3e01-7bce-46fa-98b2-3c4ffe3e3935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:34.350761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7ff3e01-7bce-46fa-98b2-3c4ffe3e3935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:34.483284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c7ff3e01-7bce-46fa-98b2-3c4ffe3e3935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:34.492661 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c7ff3e01-7bce-46fa-98b2-3c4ffe3e3935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:34.494065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c7ff3e01-7bce-46fa-98b2-3c4ffe3e3935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:34.495230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c7ff3e01-7bce-46fa-98b2-3c4ffe3e3935 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.159001 Oct 28 20:11:34.495783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 469/946] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:34 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:34.891428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-84583fd9-bfd1-4850-b966-7573747ef357 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:34.892595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-84583fd9-bfd1-4850-b966-7573747ef357 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:34.899026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84583fd9-bfd1-4850-b966-7573747ef357 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:34.899496 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84583fd9-bfd1-4850-b966-7573747ef357 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:34.899926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84583fd9-bfd1-4850-b966-7573747ef357 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:34.900603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84583fd9-bfd1-4850-b966-7573747ef357 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:34.901046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84583fd9-bfd1-4850-b966-7573747ef357 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:34.901502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84583fd9-bfd1-4850-b966-7573747ef357 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:34.964811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-84583fd9-bfd1-4850-b966-7573747ef357 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:34.973241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-84583fd9-bfd1-4850-b966-7573747ef357 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085734 Oct 28 20:11:34.973823 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 478/947] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:34 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:35.085415 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e61eaadd-f6d0-4ce7-8368-b56c08a738dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:35.087580 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e61eaadd-f6d0-4ce7-8368-b56c08a738dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:35.094303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e61eaadd-f6d0-4ce7-8368-b56c08a738dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:35.094777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e61eaadd-f6d0-4ce7-8368-b56c08a738dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:35.095205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e61eaadd-f6d0-4ce7-8368-b56c08a738dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:35.095880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e61eaadd-f6d0-4ce7-8368-b56c08a738dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:35.096329 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e61eaadd-f6d0-4ce7-8368-b56c08a738dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:35.096745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e61eaadd-f6d0-4ce7-8368-b56c08a738dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:35.125218 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e61eaadd-f6d0-4ce7-8368-b56c08a738dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044093 Oct 28 20:11:35.125803 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 470/948] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:35 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:35.521793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-444659e6-6453-49c6-948a-65935e8fff93 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:35.522628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-444659e6-6453-49c6-948a-65935e8fff93 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:35.529439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-444659e6-6453-49c6-948a-65935e8fff93 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:35.529944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-444659e6-6453-49c6-948a-65935e8fff93 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:35.530397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-444659e6-6453-49c6-948a-65935e8fff93 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:35.531136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-444659e6-6453-49c6-948a-65935e8fff93 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:35.531726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-444659e6-6453-49c6-948a-65935e8fff93 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:35.532157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-444659e6-6453-49c6-948a-65935e8fff93 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:35.665307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-444659e6-6453-49c6-948a-65935e8fff93 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:35.673872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-444659e6-6453-49c6-948a-65935e8fff93 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:35.675296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-444659e6-6453-49c6-948a-65935e8fff93 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:35.676437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-444659e6-6453-49c6-948a-65935e8fff93 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.158451 Oct 28 20:11:35.676986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 479/949] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:35 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:35.995694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c3fb44b3-fcd0-410b-97cf-1bc5e1eb217a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:35.996309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c3fb44b3-fcd0-410b-97cf-1bc5e1eb217a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:36.003758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3fb44b3-fcd0-410b-97cf-1bc5e1eb217a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:36.004245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3fb44b3-fcd0-410b-97cf-1bc5e1eb217a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:36.004686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3fb44b3-fcd0-410b-97cf-1bc5e1eb217a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:36.005403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3fb44b3-fcd0-410b-97cf-1bc5e1eb217a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:36.005866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3fb44b3-fcd0-410b-97cf-1bc5e1eb217a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:36.006292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3fb44b3-fcd0-410b-97cf-1bc5e1eb217a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:36.067239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c3fb44b3-fcd0-410b-97cf-1bc5e1eb217a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:36.074760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c3fb44b3-fcd0-410b-97cf-1bc5e1eb217a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082955 Oct 28 20:11:36.075331 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 471/950] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:35 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:36.137667 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3948e3f4-aa28-4212-b404-4c0d84b37e93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:36.139802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3948e3f4-aa28-4212-b404-4c0d84b37e93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:36.146129 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3948e3f4-aa28-4212-b404-4c0d84b37e93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:36.146601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3948e3f4-aa28-4212-b404-4c0d84b37e93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:36.147029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3948e3f4-aa28-4212-b404-4c0d84b37e93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:36.147711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3948e3f4-aa28-4212-b404-4c0d84b37e93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:36.148158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3948e3f4-aa28-4212-b404-4c0d84b37e93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:36.148578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3948e3f4-aa28-4212-b404-4c0d84b37e93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:36.178180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3948e3f4-aa28-4212-b404-4c0d84b37e93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044431 Oct 28 20:11:36.178722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 480/951] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:36 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:36.702294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-14a7bb27-ee58-4397-818f-1d38f775cd9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:36.702910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-14a7bb27-ee58-4397-818f-1d38f775cd9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:36.708786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14a7bb27-ee58-4397-818f-1d38f775cd9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:36.709538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14a7bb27-ee58-4397-818f-1d38f775cd9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:36.710031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14a7bb27-ee58-4397-818f-1d38f775cd9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:36.710718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14a7bb27-ee58-4397-818f-1d38f775cd9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:36.711175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14a7bb27-ee58-4397-818f-1d38f775cd9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:36.711598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14a7bb27-ee58-4397-818f-1d38f775cd9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:36.845428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-14a7bb27-ee58-4397-818f-1d38f775cd9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:36.854355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-14a7bb27-ee58-4397-818f-1d38f775cd9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:36.855779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-14a7bb27-ee58-4397-818f-1d38f775cd9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:36.857905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-14a7bb27-ee58-4397-818f-1d38f775cd9a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.159382 Oct 28 20:11:36.858586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 472/952] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:36 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:37.098199 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5034b2b1-4ce4-4857-8111-a157afe48d05 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:37.098813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5034b2b1-4ce4-4857-8111-a157afe48d05 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:37.104683 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5034b2b1-4ce4-4857-8111-a157afe48d05 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:37.105163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5034b2b1-4ce4-4857-8111-a157afe48d05 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:37.105645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5034b2b1-4ce4-4857-8111-a157afe48d05 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:37.106330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5034b2b1-4ce4-4857-8111-a157afe48d05 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:37.107850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5034b2b1-4ce4-4857-8111-a157afe48d05 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:37.108285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5034b2b1-4ce4-4857-8111-a157afe48d05 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:37.167750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5034b2b1-4ce4-4857-8111-a157afe48d05 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:37.176295 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5034b2b1-4ce4-4857-8111-a157afe48d05 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081911 Oct 28 20:11:37.176919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 481/953] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:37 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:37.190536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f6adc2fb-6ae2-4083-8ad5-81c36031c427 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:37.192731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f6adc2fb-6ae2-4083-8ad5-81c36031c427 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:37.199063 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6adc2fb-6ae2-4083-8ad5-81c36031c427 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:37.199549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6adc2fb-6ae2-4083-8ad5-81c36031c427 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:37.199984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6adc2fb-6ae2-4083-8ad5-81c36031c427 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:37.201352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6adc2fb-6ae2-4083-8ad5-81c36031c427 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:37.201991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6adc2fb-6ae2-4083-8ad5-81c36031c427 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:37.202220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6adc2fb-6ae2-4083-8ad5-81c36031c427 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:37.232681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f6adc2fb-6ae2-4083-8ad5-81c36031c427 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046042 Oct 28 20:11:37.233251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 473/954] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:37 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:37.886036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-90d23f62-3747-4dcb-bf6c-26eba0f57e01 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:37.886651 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-90d23f62-3747-4dcb-bf6c-26eba0f57e01 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:37.893930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d23f62-3747-4dcb-bf6c-26eba0f57e01 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:37.894439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d23f62-3747-4dcb-bf6c-26eba0f57e01 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:37.894885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d23f62-3747-4dcb-bf6c-26eba0f57e01 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:37.895586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d23f62-3747-4dcb-bf6c-26eba0f57e01 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:37.896077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d23f62-3747-4dcb-bf6c-26eba0f57e01 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:37.896513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d23f62-3747-4dcb-bf6c-26eba0f57e01 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:38.030017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-90d23f62-3747-4dcb-bf6c-26eba0f57e01 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:38.039972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-90d23f62-3747-4dcb-bf6c-26eba0f57e01 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:38.041542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-90d23f62-3747-4dcb-bf6c-26eba0f57e01 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:38.042727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-90d23f62-3747-4dcb-bf6c-26eba0f57e01 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.160662 Oct 28 20:11:38.043276 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 482/955] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:37 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:38.198928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a71d30a-c4c4-424f-a98b-af857bf937b4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:38.199545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a71d30a-c4c4-424f-a98b-af857bf937b4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:38.206211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a71d30a-c4c4-424f-a98b-af857bf937b4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:38.206692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a71d30a-c4c4-424f-a98b-af857bf937b4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:38.207136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a71d30a-c4c4-424f-a98b-af857bf937b4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:38.207857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a71d30a-c4c4-424f-a98b-af857bf937b4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:38.208316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a71d30a-c4c4-424f-a98b-af857bf937b4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:38.208744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a71d30a-c4c4-424f-a98b-af857bf937b4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:38.244087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e7eccaec-d6ed-4ac6-b2de-ecc5eb00d1ee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:38.246281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e7eccaec-d6ed-4ac6-b2de-ecc5eb00d1ee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:38.253931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7eccaec-d6ed-4ac6-b2de-ecc5eb00d1ee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:38.254417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7eccaec-d6ed-4ac6-b2de-ecc5eb00d1ee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:38.254855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7eccaec-d6ed-4ac6-b2de-ecc5eb00d1ee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:38.255557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7eccaec-d6ed-4ac6-b2de-ecc5eb00d1ee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:38.256030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7eccaec-d6ed-4ac6-b2de-ecc5eb00d1ee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:38.256439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7eccaec-d6ed-4ac6-b2de-ecc5eb00d1ee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:38.272265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1a71d30a-c4c4-424f-a98b-af857bf937b4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:38.274572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:38.281109 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a71d30a-c4c4-424f-a98b-af857bf937b4 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085949 Oct 28 20:11:38.293540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 474/956] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:38 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:38.293684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e7eccaec-d6ed-4ac6-b2de-ecc5eb00d1ee tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046780 Oct 28 20:11:38.293684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 483/957] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:38 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:11:39.069884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03b97ff5-bb45-4a22-9780-49313127a8f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:39.070505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-03b97ff5-bb45-4a22-9780-49313127a8f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:39.077030 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03b97ff5-bb45-4a22-9780-49313127a8f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:39.077558 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03b97ff5-bb45-4a22-9780-49313127a8f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:39.078001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03b97ff5-bb45-4a22-9780-49313127a8f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:39.078687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03b97ff5-bb45-4a22-9780-49313127a8f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:39.079141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03b97ff5-bb45-4a22-9780-49313127a8f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:39.079570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03b97ff5-bb45-4a22-9780-49313127a8f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:39.202762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-03b97ff5-bb45-4a22-9780-49313127a8f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:39.211865 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-03b97ff5-bb45-4a22-9780-49313127a8f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:39.213352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-03b97ff5-bb45-4a22-9780-49313127a8f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:39.214490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-03b97ff5-bb45-4a22-9780-49313127a8f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.148513 Oct 28 20:11:39.215040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 475/958] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:39 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:39.304474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-22908b5f-fe8d-4969-a0e9-c0c5bc3a6f55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:39.306613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22908b5f-fe8d-4969-a0e9-c0c5bc3a6f55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:39.313894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22908b5f-fe8d-4969-a0e9-c0c5bc3a6f55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:39.314382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22908b5f-fe8d-4969-a0e9-c0c5bc3a6f55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:39.314940 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-043d3b52-13c1-4319-bd79-9d42da8da62b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:39.315080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22908b5f-fe8d-4969-a0e9-c0c5bc3a6f55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:39.315726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-043d3b52-13c1-4319-bd79-9d42da8da62b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:39.315854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22908b5f-fe8d-4969-a0e9-c0c5bc3a6f55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:39.316218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22908b5f-fe8d-4969-a0e9-c0c5bc3a6f55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:39.316642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22908b5f-fe8d-4969-a0e9-c0c5bc3a6f55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:39.322298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043d3b52-13c1-4319-bd79-9d42da8da62b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:39.332543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043d3b52-13c1-4319-bd79-9d42da8da62b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:39.332543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043d3b52-13c1-4319-bd79-9d42da8da62b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:39.332543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043d3b52-13c1-4319-bd79-9d42da8da62b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:39.332543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043d3b52-13c1-4319-bd79-9d42da8da62b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:39.332906 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043d3b52-13c1-4319-bd79-9d42da8da62b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:39.347181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-22908b5f-fe8d-4969-a0e9-c0c5bc3a6f55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046883 Oct 28 20:11:39.347746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 484/959] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:39 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:39.385920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-043d3b52-13c1-4319-bd79-9d42da8da62b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:39.393618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-043d3b52-13c1-4319-bd79-9d42da8da62b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082811 Oct 28 20:11:39.394173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 476/960] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:39 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:11:40.240031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ac131f7b-7287-40ec-8584-f3ded9516517 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:40.240673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ac131f7b-7287-40ec-8584-f3ded9516517 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:40.246728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac131f7b-7287-40ec-8584-f3ded9516517 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:40.247291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac131f7b-7287-40ec-8584-f3ded9516517 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:40.247960 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac131f7b-7287-40ec-8584-f3ded9516517 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:40.248656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac131f7b-7287-40ec-8584-f3ded9516517 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:40.249116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac131f7b-7287-40ec-8584-f3ded9516517 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:40.249575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac131f7b-7287-40ec-8584-f3ded9516517 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:40.360121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c03ae616-f63b-4c15-8e57-94bf14fb4811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:40.362445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c03ae616-f63b-4c15-8e57-94bf14fb4811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:40.368724 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c03ae616-f63b-4c15-8e57-94bf14fb4811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:40.369213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c03ae616-f63b-4c15-8e57-94bf14fb4811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:40.369686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c03ae616-f63b-4c15-8e57-94bf14fb4811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:40.370412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c03ae616-f63b-4c15-8e57-94bf14fb4811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:40.370868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c03ae616-f63b-4c15-8e57-94bf14fb4811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:40.371293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c03ae616-f63b-4c15-8e57-94bf14fb4811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:40.379261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac131f7b-7287-40ec-8584-f3ded9516517 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:40.388331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac131f7b-7287-40ec-8584-f3ded9516517 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:40.389802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac131f7b-7287-40ec-8584-f3ded9516517 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:40.390957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ac131f7b-7287-40ec-8584-f3ded9516517 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.154923 Oct 28 20:11:40.391507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 485/961] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:40 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:40.402244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c03ae616-f63b-4c15-8e57-94bf14fb4811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046519 Oct 28 20:11:40.402800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 477/962] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:40 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:11:40.417845 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0ed05404-8891-4476-b114-40e9e37310bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:40.418452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0ed05404-8891-4476-b114-40e9e37310bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:40.424870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed05404-8891-4476-b114-40e9e37310bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:40.425405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed05404-8891-4476-b114-40e9e37310bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:40.425867 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed05404-8891-4476-b114-40e9e37310bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:40.426548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed05404-8891-4476-b114-40e9e37310bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:40.426996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed05404-8891-4476-b114-40e9e37310bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:40.427413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed05404-8891-4476-b114-40e9e37310bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:40.487697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0ed05404-8891-4476-b114-40e9e37310bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:40.495194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0ed05404-8891-4476-b114-40e9e37310bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081120 Oct 28 20:11:40.495747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 486/963] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:40 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:41.415316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40c80d99-7580-4d1e-9b10-5aba8eccaa5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:41.416512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-76080cd0-df50-4dc6-a9fa-f5be18e98b8f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:41.417122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-76080cd0-df50-4dc6-a9fa-f5be18e98b8f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:41.417498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-40c80d99-7580-4d1e-9b10-5aba8eccaa5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:41.423654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76080cd0-df50-4dc6-a9fa-f5be18e98b8f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:41.423905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40c80d99-7580-4d1e-9b10-5aba8eccaa5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:41.424136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76080cd0-df50-4dc6-a9fa-f5be18e98b8f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:41.424381 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40c80d99-7580-4d1e-9b10-5aba8eccaa5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:41.424574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76080cd0-df50-4dc6-a9fa-f5be18e98b8f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:41.424813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40c80d99-7580-4d1e-9b10-5aba8eccaa5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:41.425261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76080cd0-df50-4dc6-a9fa-f5be18e98b8f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:41.425529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40c80d99-7580-4d1e-9b10-5aba8eccaa5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:41.425744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76080cd0-df50-4dc6-a9fa-f5be18e98b8f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:41.425979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40c80d99-7580-4d1e-9b10-5aba8eccaa5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:41.426166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76080cd0-df50-4dc6-a9fa-f5be18e98b8f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:41.426395 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40c80d99-7580-4d1e-9b10-5aba8eccaa5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:41.457252 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-40c80d99-7580-4d1e-9b10-5aba8eccaa5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045848 Oct 28 20:11:41.457938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 478/964] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:41 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:11:41.518283 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d480ac61-02ff-4c5f-a648-bc19ed2109df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:41.519019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d480ac61-02ff-4c5f-a648-bc19ed2109df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:41.525489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d480ac61-02ff-4c5f-a648-bc19ed2109df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:41.525974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d480ac61-02ff-4c5f-a648-bc19ed2109df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:41.526407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d480ac61-02ff-4c5f-a648-bc19ed2109df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:41.527097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d480ac61-02ff-4c5f-a648-bc19ed2109df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:41.527543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d480ac61-02ff-4c5f-a648-bc19ed2109df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:41.527958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d480ac61-02ff-4c5f-a648-bc19ed2109df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:41.563154 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-76080cd0-df50-4dc6-a9fa-f5be18e98b8f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:41.571733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-76080cd0-df50-4dc6-a9fa-f5be18e98b8f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:41.573222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-76080cd0-df50-4dc6-a9fa-f5be18e98b8f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:41.574434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-76080cd0-df50-4dc6-a9fa-f5be18e98b8f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.161749 Oct 28 20:11:41.574991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 487/965] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:41 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:11:41.594368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d480ac61-02ff-4c5f-a648-bc19ed2109df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:41.601926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d480ac61-02ff-4c5f-a648-bc19ed2109df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.087580 Oct 28 20:11:41.602487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 479/966] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:41 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:11:42.470453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-03b9478c-083b-4379-8631-ff850681319c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:42.472705 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-03b9478c-083b-4379-8631-ff850681319c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:42.479566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b9478c-083b-4379-8631-ff850681319c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:42.480041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b9478c-083b-4379-8631-ff850681319c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:42.480469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b9478c-083b-4379-8631-ff850681319c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:42.481155 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b9478c-083b-4379-8631-ff850681319c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:42.482136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b9478c-083b-4379-8631-ff850681319c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:42.482552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b9478c-083b-4379-8631-ff850681319c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:42.515521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-03b9478c-083b-4379-8631-ff850681319c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049302 Oct 28 20:11:42.516090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 488/967] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:42 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:42.601431 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-57434c8a-0c3a-47b6-970d-fbf98d383f2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:42.601995 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-57434c8a-0c3a-47b6-970d-fbf98d383f2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:42.609827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57434c8a-0c3a-47b6-970d-fbf98d383f2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:42.610316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57434c8a-0c3a-47b6-970d-fbf98d383f2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:42.611023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57434c8a-0c3a-47b6-970d-fbf98d383f2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:42.611727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57434c8a-0c3a-47b6-970d-fbf98d383f2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:42.612189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57434c8a-0c3a-47b6-970d-fbf98d383f2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:42.612613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57434c8a-0c3a-47b6-970d-fbf98d383f2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:42.626013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-51deba51-1ddf-4020-95c7-86a9648e8094 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:42.626624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-51deba51-1ddf-4020-95c7-86a9648e8094 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:42.632621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51deba51-1ddf-4020-95c7-86a9648e8094 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:42.633109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51deba51-1ddf-4020-95c7-86a9648e8094 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:42.633596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51deba51-1ddf-4020-95c7-86a9648e8094 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:42.634273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51deba51-1ddf-4020-95c7-86a9648e8094 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:42.634726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51deba51-1ddf-4020-95c7-86a9648e8094 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:42.635145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51deba51-1ddf-4020-95c7-86a9648e8094 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:42.723644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-51deba51-1ddf-4020-95c7-86a9648e8094 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:42.732195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-51deba51-1ddf-4020-95c7-86a9648e8094 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.110109 Oct 28 20:11:42.732833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 489/968] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:42 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:11:42.785568 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-57434c8a-0c3a-47b6-970d-fbf98d383f2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:42.795386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-57434c8a-0c3a-47b6-970d-fbf98d383f2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:42.796997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-57434c8a-0c3a-47b6-970d-fbf98d383f2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:42.798201 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-57434c8a-0c3a-47b6-970d-fbf98d383f2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.200822 Oct 28 20:11:42.798771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 480/969] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:42 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:43.528148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5b257feb-9b26-410c-9e63-4bba44b4090d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:43.531028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5b257feb-9b26-410c-9e63-4bba44b4090d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:43.538517 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b257feb-9b26-410c-9e63-4bba44b4090d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:43.539001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b257feb-9b26-410c-9e63-4bba44b4090d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:43.539437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b257feb-9b26-410c-9e63-4bba44b4090d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:43.540138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b257feb-9b26-410c-9e63-4bba44b4090d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:43.540594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b257feb-9b26-410c-9e63-4bba44b4090d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:43.541021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b257feb-9b26-410c-9e63-4bba44b4090d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:43.572107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5b257feb-9b26-410c-9e63-4bba44b4090d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047942 Oct 28 20:11:43.572652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 490/970] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:43 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:43.755868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-df1321b3-6aa9-45f1-9f53-6995cab0b61f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:43.756478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-df1321b3-6aa9-45f1-9f53-6995cab0b61f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:43.762836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df1321b3-6aa9-45f1-9f53-6995cab0b61f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:43.763310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df1321b3-6aa9-45f1-9f53-6995cab0b61f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:43.763743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df1321b3-6aa9-45f1-9f53-6995cab0b61f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:43.764443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df1321b3-6aa9-45f1-9f53-6995cab0b61f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:43.764919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df1321b3-6aa9-45f1-9f53-6995cab0b61f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:43.765359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df1321b3-6aa9-45f1-9f53-6995cab0b61f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:43.827008 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-df1321b3-6aa9-45f1-9f53-6995cab0b61f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:43.827999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-88cd0cf3-da8a-4bd9-b339-aee96e13910d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:43.828682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-88cd0cf3-da8a-4bd9-b339-aee96e13910d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:43.834726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88cd0cf3-da8a-4bd9-b339-aee96e13910d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:43.834866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-df1321b3-6aa9-45f1-9f53-6995cab0b61f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082417 Oct 28 20:11:43.835211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88cd0cf3-da8a-4bd9-b339-aee96e13910d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:43.835330 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 481/971] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:43 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:43.835646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88cd0cf3-da8a-4bd9-b339-aee96e13910d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:43.836329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88cd0cf3-da8a-4bd9-b339-aee96e13910d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:43.836781 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88cd0cf3-da8a-4bd9-b339-aee96e13910d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:43.837199 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88cd0cf3-da8a-4bd9-b339-aee96e13910d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:43.968448 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-88cd0cf3-da8a-4bd9-b339-aee96e13910d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:43.971779 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:43.977088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-88cd0cf3-da8a-4bd9-b339-aee96e13910d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:43.981972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-88cd0cf3-da8a-4bd9-b339-aee96e13910d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:43.981972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-88cd0cf3-da8a-4bd9-b339-aee96e13910d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.156101 Oct 28 20:11:43.981972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 491/972] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:43 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:11:44.584830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7aa1991e-6edc-4ce4-9783-ef054c22c844 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:44.587026 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7aa1991e-6edc-4ce4-9783-ef054c22c844 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:44.593487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aa1991e-6edc-4ce4-9783-ef054c22c844 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:44.593938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aa1991e-6edc-4ce4-9783-ef054c22c844 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:44.594375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aa1991e-6edc-4ce4-9783-ef054c22c844 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:44.595067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aa1991e-6edc-4ce4-9783-ef054c22c844 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:44.595523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aa1991e-6edc-4ce4-9783-ef054c22c844 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:44.595952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aa1991e-6edc-4ce4-9783-ef054c22c844 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:44.773973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7aa1991e-6edc-4ce4-9783-ef054c22c844 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193376 Oct 28 20:11:44.774655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 482/973] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:44 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:44.858514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-583245a3-7cf9-40a7-8f6e-625d13ce408a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:44.859059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-583245a3-7cf9-40a7-8f6e-625d13ce408a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:44.865382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-583245a3-7cf9-40a7-8f6e-625d13ce408a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:44.865856 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-583245a3-7cf9-40a7-8f6e-625d13ce408a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:44.866283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-583245a3-7cf9-40a7-8f6e-625d13ce408a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:44.866958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-583245a3-7cf9-40a7-8f6e-625d13ce408a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:44.867402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-583245a3-7cf9-40a7-8f6e-625d13ce408a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:44.867825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-583245a3-7cf9-40a7-8f6e-625d13ce408a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:44.926854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-583245a3-7cf9-40a7-8f6e-625d13ce408a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:44.934370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-583245a3-7cf9-40a7-8f6e-625d13ce408a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.080846 Oct 28 20:11:44.934919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 492/974] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:44 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:45.005332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01c9ac20-d94b-4595-abfc-132d99b753c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:45.005950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-01c9ac20-d94b-4595-abfc-132d99b753c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:45.011757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01c9ac20-d94b-4595-abfc-132d99b753c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:45.012236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01c9ac20-d94b-4595-abfc-132d99b753c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:45.012800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01c9ac20-d94b-4595-abfc-132d99b753c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:45.013690 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01c9ac20-d94b-4595-abfc-132d99b753c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:45.014147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01c9ac20-d94b-4595-abfc-132d99b753c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:45.014631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01c9ac20-d94b-4595-abfc-132d99b753c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:45.144117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-01c9ac20-d94b-4595-abfc-132d99b753c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:45.152780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-01c9ac20-d94b-4595-abfc-132d99b753c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:45.154926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-01c9ac20-d94b-4595-abfc-132d99b753c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:45.156044 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-01c9ac20-d94b-4595-abfc-132d99b753c8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.154594 Oct 28 20:11:45.156590 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 483/975] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:45 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:45.786557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc1099f7-a059-4eab-8aed-7472710bc1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:45.788723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fc1099f7-a059-4eab-8aed-7472710bc1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:45.795050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc1099f7-a059-4eab-8aed-7472710bc1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:45.795535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc1099f7-a059-4eab-8aed-7472710bc1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:45.795979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc1099f7-a059-4eab-8aed-7472710bc1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:45.796673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc1099f7-a059-4eab-8aed-7472710bc1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:45.797132 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc1099f7-a059-4eab-8aed-7472710bc1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:45.797590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc1099f7-a059-4eab-8aed-7472710bc1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:45.828483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fc1099f7-a059-4eab-8aed-7472710bc1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045877 Oct 28 20:11:45.829029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 493/976] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:45 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:45.957084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cf30a48b-d36a-4805-8151-88bf49e54b60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:45.957717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cf30a48b-d36a-4805-8151-88bf49e54b60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:45.964354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf30a48b-d36a-4805-8151-88bf49e54b60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:45.964829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf30a48b-d36a-4805-8151-88bf49e54b60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:45.965258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf30a48b-d36a-4805-8151-88bf49e54b60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:45.966242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf30a48b-d36a-4805-8151-88bf49e54b60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:45.966697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf30a48b-d36a-4805-8151-88bf49e54b60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:45.967117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf30a48b-d36a-4805-8151-88bf49e54b60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:46.026779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-cf30a48b-d36a-4805-8151-88bf49e54b60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:46.034764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cf30a48b-d36a-4805-8151-88bf49e54b60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081434 Oct 28 20:11:46.035322 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 484/977] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:45 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:46.181016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d7be5831-f668-414a-bf84-a01cd25efa59 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:46.181610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d7be5831-f668-414a-bf84-a01cd25efa59 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:46.188644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7be5831-f668-414a-bf84-a01cd25efa59 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:46.189136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7be5831-f668-414a-bf84-a01cd25efa59 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:46.189619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7be5831-f668-414a-bf84-a01cd25efa59 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:46.190312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7be5831-f668-414a-bf84-a01cd25efa59 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:46.190772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7be5831-f668-414a-bf84-a01cd25efa59 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:46.191200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7be5831-f668-414a-bf84-a01cd25efa59 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:46.321927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d7be5831-f668-414a-bf84-a01cd25efa59 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:46.345858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d7be5831-f668-414a-bf84-a01cd25efa59 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:46.347358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d7be5831-f668-414a-bf84-a01cd25efa59 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:46.348610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d7be5831-f668-414a-bf84-a01cd25efa59 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.171554 Oct 28 20:11:46.349181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 494/978] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:46 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:46.841303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-49b8ec71-11ba-4ead-92b9-9ae19818c0a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:46.843618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-49b8ec71-11ba-4ead-92b9-9ae19818c0a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:46.849631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b8ec71-11ba-4ead-92b9-9ae19818c0a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:46.850116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b8ec71-11ba-4ead-92b9-9ae19818c0a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:46.850558 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b8ec71-11ba-4ead-92b9-9ae19818c0a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:46.851249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b8ec71-11ba-4ead-92b9-9ae19818c0a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:46.851707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b8ec71-11ba-4ead-92b9-9ae19818c0a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:46.852139 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b8ec71-11ba-4ead-92b9-9ae19818c0a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:46.881674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-49b8ec71-11ba-4ead-92b9-9ae19818c0a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044832 Oct 28 20:11:46.882220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 485/979] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:46 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:47.057010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c0321f97-a097-4703-9f81-52730d58e2ea tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:47.057690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c0321f97-a097-4703-9f81-52730d58e2ea tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:47.064310 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0321f97-a097-4703-9f81-52730d58e2ea tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:47.064799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0321f97-a097-4703-9f81-52730d58e2ea tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:47.065243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0321f97-a097-4703-9f81-52730d58e2ea tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:47.065964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0321f97-a097-4703-9f81-52730d58e2ea tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:47.066421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0321f97-a097-4703-9f81-52730d58e2ea tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:47.066854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0321f97-a097-4703-9f81-52730d58e2ea tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:47.127211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c0321f97-a097-4703-9f81-52730d58e2ea tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:47.134874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c0321f97-a097-4703-9f81-52730d58e2ea tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081791 Oct 28 20:11:47.135436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 495/980] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:47 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:47.374427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9eb957be-f2ba-4b35-b365-364abf93648d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:47.379815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9eb957be-f2ba-4b35-b365-364abf93648d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:47.381663 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9eb957be-f2ba-4b35-b365-364abf93648d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:47.382151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9eb957be-f2ba-4b35-b365-364abf93648d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:47.382596 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9eb957be-f2ba-4b35-b365-364abf93648d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:47.383287 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9eb957be-f2ba-4b35-b365-364abf93648d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:47.383747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9eb957be-f2ba-4b35-b365-364abf93648d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:47.384173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9eb957be-f2ba-4b35-b365-364abf93648d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:47.517256 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9eb957be-f2ba-4b35-b365-364abf93648d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:47.525724 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9eb957be-f2ba-4b35-b365-364abf93648d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:47.527161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9eb957be-f2ba-4b35-b365-364abf93648d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:47.529072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9eb957be-f2ba-4b35-b365-364abf93648d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.158859 Oct 28 20:11:47.529748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 486/981] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:47 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:47.895170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-adf33be0-8e77-41cf-8efc-2000be3eef41 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:47.897601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-adf33be0-8e77-41cf-8efc-2000be3eef41 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:47.899420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=82 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:47.904850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adf33be0-8e77-41cf-8efc-2000be3eef41 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:47.905350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adf33be0-8e77-41cf-8efc-2000be3eef41 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:47.905790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adf33be0-8e77-41cf-8efc-2000be3eef41 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:47.906481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adf33be0-8e77-41cf-8efc-2000be3eef41 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:47.906938 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adf33be0-8e77-41cf-8efc-2000be3eef41 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:47.907362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adf33be0-8e77-41cf-8efc-2000be3eef41 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:47.936886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-adf33be0-8e77-41cf-8efc-2000be3eef41 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046161 Oct 28 20:11:47.937467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 496/982] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:47 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:48.157665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bdc9ce11-ee86-469a-8704-8cca7c22ae11 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:48.158218 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bdc9ce11-ee86-469a-8704-8cca7c22ae11 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:48.164065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdc9ce11-ee86-469a-8704-8cca7c22ae11 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:48.164551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdc9ce11-ee86-469a-8704-8cca7c22ae11 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:48.164990 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdc9ce11-ee86-469a-8704-8cca7c22ae11 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:48.165717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdc9ce11-ee86-469a-8704-8cca7c22ae11 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:48.166191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdc9ce11-ee86-469a-8704-8cca7c22ae11 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:48.166608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdc9ce11-ee86-469a-8704-8cca7c22ae11 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:48.227022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bdc9ce11-ee86-469a-8704-8cca7c22ae11 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:48.234651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bdc9ce11-ee86-469a-8704-8cca7c22ae11 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081371 Oct 28 20:11:48.235196 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 487/983] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:48 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:48.555773 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9c5010ea-593f-4bfb-b322-1ef86c8ec64d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:48.556381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9c5010ea-593f-4bfb-b322-1ef86c8ec64d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:48.563129 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c5010ea-593f-4bfb-b322-1ef86c8ec64d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:48.563610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c5010ea-593f-4bfb-b322-1ef86c8ec64d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:48.564046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c5010ea-593f-4bfb-b322-1ef86c8ec64d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:48.564726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c5010ea-593f-4bfb-b322-1ef86c8ec64d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:48.565175 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c5010ea-593f-4bfb-b322-1ef86c8ec64d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:48.565627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c5010ea-593f-4bfb-b322-1ef86c8ec64d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:48.692890 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9c5010ea-593f-4bfb-b322-1ef86c8ec64d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:48.702054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9c5010ea-593f-4bfb-b322-1ef86c8ec64d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:48.703561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9c5010ea-593f-4bfb-b322-1ef86c8ec64d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:48.704813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9c5010ea-593f-4bfb-b322-1ef86c8ec64d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.152984 Oct 28 20:11:48.705755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 497/984] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:48 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:48.948836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-af7b56f6-5bf0-4e45-9c1b-11ae85ee4bdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:48.951441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-af7b56f6-5bf0-4e45-9c1b-11ae85ee4bdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:48.957772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af7b56f6-5bf0-4e45-9c1b-11ae85ee4bdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:48.958262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af7b56f6-5bf0-4e45-9c1b-11ae85ee4bdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:48.958705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af7b56f6-5bf0-4e45-9c1b-11ae85ee4bdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:48.959658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af7b56f6-5bf0-4e45-9c1b-11ae85ee4bdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:48.960116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af7b56f6-5bf0-4e45-9c1b-11ae85ee4bdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:48.960544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af7b56f6-5bf0-4e45-9c1b-11ae85ee4bdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:48.992715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-af7b56f6-5bf0-4e45-9c1b-11ae85ee4bdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047796 Oct 28 20:11:48.993250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 488/985] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:48 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:49.257882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-44e2fcd9-01fb-42b3-a062-5ad62a11ad4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:49.258439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-44e2fcd9-01fb-42b3-a062-5ad62a11ad4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:49.265373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44e2fcd9-01fb-42b3-a062-5ad62a11ad4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:49.270665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44e2fcd9-01fb-42b3-a062-5ad62a11ad4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:49.270665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44e2fcd9-01fb-42b3-a062-5ad62a11ad4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:49.270665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44e2fcd9-01fb-42b3-a062-5ad62a11ad4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:49.270665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44e2fcd9-01fb-42b3-a062-5ad62a11ad4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:49.271120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44e2fcd9-01fb-42b3-a062-5ad62a11ad4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:49.330087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-44e2fcd9-01fb-42b3-a062-5ad62a11ad4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:49.338020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-44e2fcd9-01fb-42b3-a062-5ad62a11ad4f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084035 Oct 28 20:11:49.338579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 498/986] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:49 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:49.730892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-436bd35f-b0cc-4568-89d0-954d1c9f4d7f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:49.732376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-436bd35f-b0cc-4568-89d0-954d1c9f4d7f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:49.738349 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436bd35f-b0cc-4568-89d0-954d1c9f4d7f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:49.738833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436bd35f-b0cc-4568-89d0-954d1c9f4d7f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:49.739270 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436bd35f-b0cc-4568-89d0-954d1c9f4d7f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:49.739954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436bd35f-b0cc-4568-89d0-954d1c9f4d7f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:49.740440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436bd35f-b0cc-4568-89d0-954d1c9f4d7f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:49.740865 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436bd35f-b0cc-4568-89d0-954d1c9f4d7f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:49.870079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-436bd35f-b0cc-4568-89d0-954d1c9f4d7f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:49.878748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-436bd35f-b0cc-4568-89d0-954d1c9f4d7f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:49.880216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-436bd35f-b0cc-4568-89d0-954d1c9f4d7f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:49.881397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-436bd35f-b0cc-4568-89d0-954d1c9f4d7f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.154356 Oct 28 20:11:49.881944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 489/987] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:49 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:50.005584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2e9602b6-8f58-4ffb-bfb6-77645643a80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:50.007783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2e9602b6-8f58-4ffb-bfb6-77645643a80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:50.014648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e9602b6-8f58-4ffb-bfb6-77645643a80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:50.015134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e9602b6-8f58-4ffb-bfb6-77645643a80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:50.015574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e9602b6-8f58-4ffb-bfb6-77645643a80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:50.016270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e9602b6-8f58-4ffb-bfb6-77645643a80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:50.016730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e9602b6-8f58-4ffb-bfb6-77645643a80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:50.017156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e9602b6-8f58-4ffb-bfb6-77645643a80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:50.048151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2e9602b6-8f58-4ffb-bfb6-77645643a80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046484 Oct 28 20:11:50.048708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 499/988] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:50 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:50.362067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d478541b-11a5-4a3f-9d38-d7bf7d4a8e6f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:50.362710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d478541b-11a5-4a3f-9d38-d7bf7d4a8e6f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:50.364953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=84 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:50.369586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d478541b-11a5-4a3f-9d38-d7bf7d4a8e6f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:50.370070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d478541b-11a5-4a3f-9d38-d7bf7d4a8e6f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:50.370507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d478541b-11a5-4a3f-9d38-d7bf7d4a8e6f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:50.371192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d478541b-11a5-4a3f-9d38-d7bf7d4a8e6f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:50.371646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d478541b-11a5-4a3f-9d38-d7bf7d4a8e6f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:50.372069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d478541b-11a5-4a3f-9d38-d7bf7d4a8e6f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:50.432757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d478541b-11a5-4a3f-9d38-d7bf7d4a8e6f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:50.440312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d478541b-11a5-4a3f-9d38-d7bf7d4a8e6f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082084 Oct 28 20:11:50.440860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 490/989] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:50 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:50.906518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d2ccd911-b41f-459b-803c-9943823bf596 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:50.907064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d2ccd911-b41f-459b-803c-9943823bf596 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:50.913520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2ccd911-b41f-459b-803c-9943823bf596 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:50.913999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2ccd911-b41f-459b-803c-9943823bf596 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:50.914435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2ccd911-b41f-459b-803c-9943823bf596 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:50.915119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2ccd911-b41f-459b-803c-9943823bf596 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:50.915570 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2ccd911-b41f-459b-803c-9943823bf596 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:50.915991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2ccd911-b41f-459b-803c-9943823bf596 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:51.046382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d2ccd911-b41f-459b-803c-9943823bf596 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:51.054828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d2ccd911-b41f-459b-803c-9943823bf596 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:51.056271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d2ccd911-b41f-459b-803c-9943823bf596 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:51.057459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d2ccd911-b41f-459b-803c-9943823bf596 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.155038 Oct 28 20:11:51.058007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 500/990] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:50 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:51.061253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ce57b5b-4298-43c8-b51d-9a9dd5008500 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:51.063126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5ce57b5b-4298-43c8-b51d-9a9dd5008500 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:51.069263 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce57b5b-4298-43c8-b51d-9a9dd5008500 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:51.069780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce57b5b-4298-43c8-b51d-9a9dd5008500 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:51.070224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce57b5b-4298-43c8-b51d-9a9dd5008500 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:51.070927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce57b5b-4298-43c8-b51d-9a9dd5008500 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:51.071384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce57b5b-4298-43c8-b51d-9a9dd5008500 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:51.071815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce57b5b-4298-43c8-b51d-9a9dd5008500 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:51.087174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:51.103361 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5ce57b5b-4298-43c8-b51d-9a9dd5008500 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047241 Oct 28 20:11:51.111763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 491/991] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:51 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:51.464002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9775a669-311a-41e5-99d7-204ece879d52 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:51.464617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9775a669-311a-41e5-99d7-204ece879d52 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:51.470759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9775a669-311a-41e5-99d7-204ece879d52 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:51.471245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9775a669-311a-41e5-99d7-204ece879d52 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:51.471687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9775a669-311a-41e5-99d7-204ece879d52 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:51.472381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9775a669-311a-41e5-99d7-204ece879d52 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:51.472833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9775a669-311a-41e5-99d7-204ece879d52 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:51.473260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9775a669-311a-41e5-99d7-204ece879d52 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:51.533280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9775a669-311a-41e5-99d7-204ece879d52 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:51.540937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9775a669-311a-41e5-99d7-204ece879d52 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.080792 Oct 28 20:11:51.541562 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 501/992] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:51 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:52.083885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-22e2f364-97f8-41c1-813d-a624120ca164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:52.084755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22e2f364-97f8-41c1-813d-a624120ca164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:52.091405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e2f364-97f8-41c1-813d-a624120ca164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:52.091896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e2f364-97f8-41c1-813d-a624120ca164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:52.092334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e2f364-97f8-41c1-813d-a624120ca164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:52.093025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e2f364-97f8-41c1-813d-a624120ca164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:52.093512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e2f364-97f8-41c1-813d-a624120ca164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:52.093941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e2f364-97f8-41c1-813d-a624120ca164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:52.122830 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6027146b-98b2-4e36-ab49-f590e7bcf116 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:52.124971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6027146b-98b2-4e36-ab49-f590e7bcf116 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:52.131774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6027146b-98b2-4e36-ab49-f590e7bcf116 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:52.132244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6027146b-98b2-4e36-ab49-f590e7bcf116 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:52.132674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6027146b-98b2-4e36-ab49-f590e7bcf116 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:52.133372 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6027146b-98b2-4e36-ab49-f590e7bcf116 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:52.133830 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6027146b-98b2-4e36-ab49-f590e7bcf116 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:52.134245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6027146b-98b2-4e36-ab49-f590e7bcf116 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:52.164247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6027146b-98b2-4e36-ab49-f590e7bcf116 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045820 Oct 28 20:11:52.164801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 502/993] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:52 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:11:52.222254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-22e2f364-97f8-41c1-813d-a624120ca164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:52.230604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-22e2f364-97f8-41c1-813d-a624120ca164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:52.232650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-22e2f364-97f8-41c1-813d-a624120ca164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:52.233820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-22e2f364-97f8-41c1-813d-a624120ca164 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.154272 Oct 28 20:11:52.234360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 492/994] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:52 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:52.564642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4add5374-4858-487a-8458-fdba85bd8b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:52.565259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4add5374-4858-487a-8458-fdba85bd8b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:52.571164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4add5374-4858-487a-8458-fdba85bd8b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:52.571639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4add5374-4858-487a-8458-fdba85bd8b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:52.572068 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4add5374-4858-487a-8458-fdba85bd8b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:52.572748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4add5374-4858-487a-8458-fdba85bd8b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:52.573197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4add5374-4858-487a-8458-fdba85bd8b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:52.573642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4add5374-4858-487a-8458-fdba85bd8b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:52.858331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4add5374-4858-487a-8458-fdba85bd8b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:52.866449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4add5374-4858-487a-8458-fdba85bd8b49 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.305626 Oct 28 20:11:52.867157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 503/995] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:52 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:11:53.176723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-488504ae-5eea-45ca-b7bb-7599a1d56415 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:53.178906 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-488504ae-5eea-45ca-b7bb-7599a1d56415 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:53.186223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-488504ae-5eea-45ca-b7bb-7599a1d56415 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:53.186705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-488504ae-5eea-45ca-b7bb-7599a1d56415 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:53.187138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-488504ae-5eea-45ca-b7bb-7599a1d56415 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:53.187819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-488504ae-5eea-45ca-b7bb-7599a1d56415 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:53.188272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-488504ae-5eea-45ca-b7bb-7599a1d56415 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:53.188694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-488504ae-5eea-45ca-b7bb-7599a1d56415 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:53.217556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-488504ae-5eea-45ca-b7bb-7599a1d56415 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044761 Oct 28 20:11:53.218103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 493/996] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:53 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:11:53.260095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-df29a79d-679a-420a-a850-87b20208bd85 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:53.260708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-df29a79d-679a-420a-a850-87b20208bd85 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:53.267238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df29a79d-679a-420a-a850-87b20208bd85 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:53.267749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df29a79d-679a-420a-a850-87b20208bd85 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:53.268181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df29a79d-679a-420a-a850-87b20208bd85 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:53.268869 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df29a79d-679a-420a-a850-87b20208bd85 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:53.269344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df29a79d-679a-420a-a850-87b20208bd85 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:53.269816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df29a79d-679a-420a-a850-87b20208bd85 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:53.399209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-df29a79d-679a-420a-a850-87b20208bd85 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:53.408746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-df29a79d-679a-420a-a850-87b20208bd85 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:53.410232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-df29a79d-679a-420a-a850-87b20208bd85 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:53.411390 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-df29a79d-679a-420a-a850-87b20208bd85 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.155270 Oct 28 20:11:53.411942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 504/997] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:53 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:53.890228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7dc3e58f-52b4-44a0-a031-3ac1ac21e201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:53.890839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7dc3e58f-52b4-44a0-a031-3ac1ac21e201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:53.896577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc3e58f-52b4-44a0-a031-3ac1ac21e201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:53.897057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc3e58f-52b4-44a0-a031-3ac1ac21e201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:53.897520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc3e58f-52b4-44a0-a031-3ac1ac21e201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:53.898200 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc3e58f-52b4-44a0-a031-3ac1ac21e201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:53.898657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc3e58f-52b4-44a0-a031-3ac1ac21e201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:53.899074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc3e58f-52b4-44a0-a031-3ac1ac21e201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:53.959969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7dc3e58f-52b4-44a0-a031-3ac1ac21e201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:53.968603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7dc3e58f-52b4-44a0-a031-3ac1ac21e201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082767 Oct 28 20:11:53.969156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 494/998] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:53 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:54.229102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dedc5ebc-7523-460f-8e88-a9d8ab675bba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:54.231298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dedc5ebc-7523-460f-8e88-a9d8ab675bba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:54.237169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dedc5ebc-7523-460f-8e88-a9d8ab675bba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:54.237678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dedc5ebc-7523-460f-8e88-a9d8ab675bba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:54.238109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dedc5ebc-7523-460f-8e88-a9d8ab675bba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:54.238782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dedc5ebc-7523-460f-8e88-a9d8ab675bba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:54.239227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dedc5ebc-7523-460f-8e88-a9d8ab675bba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:54.239643 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dedc5ebc-7523-460f-8e88-a9d8ab675bba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:54.269741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dedc5ebc-7523-460f-8e88-a9d8ab675bba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Oct 28 20:11:54.270317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 505/999] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:54 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:54.438220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1df6934b-f344-4e72-a586-ab812c330772 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:54.438758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1df6934b-f344-4e72-a586-ab812c330772 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:54.444634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1df6934b-f344-4e72-a586-ab812c330772 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:54.445119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1df6934b-f344-4e72-a586-ab812c330772 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:54.445589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1df6934b-f344-4e72-a586-ab812c330772 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:54.446268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1df6934b-f344-4e72-a586-ab812c330772 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:54.446723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1df6934b-f344-4e72-a586-ab812c330772 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:54.447145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1df6934b-f344-4e72-a586-ab812c330772 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:54.574533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1df6934b-f344-4e72-a586-ab812c330772 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:54.583096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1df6934b-f344-4e72-a586-ab812c330772 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:54.584790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1df6934b-f344-4e72-a586-ab812c330772 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:54.585972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1df6934b-f344-4e72-a586-ab812c330772 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.152546 Oct 28 20:11:54.595328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 495/1000] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:54 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:54.990608 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5dd2f8cd-a979-4547-8c29-144caf10d38d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:54.991212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5dd2f8cd-a979-4547-8c29-144caf10d38d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:54.997581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dd2f8cd-a979-4547-8c29-144caf10d38d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:54.998058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dd2f8cd-a979-4547-8c29-144caf10d38d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:54.998486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dd2f8cd-a979-4547-8c29-144caf10d38d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:54.999165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dd2f8cd-a979-4547-8c29-144caf10d38d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:54.999609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dd2f8cd-a979-4547-8c29-144caf10d38d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:55.000203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dd2f8cd-a979-4547-8c29-144caf10d38d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:55.061348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5dd2f8cd-a979-4547-8c29-144caf10d38d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:55.068922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5dd2f8cd-a979-4547-8c29-144caf10d38d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082053 Oct 28 20:11:55.069497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 506/1001] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:54 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:55.282414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d4950e98-2b01-4f4f-9da6-dfe759eb2df5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:55.284593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d4950e98-2b01-4f4f-9da6-dfe759eb2df5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:55.290658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4950e98-2b01-4f4f-9da6-dfe759eb2df5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:55.291147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4950e98-2b01-4f4f-9da6-dfe759eb2df5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:55.291590 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4950e98-2b01-4f4f-9da6-dfe759eb2df5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:55.292281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4950e98-2b01-4f4f-9da6-dfe759eb2df5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:55.292736 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4950e98-2b01-4f4f-9da6-dfe759eb2df5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:55.293164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4950e98-2b01-4f4f-9da6-dfe759eb2df5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:55.322337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d4950e98-2b01-4f4f-9da6-dfe759eb2df5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044701 Oct 28 20:11:55.322813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 496/1002] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:55 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:55.619188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b0b10fc3-a72a-4169-b009-dd290f375a28 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:55.619720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b0b10fc3-a72a-4169-b009-dd290f375a28 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:55.627059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0b10fc3-a72a-4169-b009-dd290f375a28 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:55.631320 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0b10fc3-a72a-4169-b009-dd290f375a28 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:55.631320 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0b10fc3-a72a-4169-b009-dd290f375a28 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:55.631320 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0b10fc3-a72a-4169-b009-dd290f375a28 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:55.631320 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0b10fc3-a72a-4169-b009-dd290f375a28 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:55.631783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0b10fc3-a72a-4169-b009-dd290f375a28 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:55.765432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b0b10fc3-a72a-4169-b009-dd290f375a28 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:55.773855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b0b10fc3-a72a-4169-b009-dd290f375a28 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:55.775300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b0b10fc3-a72a-4169-b009-dd290f375a28 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:55.776462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b0b10fc3-a72a-4169-b009-dd290f375a28 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.161371 Oct 28 20:11:55.777014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 507/1003] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:55 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:56.091253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0b7fadb7-e555-4719-90e0-632e6f352adf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:56.091857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0b7fadb7-e555-4719-90e0-632e6f352adf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:56.098048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b7fadb7-e555-4719-90e0-632e6f352adf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:56.098525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b7fadb7-e555-4719-90e0-632e6f352adf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:56.098952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b7fadb7-e555-4719-90e0-632e6f352adf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:56.099645 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b7fadb7-e555-4719-90e0-632e6f352adf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:56.100083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b7fadb7-e555-4719-90e0-632e6f352adf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:56.100499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b7fadb7-e555-4719-90e0-632e6f352adf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:56.159851 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0b7fadb7-e555-4719-90e0-632e6f352adf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:56.167301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0b7fadb7-e555-4719-90e0-632e6f352adf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.079863 Oct 28 20:11:56.167847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 497/1004] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:56 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:56.335690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d9293b18-d0b2-4e61-9f44-68bf78f2fcdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:56.337953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d9293b18-d0b2-4e61-9f44-68bf78f2fcdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:56.344421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9293b18-d0b2-4e61-9f44-68bf78f2fcdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:56.344893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9293b18-d0b2-4e61-9f44-68bf78f2fcdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:56.345344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9293b18-d0b2-4e61-9f44-68bf78f2fcdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:56.346020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9293b18-d0b2-4e61-9f44-68bf78f2fcdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:56.346470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9293b18-d0b2-4e61-9f44-68bf78f2fcdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:56.346886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9293b18-d0b2-4e61-9f44-68bf78f2fcdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:56.364652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:56.376172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d9293b18-d0b2-4e61-9f44-68bf78f2fcdc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Oct 28 20:11:56.376709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 508/1005] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:56 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:56.802180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5cdac86c-73e6-49af-acc8-a8e4a9d38e69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:56.802791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5cdac86c-73e6-49af-acc8-a8e4a9d38e69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:56.808621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cdac86c-73e6-49af-acc8-a8e4a9d38e69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:56.809100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cdac86c-73e6-49af-acc8-a8e4a9d38e69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:56.809574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cdac86c-73e6-49af-acc8-a8e4a9d38e69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:56.810286 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cdac86c-73e6-49af-acc8-a8e4a9d38e69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:56.810740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cdac86c-73e6-49af-acc8-a8e4a9d38e69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:56.811160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cdac86c-73e6-49af-acc8-a8e4a9d38e69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:56.937483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5cdac86c-73e6-49af-acc8-a8e4a9d38e69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:56.945935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5cdac86c-73e6-49af-acc8-a8e4a9d38e69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:56.947368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5cdac86c-73e6-49af-acc8-a8e4a9d38e69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:56.948508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5cdac86c-73e6-49af-acc8-a8e4a9d38e69 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.150218 Oct 28 20:11:56.949069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 498/1006] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:56 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:57.190887 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4eb4fdf9-dcdc-46ee-a4ac-61bdf28854b0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:57.191501 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4eb4fdf9-dcdc-46ee-a4ac-61bdf28854b0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:57.197998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eb4fdf9-dcdc-46ee-a4ac-61bdf28854b0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:57.198483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eb4fdf9-dcdc-46ee-a4ac-61bdf28854b0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:57.198921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eb4fdf9-dcdc-46ee-a4ac-61bdf28854b0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:57.199689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eb4fdf9-dcdc-46ee-a4ac-61bdf28854b0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:57.200175 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eb4fdf9-dcdc-46ee-a4ac-61bdf28854b0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:57.200598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eb4fdf9-dcdc-46ee-a4ac-61bdf28854b0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:57.260471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4eb4fdf9-dcdc-46ee-a4ac-61bdf28854b0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:57.268133 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4eb4fdf9-dcdc-46ee-a4ac-61bdf28854b0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081389 Oct 28 20:11:57.268688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 509/1007] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:57 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:57.388469 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d431365-a94e-4937-b142-acadb9f2d23b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:57.390549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6d431365-a94e-4937-b142-acadb9f2d23b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:57.396876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d431365-a94e-4937-b142-acadb9f2d23b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:57.397400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d431365-a94e-4937-b142-acadb9f2d23b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:57.397839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d431365-a94e-4937-b142-acadb9f2d23b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:57.398521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d431365-a94e-4937-b142-acadb9f2d23b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:57.398972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d431365-a94e-4937-b142-acadb9f2d23b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:57.399394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d431365-a94e-4937-b142-acadb9f2d23b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:57.428710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6d431365-a94e-4937-b142-acadb9f2d23b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044290 Oct 28 20:11:57.429252 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 499/1008] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:57 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:57.978215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5ede8b46-5d54-4e9b-95ab-ce4b7676e0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:57.979100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5ede8b46-5d54-4e9b-95ab-ce4b7676e0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:57.986066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ede8b46-5d54-4e9b-95ab-ce4b7676e0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:57.986804 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ede8b46-5d54-4e9b-95ab-ce4b7676e0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:57.987236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ede8b46-5d54-4e9b-95ab-ce4b7676e0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:57.987916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ede8b46-5d54-4e9b-95ab-ce4b7676e0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:57.988369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ede8b46-5d54-4e9b-95ab-ce4b7676e0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:57.988781 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ede8b46-5d54-4e9b-95ab-ce4b7676e0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:58.132920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5ede8b46-5d54-4e9b-95ab-ce4b7676e0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:58.142567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5ede8b46-5d54-4e9b-95ab-ce4b7676e0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:58.144109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5ede8b46-5d54-4e9b-95ab-ce4b7676e0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:58.145448 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5ede8b46-5d54-4e9b-95ab-ce4b7676e0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.172477 Oct 28 20:11:58.146080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 510/1009] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:57 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:58.290446 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-93d54ca7-08b3-4443-b828-32326fb26c60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:58.290972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-93d54ca7-08b3-4443-b828-32326fb26c60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:58.296955 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93d54ca7-08b3-4443-b828-32326fb26c60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:58.297473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93d54ca7-08b3-4443-b828-32326fb26c60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:58.297906 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93d54ca7-08b3-4443-b828-32326fb26c60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:58.298580 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93d54ca7-08b3-4443-b828-32326fb26c60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:58.299029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93d54ca7-08b3-4443-b828-32326fb26c60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:58.299444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93d54ca7-08b3-4443-b828-32326fb26c60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:58.358777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-93d54ca7-08b3-4443-b828-32326fb26c60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:58.366289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-93d54ca7-08b3-4443-b828-32326fb26c60 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.079747 Oct 28 20:11:58.366839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 500/1010] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:58 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:58.441082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a7642ee0-196f-45a4-b747-09abde641ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:58.443263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a7642ee0-196f-45a4-b747-09abde641ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:58.450215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7642ee0-196f-45a4-b747-09abde641ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:58.450714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7642ee0-196f-45a4-b747-09abde641ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:58.451151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7642ee0-196f-45a4-b747-09abde641ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:58.451837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7642ee0-196f-45a4-b747-09abde641ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:58.452292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7642ee0-196f-45a4-b747-09abde641ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:58.452713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7642ee0-196f-45a4-b747-09abde641ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:58.482522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a7642ee0-196f-45a4-b747-09abde641ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045350 Oct 28 20:11:58.483062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 511/1011] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:58 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:59.174093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fa1ffcb1-f3aa-4006-949b-a2da563a51e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:59.174615 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fa1ffcb1-f3aa-4006-949b-a2da563a51e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:59.180534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa1ffcb1-f3aa-4006-949b-a2da563a51e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:59.181023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa1ffcb1-f3aa-4006-949b-a2da563a51e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:59.181490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa1ffcb1-f3aa-4006-949b-a2da563a51e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:59.182184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa1ffcb1-f3aa-4006-949b-a2da563a51e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:59.182647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa1ffcb1-f3aa-4006-949b-a2da563a51e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:59.183075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa1ffcb1-f3aa-4006-949b-a2da563a51e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:59.319969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fa1ffcb1-f3aa-4006-949b-a2da563a51e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:59.328637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fa1ffcb1-f3aa-4006-949b-a2da563a51e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:59.330110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fa1ffcb1-f3aa-4006-949b-a2da563a51e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:59.331364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fa1ffcb1-f3aa-4006-949b-a2da563a51e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.163824 Oct 28 20:11:59.331935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 501/1012] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:11:59 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:11:59.389077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a667aaad-6ee6-4c19-882c-ce008bb5d0b3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:59.389707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a667aaad-6ee6-4c19-882c-ce008bb5d0b3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:59.395577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a667aaad-6ee6-4c19-882c-ce008bb5d0b3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:59.396030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a667aaad-6ee6-4c19-882c-ce008bb5d0b3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:59.396463 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a667aaad-6ee6-4c19-882c-ce008bb5d0b3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:59.397149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a667aaad-6ee6-4c19-882c-ce008bb5d0b3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:59.397627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a667aaad-6ee6-4c19-882c-ce008bb5d0b3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:59.398051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a667aaad-6ee6-4c19-882c-ce008bb5d0b3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:59.457409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a667aaad-6ee6-4c19-882c-ce008bb5d0b3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:59.465762 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a667aaad-6ee6-4c19-882c-ce008bb5d0b3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.079985 Oct 28 20:11:59.466320 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 512/1013] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:59 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:59.494850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ed080423-67a7-4b3e-96e6-ae4a96ec2616 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:59.497878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ed080423-67a7-4b3e-96e6-ae4a96ec2616 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:59.504034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed080423-67a7-4b3e-96e6-ae4a96ec2616 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:59.504520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed080423-67a7-4b3e-96e6-ae4a96ec2616 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:59.504962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed080423-67a7-4b3e-96e6-ae4a96ec2616 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:59.505683 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed080423-67a7-4b3e-96e6-ae4a96ec2616 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:59.506141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed080423-67a7-4b3e-96e6-ae4a96ec2616 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:59.506570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed080423-67a7-4b3e-96e6-ae4a96ec2616 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:59.537040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ed080423-67a7-4b3e-96e6-ae4a96ec2616 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046065 Oct 28 20:11:59.537689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 502/1014] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:11:59 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:00.357669 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-933cd0f2-7321-44dc-b329-255e9d8b21f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:00.358411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-933cd0f2-7321-44dc-b329-255e9d8b21f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:00.364372 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-933cd0f2-7321-44dc-b329-255e9d8b21f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:00.364853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-933cd0f2-7321-44dc-b329-255e9d8b21f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:00.365289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-933cd0f2-7321-44dc-b329-255e9d8b21f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:00.366003 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-933cd0f2-7321-44dc-b329-255e9d8b21f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:00.366465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-933cd0f2-7321-44dc-b329-255e9d8b21f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:00.366888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-933cd0f2-7321-44dc-b329-255e9d8b21f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:00.488470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d5f7265a-3649-4ef3-bb35-bf3a331786c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:00.489098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d5f7265a-3649-4ef3-bb35-bf3a331786c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:00.492027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-933cd0f2-7321-44dc-b329-255e9d8b21f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:00.495665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5f7265a-3649-4ef3-bb35-bf3a331786c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:00.496864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5f7265a-3649-4ef3-bb35-bf3a331786c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:00.497354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5f7265a-3649-4ef3-bb35-bf3a331786c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:00.498052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5f7265a-3649-4ef3-bb35-bf3a331786c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:00.498510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5f7265a-3649-4ef3-bb35-bf3a331786c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:00.498936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5f7265a-3649-4ef3-bb35-bf3a331786c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:00.501514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-933cd0f2-7321-44dc-b329-255e9d8b21f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:00.502959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-933cd0f2-7321-44dc-b329-255e9d8b21f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:00.504118 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-933cd0f2-7321-44dc-b329-255e9d8b21f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.150401 Oct 28 20:12:00.504671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 513/1015] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:00 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:00.550128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4258af68-3fa1-4f12-a0a7-868c97dffaf1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:00.552186 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4258af68-3fa1-4f12-a0a7-868c97dffaf1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:00.557987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d5f7265a-3649-4ef3-bb35-bf3a331786c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:00.558364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4258af68-3fa1-4f12-a0a7-868c97dffaf1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:00.559659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4258af68-3fa1-4f12-a0a7-868c97dffaf1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:00.560268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4258af68-3fa1-4f12-a0a7-868c97dffaf1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:00.560973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4258af68-3fa1-4f12-a0a7-868c97dffaf1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:00.561500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4258af68-3fa1-4f12-a0a7-868c97dffaf1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:00.561929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4258af68-3fa1-4f12-a0a7-868c97dffaf1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:00.566249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d5f7265a-3649-4ef3-bb35-bf3a331786c6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081682 Oct 28 20:12:00.566818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 503/1016] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:00 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:12:00.591538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4258af68-3fa1-4f12-a0a7-868c97dffaf1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045414 Oct 28 20:12:00.592081 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 514/1017] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:00 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:12:01.530002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a6e133b-bb45-460f-aeb8-26800d747ca1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:01.530617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3a6e133b-bb45-460f-aeb8-26800d747ca1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:01.537181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6e133b-bb45-460f-aeb8-26800d747ca1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:01.537640 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6e133b-bb45-460f-aeb8-26800d747ca1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:01.538083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6e133b-bb45-460f-aeb8-26800d747ca1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:01.539039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6e133b-bb45-460f-aeb8-26800d747ca1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:01.539503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6e133b-bb45-460f-aeb8-26800d747ca1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:01.539931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6e133b-bb45-460f-aeb8-26800d747ca1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:01.589218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-09795a45-c7f4-4380-9c43-b334fd1bc133 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:01.590413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-09795a45-c7f4-4380-9c43-b334fd1bc133 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:01.596904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09795a45-c7f4-4380-9c43-b334fd1bc133 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:01.598962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09795a45-c7f4-4380-9c43-b334fd1bc133 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:01.599410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09795a45-c7f4-4380-9c43-b334fd1bc133 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:01.600114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09795a45-c7f4-4380-9c43-b334fd1bc133 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:01.600574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09795a45-c7f4-4380-9c43-b334fd1bc133 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:01.601002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09795a45-c7f4-4380-9c43-b334fd1bc133 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:01.672794 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-09795a45-c7f4-4380-9c43-b334fd1bc133 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:01.681006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-09795a45-c7f4-4380-9c43-b334fd1bc133 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.095659 Oct 28 20:12:01.681618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 515/1018] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:01 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:01.686416 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-46143ab6-4fbb-41d5-b911-c643ac826a53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:01.688554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-46143ab6-4fbb-41d5-b911-c643ac826a53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:01.694747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46143ab6-4fbb-41d5-b911-c643ac826a53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:01.695232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46143ab6-4fbb-41d5-b911-c643ac826a53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:01.695660 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46143ab6-4fbb-41d5-b911-c643ac826a53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:01.696352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46143ab6-4fbb-41d5-b911-c643ac826a53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:01.696803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46143ab6-4fbb-41d5-b911-c643ac826a53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:01.697219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46143ab6-4fbb-41d5-b911-c643ac826a53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:01.700716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a6e133b-bb45-460f-aeb8-26800d747ca1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:01.711096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a6e133b-bb45-460f-aeb8-26800d747ca1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:01.712542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a6e133b-bb45-460f-aeb8-26800d747ca1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:01.713723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a6e133b-bb45-460f-aeb8-26800d747ca1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.188264 Oct 28 20:12:01.714407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 504/1019] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:01 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:01.728409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-46143ab6-4fbb-41d5-b911-c643ac826a53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045788 Oct 28 20:12:01.729983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 516/1020] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:01 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:02.705613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-182b6bd0-935f-448d-806d-151f77e80dba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:02.706230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-182b6bd0-935f-448d-806d-151f77e80dba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:02.713180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-182b6bd0-935f-448d-806d-151f77e80dba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:02.713695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-182b6bd0-935f-448d-806d-151f77e80dba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:02.714137 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-182b6bd0-935f-448d-806d-151f77e80dba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:02.714879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-182b6bd0-935f-448d-806d-151f77e80dba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:02.715340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-182b6bd0-935f-448d-806d-151f77e80dba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:02.715764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-182b6bd0-935f-448d-806d-151f77e80dba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:02.741133 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-799ffac0-fe08-48cc-ad6f-485364afd581 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:02.741760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-799ffac0-fe08-48cc-ad6f-485364afd581 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:02.748894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-799ffac0-fe08-48cc-ad6f-485364afd581 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:02.749392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-799ffac0-fe08-48cc-ad6f-485364afd581 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:02.749843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-799ffac0-fe08-48cc-ad6f-485364afd581 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:02.750544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-799ffac0-fe08-48cc-ad6f-485364afd581 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:02.750991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-799ffac0-fe08-48cc-ad6f-485364afd581 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:02.751411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-799ffac0-fe08-48cc-ad6f-485364afd581 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:02.776641 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-182b6bd0-935f-448d-806d-151f77e80dba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:02.784969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-182b6bd0-935f-448d-806d-151f77e80dba tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.083217 Oct 28 20:12:02.785566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 505/1021] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:02 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:02.790084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e9d1bf4a-ba92-44d5-be6d-fa74e819019f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:02.792257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e9d1bf4a-ba92-44d5-be6d-fa74e819019f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:02.799046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9d1bf4a-ba92-44d5-be6d-fa74e819019f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:02.799536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9d1bf4a-ba92-44d5-be6d-fa74e819019f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:02.799976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9d1bf4a-ba92-44d5-be6d-fa74e819019f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:02.800676 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9d1bf4a-ba92-44d5-be6d-fa74e819019f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:02.801133 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9d1bf4a-ba92-44d5-be6d-fa74e819019f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:02.801587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9d1bf4a-ba92-44d5-be6d-fa74e819019f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:02.833787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e9d1bf4a-ba92-44d5-be6d-fa74e819019f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046973 Oct 28 20:12:02.834621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 506/1022] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:02 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:02.882302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-799ffac0-fe08-48cc-ad6f-485364afd581 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:02.890961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-799ffac0-fe08-48cc-ad6f-485364afd581 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:02.892400 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-799ffac0-fe08-48cc-ad6f-485364afd581 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:02.893585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-799ffac0-fe08-48cc-ad6f-485364afd581 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.156240 Oct 28 20:12:02.894140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 517/1023] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:02 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:03.809074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7704546-a194-4a72-a942-dfb0c52fd575 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:03.809985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7704546-a194-4a72-a942-dfb0c52fd575 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:03.816565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7704546-a194-4a72-a942-dfb0c52fd575 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:03.816993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7704546-a194-4a72-a942-dfb0c52fd575 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:03.817472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7704546-a194-4a72-a942-dfb0c52fd575 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:03.818167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7704546-a194-4a72-a942-dfb0c52fd575 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:03.818626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7704546-a194-4a72-a942-dfb0c52fd575 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:03.819050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7704546-a194-4a72-a942-dfb0c52fd575 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:03.848049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e5010caf-513a-43a1-a4a3-8213762c908b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:03.850879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e5010caf-513a-43a1-a4a3-8213762c908b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:03.858638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5010caf-513a-43a1-a4a3-8213762c908b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:03.859132 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5010caf-513a-43a1-a4a3-8213762c908b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:03.859574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5010caf-513a-43a1-a4a3-8213762c908b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:03.860325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5010caf-513a-43a1-a4a3-8213762c908b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:03.860785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5010caf-513a-43a1-a4a3-8213762c908b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:03.861215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5010caf-513a-43a1-a4a3-8213762c908b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:03.884468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7704546-a194-4a72-a942-dfb0c52fd575 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:03.891606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e5010caf-513a-43a1-a4a3-8213762c908b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047906 Oct 28 20:12:03.892180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 518/1024] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:03 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:12:03.892339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7704546-a194-4a72-a942-dfb0c52fd575 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.087811 Oct 28 20:12:03.892876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 507/1025] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:03 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:03.919925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d9b7d490-5faa-4ea8-abfe-0b17f8fea27c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:03.920535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d9b7d490-5faa-4ea8-abfe-0b17f8fea27c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:03.926302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9b7d490-5faa-4ea8-abfe-0b17f8fea27c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:03.926790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9b7d490-5faa-4ea8-abfe-0b17f8fea27c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:03.927226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9b7d490-5faa-4ea8-abfe-0b17f8fea27c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:03.927912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9b7d490-5faa-4ea8-abfe-0b17f8fea27c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:03.928419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9b7d490-5faa-4ea8-abfe-0b17f8fea27c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:03.928827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9b7d490-5faa-4ea8-abfe-0b17f8fea27c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:04.056343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d9b7d490-5faa-4ea8-abfe-0b17f8fea27c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:04.064817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d9b7d490-5faa-4ea8-abfe-0b17f8fea27c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:04.066299 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d9b7d490-5faa-4ea8-abfe-0b17f8fea27c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:04.067541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d9b7d490-5faa-4ea8-abfe-0b17f8fea27c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.152318 Oct 28 20:12:04.068041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 519/1026] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:03 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:04.904721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03c6ddf2-c3a7-4e00-bbb6-91ac939f6e75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:04.906836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-03c6ddf2-c3a7-4e00-bbb6-91ac939f6e75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:04.913258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03c6ddf2-c3a7-4e00-bbb6-91ac939f6e75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:04.913773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03c6ddf2-c3a7-4e00-bbb6-91ac939f6e75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:04.914211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03c6ddf2-c3a7-4e00-bbb6-91ac939f6e75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:04.914897 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03c6ddf2-c3a7-4e00-bbb6-91ac939f6e75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:04.915350 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03c6ddf2-c3a7-4e00-bbb6-91ac939f6e75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:04.915581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75da2e97-5427-4443-aa70-517646a98a3d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:04.916002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03c6ddf2-c3a7-4e00-bbb6-91ac939f6e75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:04.916200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-75da2e97-5427-4443-aa70-517646a98a3d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:04.918984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:04.923505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75da2e97-5427-4443-aa70-517646a98a3d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:04.926989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75da2e97-5427-4443-aa70-517646a98a3d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:04.926989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75da2e97-5427-4443-aa70-517646a98a3d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:04.926989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75da2e97-5427-4443-aa70-517646a98a3d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:04.926989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75da2e97-5427-4443-aa70-517646a98a3d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:04.927384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75da2e97-5427-4443-aa70-517646a98a3d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:04.947283 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-03c6ddf2-c3a7-4e00-bbb6-91ac939f6e75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047143 Oct 28 20:12:04.947834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 508/1027] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:04 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:04.990005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-75da2e97-5427-4443-aa70-517646a98a3d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:04.997458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-75da2e97-5427-4443-aa70-517646a98a3d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085730 Oct 28 20:12:04.998020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 520/1028] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:04 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:12:05.093219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9823c5f5-0ccb-40ef-891c-681c0e8191d8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:05.093855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9823c5f5-0ccb-40ef-891c-681c0e8191d8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:05.099773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9823c5f5-0ccb-40ef-891c-681c0e8191d8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:05.100258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9823c5f5-0ccb-40ef-891c-681c0e8191d8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:05.100697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9823c5f5-0ccb-40ef-891c-681c0e8191d8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:05.101408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9823c5f5-0ccb-40ef-891c-681c0e8191d8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:05.101866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9823c5f5-0ccb-40ef-891c-681c0e8191d8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:05.102288 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9823c5f5-0ccb-40ef-891c-681c0e8191d8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:05.229802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9823c5f5-0ccb-40ef-891c-681c0e8191d8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:05.238826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9823c5f5-0ccb-40ef-891c-681c0e8191d8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:05.240276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9823c5f5-0ccb-40ef-891c-681c0e8191d8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:05.241465 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9823c5f5-0ccb-40ef-891c-681c0e8191d8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.152658 Oct 28 20:12:05.242019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 509/1029] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:05 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:05.960420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-28fb5fd8-e27a-4c8a-b56f-5b0a2b071632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:05.962617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-28fb5fd8-e27a-4c8a-b56f-5b0a2b071632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:05.969236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fb5fd8-e27a-4c8a-b56f-5b0a2b071632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:05.969988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fb5fd8-e27a-4c8a-b56f-5b0a2b071632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:05.970786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fb5fd8-e27a-4c8a-b56f-5b0a2b071632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:05.971489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fb5fd8-e27a-4c8a-b56f-5b0a2b071632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:05.971950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fb5fd8-e27a-4c8a-b56f-5b0a2b071632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:05.972379 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fb5fd8-e27a-4c8a-b56f-5b0a2b071632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:06.002206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-28fb5fd8-e27a-4c8a-b56f-5b0a2b071632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046054 Oct 28 20:12:06.002763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 521/1030] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:05 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:06.020467 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5c48dc0e-4e33-4900-ba5b-50f90b5f75b6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:06.021077 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5c48dc0e-4e33-4900-ba5b-50f90b5f75b6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:06.027587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c48dc0e-4e33-4900-ba5b-50f90b5f75b6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:06.028061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c48dc0e-4e33-4900-ba5b-50f90b5f75b6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:06.028493 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c48dc0e-4e33-4900-ba5b-50f90b5f75b6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:06.029179 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c48dc0e-4e33-4900-ba5b-50f90b5f75b6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:06.029658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c48dc0e-4e33-4900-ba5b-50f90b5f75b6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:06.030075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c48dc0e-4e33-4900-ba5b-50f90b5f75b6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:06.091201 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5c48dc0e-4e33-4900-ba5b-50f90b5f75b6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:06.098700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5c48dc0e-4e33-4900-ba5b-50f90b5f75b6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082072 Oct 28 20:12:06.099250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 510/1031] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:06 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:06.267914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-47519bd0-5f3c-4578-ba80-d3f3fbc07436 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:06.268555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-47519bd0-5f3c-4578-ba80-d3f3fbc07436 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:06.274445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47519bd0-5f3c-4578-ba80-d3f3fbc07436 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:06.274933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47519bd0-5f3c-4578-ba80-d3f3fbc07436 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:06.275367 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47519bd0-5f3c-4578-ba80-d3f3fbc07436 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:06.276054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47519bd0-5f3c-4578-ba80-d3f3fbc07436 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:06.276511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47519bd0-5f3c-4578-ba80-d3f3fbc07436 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:06.277495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47519bd0-5f3c-4578-ba80-d3f3fbc07436 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:06.410304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-47519bd0-5f3c-4578-ba80-d3f3fbc07436 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:06.416490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-47519bd0-5f3c-4578-ba80-d3f3fbc07436 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:06.418564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-47519bd0-5f3c-4578-ba80-d3f3fbc07436 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:06.419728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-47519bd0-5f3c-4578-ba80-d3f3fbc07436 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.155791 Oct 28 20:12:06.420283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 522/1032] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:06 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:07.014778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd9328e1-b961-43e9-9f66-864501a274d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:07.016952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd9328e1-b961-43e9-9f66-864501a274d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:07.022908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd9328e1-b961-43e9-9f66-864501a274d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:07.023443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd9328e1-b961-43e9-9f66-864501a274d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:07.023820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd9328e1-b961-43e9-9f66-864501a274d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:07.024512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd9328e1-b961-43e9-9f66-864501a274d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:07.024978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd9328e1-b961-43e9-9f66-864501a274d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:07.025433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd9328e1-b961-43e9-9f66-864501a274d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:07.056145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd9328e1-b961-43e9-9f66-864501a274d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045386 Oct 28 20:12:07.056692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 511/1033] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:07 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:07.121788 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0bee9a6-dcb6-482d-83c3-c3ee2342716a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:07.122395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0bee9a6-dcb6-482d-83c3-c3ee2342716a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:07.128706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0bee9a6-dcb6-482d-83c3-c3ee2342716a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:07.129181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0bee9a6-dcb6-482d-83c3-c3ee2342716a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:07.129676 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0bee9a6-dcb6-482d-83c3-c3ee2342716a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:07.130356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0bee9a6-dcb6-482d-83c3-c3ee2342716a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:07.130802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0bee9a6-dcb6-482d-83c3-c3ee2342716a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:07.131215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0bee9a6-dcb6-482d-83c3-c3ee2342716a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:07.191270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0bee9a6-dcb6-482d-83c3-c3ee2342716a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:07.199261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0bee9a6-dcb6-482d-83c3-c3ee2342716a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081023 Oct 28 20:12:07.200321 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 523/1034] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:07 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:07.445625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f82517f-5e55-45f5-8e68-778bcb69dd6b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:07.446241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6f82517f-5e55-45f5-8e68-778bcb69dd6b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:07.452456 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f82517f-5e55-45f5-8e68-778bcb69dd6b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:07.452947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f82517f-5e55-45f5-8e68-778bcb69dd6b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:07.453415 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f82517f-5e55-45f5-8e68-778bcb69dd6b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:07.454104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f82517f-5e55-45f5-8e68-778bcb69dd6b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:07.454560 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f82517f-5e55-45f5-8e68-778bcb69dd6b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:07.454986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f82517f-5e55-45f5-8e68-778bcb69dd6b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:07.580968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6f82517f-5e55-45f5-8e68-778bcb69dd6b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:07.590313 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6f82517f-5e55-45f5-8e68-778bcb69dd6b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:07.591750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6f82517f-5e55-45f5-8e68-778bcb69dd6b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:07.592903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6f82517f-5e55-45f5-8e68-778bcb69dd6b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.151266 Oct 28 20:12:07.593468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 512/1035] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:07 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:08.068192 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-43739a16-97d4-469f-90ea-d132df28615c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:08.070439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-43739a16-97d4-469f-90ea-d132df28615c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:08.076978 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43739a16-97d4-469f-90ea-d132df28615c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:08.077491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43739a16-97d4-469f-90ea-d132df28615c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:08.077932 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43739a16-97d4-469f-90ea-d132df28615c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:08.078625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43739a16-97d4-469f-90ea-d132df28615c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:08.079083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43739a16-97d4-469f-90ea-d132df28615c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:08.079510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43739a16-97d4-469f-90ea-d132df28615c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:08.110774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-43739a16-97d4-469f-90ea-d132df28615c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046564 Oct 28 20:12:08.111320 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 524/1036] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:08 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:08.223211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-25a63153-c097-4955-b498-33a3e69b8d70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:08.223832 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-25a63153-c097-4955-b498-33a3e69b8d70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:08.230861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25a63153-c097-4955-b498-33a3e69b8d70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:08.231347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25a63153-c097-4955-b498-33a3e69b8d70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:08.231789 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25a63153-c097-4955-b498-33a3e69b8d70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:08.232479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25a63153-c097-4955-b498-33a3e69b8d70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:08.232941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25a63153-c097-4955-b498-33a3e69b8d70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:08.233391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25a63153-c097-4955-b498-33a3e69b8d70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:08.295987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-25a63153-c097-4955-b498-33a3e69b8d70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:08.304228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-25a63153-c097-4955-b498-33a3e69b8d70 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084812 Oct 28 20:12:08.304798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 513/1037] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:08 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:08.617874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-346bcd00-beff-4bf6-9e8f-7926064971d7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:08.618414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-346bcd00-beff-4bf6-9e8f-7926064971d7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:08.624833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-346bcd00-beff-4bf6-9e8f-7926064971d7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:08.625339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-346bcd00-beff-4bf6-9e8f-7926064971d7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:08.625781 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-346bcd00-beff-4bf6-9e8f-7926064971d7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:08.626471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-346bcd00-beff-4bf6-9e8f-7926064971d7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:08.626928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-346bcd00-beff-4bf6-9e8f-7926064971d7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:08.627351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-346bcd00-beff-4bf6-9e8f-7926064971d7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:08.631337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:08.756090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-346bcd00-beff-4bf6-9e8f-7926064971d7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:08.765466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-346bcd00-beff-4bf6-9e8f-7926064971d7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:08.767381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-346bcd00-beff-4bf6-9e8f-7926064971d7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:08.768121 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-346bcd00-beff-4bf6-9e8f-7926064971d7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.154330 Oct 28 20:12:08.768660 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 525/1038] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:08 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:09.123489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4494641a-17a9-4055-adc9-246a5d8a2391 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:09.125751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4494641a-17a9-4055-adc9-246a5d8a2391 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:09.131612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4494641a-17a9-4055-adc9-246a5d8a2391 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:09.132091 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4494641a-17a9-4055-adc9-246a5d8a2391 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:09.132519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4494641a-17a9-4055-adc9-246a5d8a2391 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:09.133229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4494641a-17a9-4055-adc9-246a5d8a2391 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:09.133702 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4494641a-17a9-4055-adc9-246a5d8a2391 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:09.134122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4494641a-17a9-4055-adc9-246a5d8a2391 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:09.162874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4494641a-17a9-4055-adc9-246a5d8a2391 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043743 Oct 28 20:12:09.163418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 514/1039] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:09 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:09.328663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0622a0f-6efc-48f7-9e08-ac3c6054c4a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:09.329273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0622a0f-6efc-48f7-9e08-ac3c6054c4a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:09.335644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0622a0f-6efc-48f7-9e08-ac3c6054c4a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:09.336124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0622a0f-6efc-48f7-9e08-ac3c6054c4a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:09.336564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0622a0f-6efc-48f7-9e08-ac3c6054c4a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:09.337244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0622a0f-6efc-48f7-9e08-ac3c6054c4a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:09.337723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0622a0f-6efc-48f7-9e08-ac3c6054c4a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:09.338150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0622a0f-6efc-48f7-9e08-ac3c6054c4a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:09.398070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0622a0f-6efc-48f7-9e08-ac3c6054c4a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:09.406693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0622a0f-6efc-48f7-9e08-ac3c6054c4a5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081898 Oct 28 20:12:09.407252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 526/1040] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:09 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:09.794226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8e31e2e0-6d34-44a1-8cbe-51cf06956d72 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:09.794835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8e31e2e0-6d34-44a1-8cbe-51cf06956d72 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:09.801217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e31e2e0-6d34-44a1-8cbe-51cf06956d72 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:09.801733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e31e2e0-6d34-44a1-8cbe-51cf06956d72 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:09.802171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e31e2e0-6d34-44a1-8cbe-51cf06956d72 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:09.802864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e31e2e0-6d34-44a1-8cbe-51cf06956d72 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:09.803324 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e31e2e0-6d34-44a1-8cbe-51cf06956d72 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:09.803748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e31e2e0-6d34-44a1-8cbe-51cf06956d72 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:09.939080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8e31e2e0-6d34-44a1-8cbe-51cf06956d72 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:09.947713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8e31e2e0-6d34-44a1-8cbe-51cf06956d72 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:09.950294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8e31e2e0-6d34-44a1-8cbe-51cf06956d72 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:09.951594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8e31e2e0-6d34-44a1-8cbe-51cf06956d72 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.161366 Oct 28 20:12:09.956303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 515/1041] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:09 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:10.176003 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dcd0eb2e-31c8-4ca2-9e0a-5f2484bdf189 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:10.178102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dcd0eb2e-31c8-4ca2-9e0a-5f2484bdf189 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:10.184995 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcd0eb2e-31c8-4ca2-9e0a-5f2484bdf189 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:10.185518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcd0eb2e-31c8-4ca2-9e0a-5f2484bdf189 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:10.185960 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcd0eb2e-31c8-4ca2-9e0a-5f2484bdf189 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:10.186641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcd0eb2e-31c8-4ca2-9e0a-5f2484bdf189 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:10.187091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcd0eb2e-31c8-4ca2-9e0a-5f2484bdf189 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:10.187509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcd0eb2e-31c8-4ca2-9e0a-5f2484bdf189 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:10.216893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dcd0eb2e-31c8-4ca2-9e0a-5f2484bdf189 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044872 Oct 28 20:12:10.217467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 527/1042] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:10 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:10.430544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3928abf5-3898-4e71-b32a-68f69e9ffac6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:10.431074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3928abf5-3898-4e71-b32a-68f69e9ffac6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:10.437847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3928abf5-3898-4e71-b32a-68f69e9ffac6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:10.438329 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3928abf5-3898-4e71-b32a-68f69e9ffac6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:10.438767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3928abf5-3898-4e71-b32a-68f69e9ffac6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:10.439458 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3928abf5-3898-4e71-b32a-68f69e9ffac6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:10.439915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3928abf5-3898-4e71-b32a-68f69e9ffac6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:10.440341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3928abf5-3898-4e71-b32a-68f69e9ffac6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:10.502268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3928abf5-3898-4e71-b32a-68f69e9ffac6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:10.509854 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3928abf5-3898-4e71-b32a-68f69e9ffac6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.083317 Oct 28 20:12:10.510411 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 516/1043] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:10 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:10.976754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-daffbb2d-96af-416d-a944-fcb7e5d99884 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:10.977383 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-daffbb2d-96af-416d-a944-fcb7e5d99884 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:10.983976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daffbb2d-96af-416d-a944-fcb7e5d99884 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:10.984457 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daffbb2d-96af-416d-a944-fcb7e5d99884 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:10.984884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daffbb2d-96af-416d-a944-fcb7e5d99884 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:10.985596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daffbb2d-96af-416d-a944-fcb7e5d99884 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:10.986041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daffbb2d-96af-416d-a944-fcb7e5d99884 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:10.986459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daffbb2d-96af-416d-a944-fcb7e5d99884 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:11.116699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-daffbb2d-96af-416d-a944-fcb7e5d99884 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:11.125917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-daffbb2d-96af-416d-a944-fcb7e5d99884 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:11.127524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-daffbb2d-96af-416d-a944-fcb7e5d99884 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:11.133524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-daffbb2d-96af-416d-a944-fcb7e5d99884 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.156029 Oct 28 20:12:11.133524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 528/1044] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:10 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:11.228497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7627ab9a-4fdd-4e24-b8fa-88c5fe9a546d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:11.230925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7627ab9a-4fdd-4e24-b8fa-88c5fe9a546d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:11.237632 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7627ab9a-4fdd-4e24-b8fa-88c5fe9a546d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:11.238118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7627ab9a-4fdd-4e24-b8fa-88c5fe9a546d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:11.238557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7627ab9a-4fdd-4e24-b8fa-88c5fe9a546d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:11.239249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7627ab9a-4fdd-4e24-b8fa-88c5fe9a546d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:11.239709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7627ab9a-4fdd-4e24-b8fa-88c5fe9a546d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:11.240136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7627ab9a-4fdd-4e24-b8fa-88c5fe9a546d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:11.269446 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7627ab9a-4fdd-4e24-b8fa-88c5fe9a546d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044910 Oct 28 20:12:11.269999 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 517/1045] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:11 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:11.531961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fcc10456-b376-47ff-bbec-0c7172c11464 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:11.532508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fcc10456-b376-47ff-bbec-0c7172c11464 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:11.539045 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcc10456-b376-47ff-bbec-0c7172c11464 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:11.539521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcc10456-b376-47ff-bbec-0c7172c11464 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:11.539956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcc10456-b376-47ff-bbec-0c7172c11464 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:11.540642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcc10456-b376-47ff-bbec-0c7172c11464 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:11.541096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcc10456-b376-47ff-bbec-0c7172c11464 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:11.541555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcc10456-b376-47ff-bbec-0c7172c11464 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:11.605040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fcc10456-b376-47ff-bbec-0c7172c11464 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:11.612658 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fcc10456-b376-47ff-bbec-0c7172c11464 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084658 Oct 28 20:12:11.613217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 529/1046] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:11 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:12:12.154985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8342887b-7c76-49cd-8d06-7284c9de4404 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:12.155697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8342887b-7c76-49cd-8d06-7284c9de4404 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:12.161699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8342887b-7c76-49cd-8d06-7284c9de4404 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:12.162188 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8342887b-7c76-49cd-8d06-7284c9de4404 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:12.162629 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8342887b-7c76-49cd-8d06-7284c9de4404 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:12.163316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8342887b-7c76-49cd-8d06-7284c9de4404 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:12.163777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8342887b-7c76-49cd-8d06-7284c9de4404 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:12.164201 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8342887b-7c76-49cd-8d06-7284c9de4404 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:12.282144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-67fa93e2-4f95-4132-a7cd-4517142ab596 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:12.284230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-67fa93e2-4f95-4132-a7cd-4517142ab596 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:12.290111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67fa93e2-4f95-4132-a7cd-4517142ab596 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:12.290596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67fa93e2-4f95-4132-a7cd-4517142ab596 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:12.291033 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67fa93e2-4f95-4132-a7cd-4517142ab596 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:12.291732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67fa93e2-4f95-4132-a7cd-4517142ab596 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:12.292186 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67fa93e2-4f95-4132-a7cd-4517142ab596 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:12.292659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67fa93e2-4f95-4132-a7cd-4517142ab596 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:12.292940 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8342887b-7c76-49cd-8d06-7284c9de4404 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:12.301625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8342887b-7c76-49cd-8d06-7284c9de4404 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:12.303058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8342887b-7c76-49cd-8d06-7284c9de4404 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:12.304215 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8342887b-7c76-49cd-8d06-7284c9de4404 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.154016 Oct 28 20:12:12.304956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 518/1047] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:12 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:12.322353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-67fa93e2-4f95-4132-a7cd-4517142ab596 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 Oct 28 20:12:12.322908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 530/1048] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:12 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:12.635545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f0a9928d-453b-4c4c-9b83-7fd9d7dc9772 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:12.636088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f0a9928d-453b-4c4c-9b83-7fd9d7dc9772 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:12.642005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0a9928d-453b-4c4c-9b83-7fd9d7dc9772 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:12.642493 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0a9928d-453b-4c4c-9b83-7fd9d7dc9772 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:12.642922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0a9928d-453b-4c4c-9b83-7fd9d7dc9772 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:12.643599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0a9928d-453b-4c4c-9b83-7fd9d7dc9772 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:12.644048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0a9928d-453b-4c4c-9b83-7fd9d7dc9772 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:12.644467 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0a9928d-453b-4c4c-9b83-7fd9d7dc9772 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:12.704019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f0a9928d-453b-4c4c-9b83-7fd9d7dc9772 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:12.711881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f0a9928d-453b-4c4c-9b83-7fd9d7dc9772 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.080239 Oct 28 20:12:12.712438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 519/1049] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:12 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:13.330841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7f73fc5c-178e-44a9-ad41-a9a134040999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:13.331358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7f73fc5c-178e-44a9-ad41-a9a134040999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:13.335475 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-654f33a8-dc37-42f1-ad5a-d86a97123e99 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:13.337734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-654f33a8-dc37-42f1-ad5a-d86a97123e99 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:13.340284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f73fc5c-178e-44a9-ad41-a9a134040999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:13.340284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f73fc5c-178e-44a9-ad41-a9a134040999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:13.340284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f73fc5c-178e-44a9-ad41-a9a134040999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:13.340794 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f73fc5c-178e-44a9-ad41-a9a134040999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:13.341247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f73fc5c-178e-44a9-ad41-a9a134040999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:13.341723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f73fc5c-178e-44a9-ad41-a9a134040999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:13.345686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654f33a8-dc37-42f1-ad5a-d86a97123e99 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:13.346169 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654f33a8-dc37-42f1-ad5a-d86a97123e99 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:13.346613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654f33a8-dc37-42f1-ad5a-d86a97123e99 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:13.347372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654f33a8-dc37-42f1-ad5a-d86a97123e99 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:13.347832 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654f33a8-dc37-42f1-ad5a-d86a97123e99 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:13.348262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654f33a8-dc37-42f1-ad5a-d86a97123e99 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:13.378082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-654f33a8-dc37-42f1-ad5a-d86a97123e99 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046682 Oct 28 20:12:13.378647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 520/1050] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:13 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:12:13.472183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7f73fc5c-178e-44a9-ad41-a9a134040999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:13.480732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7f73fc5c-178e-44a9-ad41-a9a134040999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:13.482247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7f73fc5c-178e-44a9-ad41-a9a134040999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:13.483401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7f73fc5c-178e-44a9-ad41-a9a134040999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.156829 Oct 28 20:12:13.483953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 531/1051] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:13 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:13.734534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-20a84d53-e35e-4009-93e3-069447b890fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:13.735149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-20a84d53-e35e-4009-93e3-069447b890fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:13.740992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20a84d53-e35e-4009-93e3-069447b890fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:13.741520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20a84d53-e35e-4009-93e3-069447b890fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:13.741956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20a84d53-e35e-4009-93e3-069447b890fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:13.742636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20a84d53-e35e-4009-93e3-069447b890fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:13.743089 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20a84d53-e35e-4009-93e3-069447b890fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:13.743512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20a84d53-e35e-4009-93e3-069447b890fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:13.807549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-20a84d53-e35e-4009-93e3-069447b890fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:13.816180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-20a84d53-e35e-4009-93e3-069447b890fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085598 Oct 28 20:12:13.816727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 521/1052] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:13 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:14.390591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d193202a-cee4-4999-96ad-2b9c4697557d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:14.392751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d193202a-cee4-4999-96ad-2b9c4697557d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:14.399115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d193202a-cee4-4999-96ad-2b9c4697557d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:14.399594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d193202a-cee4-4999-96ad-2b9c4697557d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:14.400059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d193202a-cee4-4999-96ad-2b9c4697557d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:14.400750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d193202a-cee4-4999-96ad-2b9c4697557d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:14.401213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d193202a-cee4-4999-96ad-2b9c4697557d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:14.402576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d193202a-cee4-4999-96ad-2b9c4697557d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:14.431613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d193202a-cee4-4999-96ad-2b9c4697557d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044989 Oct 28 20:12:14.432163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 532/1053] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:14 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:14.507922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e7b7a8c1-3ab3-4bb9-8a7a-ff342bb361d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:14.508534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e7b7a8c1-3ab3-4bb9-8a7a-ff342bb361d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:14.515049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7b7a8c1-3ab3-4bb9-8a7a-ff342bb361d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:14.515531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7b7a8c1-3ab3-4bb9-8a7a-ff342bb361d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:14.515968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7b7a8c1-3ab3-4bb9-8a7a-ff342bb361d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:14.516654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7b7a8c1-3ab3-4bb9-8a7a-ff342bb361d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:14.517129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7b7a8c1-3ab3-4bb9-8a7a-ff342bb361d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:14.517562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7b7a8c1-3ab3-4bb9-8a7a-ff342bb361d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:14.646328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e7b7a8c1-3ab3-4bb9-8a7a-ff342bb361d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:14.655383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e7b7a8c1-3ab3-4bb9-8a7a-ff342bb361d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:14.656817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e7b7a8c1-3ab3-4bb9-8a7a-ff342bb361d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:14.657995 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e7b7a8c1-3ab3-4bb9-8a7a-ff342bb361d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.153967 Oct 28 20:12:14.658554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 522/1054] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:14 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:14.840196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee06bb6f-4785-4b5c-9464-fd2e0bf48cb7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:14.840733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee06bb6f-4785-4b5c-9464-fd2e0bf48cb7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:14.846552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee06bb6f-4785-4b5c-9464-fd2e0bf48cb7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:14.847026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee06bb6f-4785-4b5c-9464-fd2e0bf48cb7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:14.847456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee06bb6f-4785-4b5c-9464-fd2e0bf48cb7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:14.848129 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee06bb6f-4785-4b5c-9464-fd2e0bf48cb7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:14.848605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee06bb6f-4785-4b5c-9464-fd2e0bf48cb7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:14.849021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee06bb6f-4785-4b5c-9464-fd2e0bf48cb7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:14.914805 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee06bb6f-4785-4b5c-9464-fd2e0bf48cb7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:14.922448 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee06bb6f-4785-4b5c-9464-fd2e0bf48cb7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.086862 Oct 28 20:12:14.923004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 533/1055] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:14 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:15.443856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32ec0f37-bb20-43c1-9356-1947c800161b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:15.446009 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-32ec0f37-bb20-43c1-9356-1947c800161b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:15.452777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32ec0f37-bb20-43c1-9356-1947c800161b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:15.453249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32ec0f37-bb20-43c1-9356-1947c800161b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:15.453706 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32ec0f37-bb20-43c1-9356-1947c800161b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:15.454384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32ec0f37-bb20-43c1-9356-1947c800161b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:15.454828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32ec0f37-bb20-43c1-9356-1947c800161b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:15.455244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32ec0f37-bb20-43c1-9356-1947c800161b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:15.484779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-32ec0f37-bb20-43c1-9356-1947c800161b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044738 Oct 28 20:12:15.485340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 523/1056] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:15 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:15.684767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c92645a0-81ae-4688-998f-e653574b8f5e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:15.685308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c92645a0-81ae-4688-998f-e653574b8f5e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:15.691591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c92645a0-81ae-4688-998f-e653574b8f5e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:15.692067 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c92645a0-81ae-4688-998f-e653574b8f5e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:15.692499 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c92645a0-81ae-4688-998f-e653574b8f5e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:15.693173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c92645a0-81ae-4688-998f-e653574b8f5e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:15.693653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c92645a0-81ae-4688-998f-e653574b8f5e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:15.694067 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c92645a0-81ae-4688-998f-e653574b8f5e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:15.819455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c92645a0-81ae-4688-998f-e653574b8f5e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:15.829228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c92645a0-81ae-4688-998f-e653574b8f5e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:15.830740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c92645a0-81ae-4688-998f-e653574b8f5e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:15.831901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c92645a0-81ae-4688-998f-e653574b8f5e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.151795 Oct 28 20:12:15.832452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 534/1057] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:15 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:15.945564 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1d8d0cdd-ab28-446c-8272-524a14611745 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:15.946304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1d8d0cdd-ab28-446c-8272-524a14611745 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:15.952664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d8d0cdd-ab28-446c-8272-524a14611745 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:15.953149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d8d0cdd-ab28-446c-8272-524a14611745 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:15.953621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d8d0cdd-ab28-446c-8272-524a14611745 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:15.954316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d8d0cdd-ab28-446c-8272-524a14611745 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:15.954774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d8d0cdd-ab28-446c-8272-524a14611745 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:15.955200 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d8d0cdd-ab28-446c-8272-524a14611745 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:16.015482 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1d8d0cdd-ab28-446c-8272-524a14611745 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:16.017678 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:16.023751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1d8d0cdd-ab28-446c-8272-524a14611745 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082037 Oct 28 20:12:16.024315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 524/1058] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:15 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:16.496939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1b891fbd-f30b-49ab-8974-8b6ce59b8a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:16.499104 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1b891fbd-f30b-49ab-8974-8b6ce59b8a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:16.505669 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b891fbd-f30b-49ab-8974-8b6ce59b8a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:16.506155 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b891fbd-f30b-49ab-8974-8b6ce59b8a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:16.506596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b891fbd-f30b-49ab-8974-8b6ce59b8a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:16.507296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b891fbd-f30b-49ab-8974-8b6ce59b8a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:16.507754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b891fbd-f30b-49ab-8974-8b6ce59b8a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:16.508185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b891fbd-f30b-49ab-8974-8b6ce59b8a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:16.538037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1b891fbd-f30b-49ab-8974-8b6ce59b8a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045118 Oct 28 20:12:16.538585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 535/1059] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:16 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:16.859613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cd257c0a-412e-49e6-aea7-577432c53c46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:16.860245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cd257c0a-412e-49e6-aea7-577432c53c46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:16.866325 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd257c0a-412e-49e6-aea7-577432c53c46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:16.866805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd257c0a-412e-49e6-aea7-577432c53c46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:16.867270 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd257c0a-412e-49e6-aea7-577432c53c46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:16.867944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd257c0a-412e-49e6-aea7-577432c53c46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:16.868390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd257c0a-412e-49e6-aea7-577432c53c46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:16.868806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd257c0a-412e-49e6-aea7-577432c53c46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:16.998885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-cd257c0a-412e-49e6-aea7-577432c53c46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:17.007250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-cd257c0a-412e-49e6-aea7-577432c53c46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:17.008727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-cd257c0a-412e-49e6-aea7-577432c53c46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:17.009989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cd257c0a-412e-49e6-aea7-577432c53c46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.155409 Oct 28 20:12:17.010546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 525/1060] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:16 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:17.053406 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-17cdeccc-e28d-4f35-81b2-7f82a6f687aa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:17.054023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-17cdeccc-e28d-4f35-81b2-7f82a6f687aa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:17.060599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17cdeccc-e28d-4f35-81b2-7f82a6f687aa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:17.061084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17cdeccc-e28d-4f35-81b2-7f82a6f687aa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:17.061552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17cdeccc-e28d-4f35-81b2-7f82a6f687aa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:17.062246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17cdeccc-e28d-4f35-81b2-7f82a6f687aa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:17.062703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17cdeccc-e28d-4f35-81b2-7f82a6f687aa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:17.063130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17cdeccc-e28d-4f35-81b2-7f82a6f687aa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:17.123164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-17cdeccc-e28d-4f35-81b2-7f82a6f687aa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:17.130661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-17cdeccc-e28d-4f35-81b2-7f82a6f687aa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081146 Oct 28 20:12:17.131227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 536/1061] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:17 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:17.551190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-22fdc431-f72e-456e-ad7f-8b219dcb7c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:17.553842 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22fdc431-f72e-456e-ad7f-8b219dcb7c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:17.560258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22fdc431-f72e-456e-ad7f-8b219dcb7c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:17.560867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22fdc431-f72e-456e-ad7f-8b219dcb7c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:17.561744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22fdc431-f72e-456e-ad7f-8b219dcb7c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:17.569419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22fdc431-f72e-456e-ad7f-8b219dcb7c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:17.569419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22fdc431-f72e-456e-ad7f-8b219dcb7c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:17.569419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22fdc431-f72e-456e-ad7f-8b219dcb7c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:17.597129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-22fdc431-f72e-456e-ad7f-8b219dcb7c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050277 Oct 28 20:12:17.598341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 526/1062] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:17 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:18.036109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-65b1aa7f-8384-4787-ba3f-58349daf3e8e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:18.036731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-65b1aa7f-8384-4787-ba3f-58349daf3e8e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:18.043194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65b1aa7f-8384-4787-ba3f-58349daf3e8e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:18.043678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65b1aa7f-8384-4787-ba3f-58349daf3e8e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:18.044120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65b1aa7f-8384-4787-ba3f-58349daf3e8e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:18.044810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65b1aa7f-8384-4787-ba3f-58349daf3e8e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:18.045412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65b1aa7f-8384-4787-ba3f-58349daf3e8e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:18.045908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65b1aa7f-8384-4787-ba3f-58349daf3e8e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:18.153707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-39a2f423-69e6-4302-aad3-52c04ae9221f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:18.154408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-39a2f423-69e6-4302-aad3-52c04ae9221f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:18.160807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a2f423-69e6-4302-aad3-52c04ae9221f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:18.161292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a2f423-69e6-4302-aad3-52c04ae9221f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:18.161763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a2f423-69e6-4302-aad3-52c04ae9221f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:18.162463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a2f423-69e6-4302-aad3-52c04ae9221f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:18.162921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a2f423-69e6-4302-aad3-52c04ae9221f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:18.163348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a2f423-69e6-4302-aad3-52c04ae9221f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:18.177878 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-65b1aa7f-8384-4787-ba3f-58349daf3e8e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:18.187713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-65b1aa7f-8384-4787-ba3f-58349daf3e8e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:18.189294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-65b1aa7f-8384-4787-ba3f-58349daf3e8e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:18.190476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-65b1aa7f-8384-4787-ba3f-58349daf3e8e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.158326 Oct 28 20:12:18.191032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 537/1063] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:18 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:18.229159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-39a2f423-69e6-4302-aad3-52c04ae9221f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:18.236951 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-39a2f423-69e6-4302-aad3-52c04ae9221f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.087686 Oct 28 20:12:18.237545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 527/1064] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:18 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:12:18.610573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-53400886-0639-4a92-84e1-bbaa6f03bb06 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:18.612761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-53400886-0639-4a92-84e1-bbaa6f03bb06 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:18.614644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=84 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:18.619280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53400886-0639-4a92-84e1-bbaa6f03bb06 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:18.626223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53400886-0639-4a92-84e1-bbaa6f03bb06 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:18.626223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53400886-0639-4a92-84e1-bbaa6f03bb06 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:18.626223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53400886-0639-4a92-84e1-bbaa6f03bb06 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:18.626223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53400886-0639-4a92-84e1-bbaa6f03bb06 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:18.626770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53400886-0639-4a92-84e1-bbaa6f03bb06 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:18.653734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-53400886-0639-4a92-84e1-bbaa6f03bb06 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047000 Oct 28 20:12:18.654292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 538/1065] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:18 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:19.217930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-85aaab52-d50a-4b8d-abf3-b672c54c869f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:19.218542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-85aaab52-d50a-4b8d-abf3-b672c54c869f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:19.224942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85aaab52-d50a-4b8d-abf3-b672c54c869f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:19.225456 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85aaab52-d50a-4b8d-abf3-b672c54c869f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:19.225890 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85aaab52-d50a-4b8d-abf3-b672c54c869f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:19.226572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85aaab52-d50a-4b8d-abf3-b672c54c869f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:19.227026 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85aaab52-d50a-4b8d-abf3-b672c54c869f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:19.227448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85aaab52-d50a-4b8d-abf3-b672c54c869f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:19.260304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5fc15735-0b0d-48c9-a078-edb72c5e127a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:19.261682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5fc15735-0b0d-48c9-a078-edb72c5e127a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:19.268650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fc15735-0b0d-48c9-a078-edb72c5e127a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:19.269256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fc15735-0b0d-48c9-a078-edb72c5e127a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:19.269725 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fc15735-0b0d-48c9-a078-edb72c5e127a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:19.270433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fc15735-0b0d-48c9-a078-edb72c5e127a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:19.270884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fc15735-0b0d-48c9-a078-edb72c5e127a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:19.271308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fc15735-0b0d-48c9-a078-edb72c5e127a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:19.344788 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5fc15735-0b0d-48c9-a078-edb72c5e127a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:19.352569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5fc15735-0b0d-48c9-a078-edb72c5e127a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.096209 Oct 28 20:12:19.353156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 539/1066] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:19 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:12:19.382129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-85aaab52-d50a-4b8d-abf3-b672c54c869f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:19.390764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-85aaab52-d50a-4b8d-abf3-b672c54c869f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:19.392190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-85aaab52-d50a-4b8d-abf3-b672c54c869f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:19.393343 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-85aaab52-d50a-4b8d-abf3-b672c54c869f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.180122 Oct 28 20:12:19.393892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 528/1067] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:19 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:19.665777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dd08702c-20dd-4086-8aa7-c9855ea96024 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:19.668706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dd08702c-20dd-4086-8aa7-c9855ea96024 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:19.674728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd08702c-20dd-4086-8aa7-c9855ea96024 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:19.675476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd08702c-20dd-4086-8aa7-c9855ea96024 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:19.675688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd08702c-20dd-4086-8aa7-c9855ea96024 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:19.676306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd08702c-20dd-4086-8aa7-c9855ea96024 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:19.676756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd08702c-20dd-4086-8aa7-c9855ea96024 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:19.677176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd08702c-20dd-4086-8aa7-c9855ea96024 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:19.707141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dd08702c-20dd-4086-8aa7-c9855ea96024 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045151 Oct 28 20:12:19.707696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 540/1068] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:19 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:20.375841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aa23d8d9-2ea7-44a8-9fb8-1f98d7e8bafc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:20.376448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aa23d8d9-2ea7-44a8-9fb8-1f98d7e8bafc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:20.382834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa23d8d9-2ea7-44a8-9fb8-1f98d7e8bafc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:20.383305 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa23d8d9-2ea7-44a8-9fb8-1f98d7e8bafc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:20.383739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa23d8d9-2ea7-44a8-9fb8-1f98d7e8bafc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:20.384425 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa23d8d9-2ea7-44a8-9fb8-1f98d7e8bafc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:20.384871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa23d8d9-2ea7-44a8-9fb8-1f98d7e8bafc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:20.385299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa23d8d9-2ea7-44a8-9fb8-1f98d7e8bafc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:20.418733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1cfcc67-1c19-4ebc-a696-09f81b65aa4b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:20.419339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f1cfcc67-1c19-4ebc-a696-09f81b65aa4b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:20.425810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1cfcc67-1c19-4ebc-a696-09f81b65aa4b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:20.426296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1cfcc67-1c19-4ebc-a696-09f81b65aa4b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:20.426733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1cfcc67-1c19-4ebc-a696-09f81b65aa4b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:20.427435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1cfcc67-1c19-4ebc-a696-09f81b65aa4b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:20.427883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1cfcc67-1c19-4ebc-a696-09f81b65aa4b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:20.428305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1cfcc67-1c19-4ebc-a696-09f81b65aa4b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:20.446385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-aa23d8d9-2ea7-44a8-9fb8-1f98d7e8bafc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:20.454957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aa23d8d9-2ea7-44a8-9fb8-1f98d7e8bafc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082960 Oct 28 20:12:20.455520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 529/1069] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:20 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:20.562050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1cfcc67-1c19-4ebc-a696-09f81b65aa4b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:20.565440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:20.570701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1cfcc67-1c19-4ebc-a696-09f81b65aa4b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:20.572160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1cfcc67-1c19-4ebc-a696-09f81b65aa4b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:20.573947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1cfcc67-1c19-4ebc-a696-09f81b65aa4b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.158563 Oct 28 20:12:20.574500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 541/1070] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:20 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:20.720631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-551e9e2e-554f-434a-90c2-135e9e76f554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:20.722868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-551e9e2e-554f-434a-90c2-135e9e76f554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:20.724783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=80 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:20.729419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-551e9e2e-554f-434a-90c2-135e9e76f554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:20.736604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-551e9e2e-554f-434a-90c2-135e9e76f554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:20.736604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-551e9e2e-554f-434a-90c2-135e9e76f554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:20.736604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-551e9e2e-554f-434a-90c2-135e9e76f554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:20.736604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-551e9e2e-554f-434a-90c2-135e9e76f554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:20.737174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-551e9e2e-554f-434a-90c2-135e9e76f554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:20.761994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-551e9e2e-554f-434a-90c2-135e9e76f554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045132 Oct 28 20:12:20.762554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 530/1071] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:20 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:21.478056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d1f4323a-f914-462b-bf03-e9bfda047396 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:21.478665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d1f4323a-f914-462b-bf03-e9bfda047396 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:21.486023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1f4323a-f914-462b-bf03-e9bfda047396 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:21.486503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1f4323a-f914-462b-bf03-e9bfda047396 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:21.486936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1f4323a-f914-462b-bf03-e9bfda047396 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:21.487618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1f4323a-f914-462b-bf03-e9bfda047396 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:21.488067 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1f4323a-f914-462b-bf03-e9bfda047396 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:21.488489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1f4323a-f914-462b-bf03-e9bfda047396 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:21.553279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1f4323a-f914-462b-bf03-e9bfda047396 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:21.561900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d1f4323a-f914-462b-bf03-e9bfda047396 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.087701 Oct 28 20:12:21.562466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 542/1072] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:21 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:21.599339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-080645c7-adba-4f02-aaa0-bd3993c76b58 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:21.599954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-080645c7-adba-4f02-aaa0-bd3993c76b58 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:21.606890 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-080645c7-adba-4f02-aaa0-bd3993c76b58 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:21.607375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-080645c7-adba-4f02-aaa0-bd3993c76b58 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:21.607814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-080645c7-adba-4f02-aaa0-bd3993c76b58 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:21.608501 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-080645c7-adba-4f02-aaa0-bd3993c76b58 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:21.608955 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-080645c7-adba-4f02-aaa0-bd3993c76b58 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:21.609406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-080645c7-adba-4f02-aaa0-bd3993c76b58 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:21.741785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-080645c7-adba-4f02-aaa0-bd3993c76b58 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:21.750776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-080645c7-adba-4f02-aaa0-bd3993c76b58 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:21.753005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-080645c7-adba-4f02-aaa0-bd3993c76b58 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:21.754191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-080645c7-adba-4f02-aaa0-bd3993c76b58 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.158767 Oct 28 20:12:21.760174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 531/1073] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:21 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:21.774276 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8385a099-4c0c-480d-81e5-a0c16e1e7ae5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:21.776986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8385a099-4c0c-480d-81e5-a0c16e1e7ae5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:21.783443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8385a099-4c0c-480d-81e5-a0c16e1e7ae5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:21.783925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8385a099-4c0c-480d-81e5-a0c16e1e7ae5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:21.784368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8385a099-4c0c-480d-81e5-a0c16e1e7ae5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:21.785054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8385a099-4c0c-480d-81e5-a0c16e1e7ae5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:21.785550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8385a099-4c0c-480d-81e5-a0c16e1e7ae5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:21.785974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8385a099-4c0c-480d-81e5-a0c16e1e7ae5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:21.816619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8385a099-4c0c-480d-81e5-a0c16e1e7ae5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046236 Oct 28 20:12:21.817180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 543/1074] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:21 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:22.583858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4423824d-e6dc-4699-bbb6-68912f7e074c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:22.584641 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4423824d-e6dc-4699-bbb6-68912f7e074c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:22.591068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4423824d-e6dc-4699-bbb6-68912f7e074c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:22.591545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4423824d-e6dc-4699-bbb6-68912f7e074c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:22.591977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4423824d-e6dc-4699-bbb6-68912f7e074c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:22.592650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4423824d-e6dc-4699-bbb6-68912f7e074c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:22.593095 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4423824d-e6dc-4699-bbb6-68912f7e074c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:22.593548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4423824d-e6dc-4699-bbb6-68912f7e074c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:22.654730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4423824d-e6dc-4699-bbb6-68912f7e074c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:22.662180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4423824d-e6dc-4699-bbb6-68912f7e074c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082297 Oct 28 20:12:22.662733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 532/1075] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:22 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:22.780574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1bd46494-7567-4c39-8982-9947e37264ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:22.781292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1bd46494-7567-4c39-8982-9947e37264ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:22.787808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bd46494-7567-4c39-8982-9947e37264ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:22.788294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bd46494-7567-4c39-8982-9947e37264ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:22.788735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bd46494-7567-4c39-8982-9947e37264ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:22.789451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bd46494-7567-4c39-8982-9947e37264ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:22.789912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bd46494-7567-4c39-8982-9947e37264ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:22.790347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bd46494-7567-4c39-8982-9947e37264ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:22.828773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0673fbae-3bb7-47bd-85a2-2c7a9cb47288 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:22.830949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0673fbae-3bb7-47bd-85a2-2c7a9cb47288 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:22.843244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0673fbae-3bb7-47bd-85a2-2c7a9cb47288 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:22.843592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0673fbae-3bb7-47bd-85a2-2c7a9cb47288 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:22.844005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0673fbae-3bb7-47bd-85a2-2c7a9cb47288 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:22.844693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0673fbae-3bb7-47bd-85a2-2c7a9cb47288 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:22.845179 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0673fbae-3bb7-47bd-85a2-2c7a9cb47288 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:22.851486 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0673fbae-3bb7-47bd-85a2-2c7a9cb47288 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:22.884301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0673fbae-3bb7-47bd-85a2-2c7a9cb47288 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059237 Oct 28 20:12:22.885022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 533/1076] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:22 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:22.928780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1bd46494-7567-4c39-8982-9947e37264ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:22.938076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1bd46494-7567-4c39-8982-9947e37264ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:22.940853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1bd46494-7567-4c39-8982-9947e37264ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:22.940853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1bd46494-7567-4c39-8982-9947e37264ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.164681 Oct 28 20:12:22.942041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 544/1077] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:22 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:23.685338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9f279e93-36a9-4953-a54c-e7fc484907f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:23.685957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9f279e93-36a9-4953-a54c-e7fc484907f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:23.692550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f279e93-36a9-4953-a54c-e7fc484907f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:23.693042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f279e93-36a9-4953-a54c-e7fc484907f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:23.693519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f279e93-36a9-4953-a54c-e7fc484907f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:23.694222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f279e93-36a9-4953-a54c-e7fc484907f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:23.694739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f279e93-36a9-4953-a54c-e7fc484907f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:23.695172 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f279e93-36a9-4953-a54c-e7fc484907f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:23.755686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9f279e93-36a9-4953-a54c-e7fc484907f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:23.763875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9f279e93-36a9-4953-a54c-e7fc484907f7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082511 Oct 28 20:12:23.764431 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 534/1078] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:23 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:23.898025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e384538f-918a-4b7f-874a-63708e7bd6cc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:23.900267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e384538f-918a-4b7f-874a-63708e7bd6cc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:23.908385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e384538f-918a-4b7f-874a-63708e7bd6cc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:23.908865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e384538f-918a-4b7f-874a-63708e7bd6cc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:23.909297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e384538f-918a-4b7f-874a-63708e7bd6cc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:23.910116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e384538f-918a-4b7f-874a-63708e7bd6cc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:23.910457 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e384538f-918a-4b7f-874a-63708e7bd6cc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:23.910868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e384538f-918a-4b7f-874a-63708e7bd6cc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:23.945699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e384538f-918a-4b7f-874a-63708e7bd6cc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051477 Oct 28 20:12:23.946250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 545/1079] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:23 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:23.972706 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f912ca9-9e2f-44a6-83eb-d1e8fc009876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:23.972706 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f912ca9-9e2f-44a6-83eb-d1e8fc009876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:23.976404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f912ca9-9e2f-44a6-83eb-d1e8fc009876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:23.977058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f912ca9-9e2f-44a6-83eb-d1e8fc009876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:23.977551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f912ca9-9e2f-44a6-83eb-d1e8fc009876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:23.978249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f912ca9-9e2f-44a6-83eb-d1e8fc009876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:23.978718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f912ca9-9e2f-44a6-83eb-d1e8fc009876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:23.979150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f912ca9-9e2f-44a6-83eb-d1e8fc009876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:24.109908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4f912ca9-9e2f-44a6-83eb-d1e8fc009876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:24.118391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4f912ca9-9e2f-44a6-83eb-d1e8fc009876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:24.120364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4f912ca9-9e2f-44a6-83eb-d1e8fc009876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:24.121548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f912ca9-9e2f-44a6-83eb-d1e8fc009876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.158099 Oct 28 20:12:24.122101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 535/1080] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:23 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:24.787322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b2addbb8-ec08-4b0b-8e9d-0a262be9707b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:24.787942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b2addbb8-ec08-4b0b-8e9d-0a262be9707b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:24.794384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2addbb8-ec08-4b0b-8e9d-0a262be9707b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:24.794870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2addbb8-ec08-4b0b-8e9d-0a262be9707b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:24.795312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2addbb8-ec08-4b0b-8e9d-0a262be9707b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:24.795987 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2addbb8-ec08-4b0b-8e9d-0a262be9707b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:24.796441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2addbb8-ec08-4b0b-8e9d-0a262be9707b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:24.796865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2addbb8-ec08-4b0b-8e9d-0a262be9707b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:24.857891 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b2addbb8-ec08-4b0b-8e9d-0a262be9707b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:24.865393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b2addbb8-ec08-4b0b-8e9d-0a262be9707b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081997 Oct 28 20:12:24.865956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 546/1081] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:24 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:24.958877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0dd0ff34-9961-4fae-b91b-72e414be2edb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:24.961375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0dd0ff34-9961-4fae-b91b-72e414be2edb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:24.967926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dd0ff34-9961-4fae-b91b-72e414be2edb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:24.968414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dd0ff34-9961-4fae-b91b-72e414be2edb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:24.968848 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dd0ff34-9961-4fae-b91b-72e414be2edb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:24.969574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dd0ff34-9961-4fae-b91b-72e414be2edb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:24.970032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dd0ff34-9961-4fae-b91b-72e414be2edb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:24.970452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dd0ff34-9961-4fae-b91b-72e414be2edb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:25.002557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0dd0ff34-9961-4fae-b91b-72e414be2edb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047668 Oct 28 20:12:25.003271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 536/1082] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:24 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:25.146902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-55d33ff0-a33f-456d-bbce-27ce057d9a1c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:25.147519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-55d33ff0-a33f-456d-bbce-27ce057d9a1c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:25.154050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55d33ff0-a33f-456d-bbce-27ce057d9a1c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:25.154533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55d33ff0-a33f-456d-bbce-27ce057d9a1c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:25.154973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55d33ff0-a33f-456d-bbce-27ce057d9a1c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:25.155659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55d33ff0-a33f-456d-bbce-27ce057d9a1c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:25.156114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55d33ff0-a33f-456d-bbce-27ce057d9a1c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:25.156539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55d33ff0-a33f-456d-bbce-27ce057d9a1c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:25.286698 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-55d33ff0-a33f-456d-bbce-27ce057d9a1c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:25.296214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-55d33ff0-a33f-456d-bbce-27ce057d9a1c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:25.297680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-55d33ff0-a33f-456d-bbce-27ce057d9a1c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:25.298852 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-55d33ff0-a33f-456d-bbce-27ce057d9a1c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.156115 Oct 28 20:12:25.299411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 547/1083] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:25 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:25.888194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-90c85e90-6066-4189-ac7d-e96420e813b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:25.888814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-90c85e90-6066-4189-ac7d-e96420e813b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:25.894732 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90c85e90-6066-4189-ac7d-e96420e813b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:25.895223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90c85e90-6066-4189-ac7d-e96420e813b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:25.895663 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90c85e90-6066-4189-ac7d-e96420e813b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:25.896352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90c85e90-6066-4189-ac7d-e96420e813b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:25.896810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90c85e90-6066-4189-ac7d-e96420e813b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:25.897236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90c85e90-6066-4189-ac7d-e96420e813b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:25.965747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-90c85e90-6066-4189-ac7d-e96420e813b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:25.973340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-90c85e90-6066-4189-ac7d-e96420e813b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.089277 Oct 28 20:12:25.973904 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 537/1084] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:25 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:26.015487 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fa49b5b6-7fb9-41e5-9e47-2e5b196f9b58 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:26.017719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fa49b5b6-7fb9-41e5-9e47-2e5b196f9b58 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:26.023484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa49b5b6-7fb9-41e5-9e47-2e5b196f9b58 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:26.023965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa49b5b6-7fb9-41e5-9e47-2e5b196f9b58 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:26.024402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa49b5b6-7fb9-41e5-9e47-2e5b196f9b58 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:26.025218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa49b5b6-7fb9-41e5-9e47-2e5b196f9b58 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:26.025816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa49b5b6-7fb9-41e5-9e47-2e5b196f9b58 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:26.026828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa49b5b6-7fb9-41e5-9e47-2e5b196f9b58 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:26.062353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fa49b5b6-7fb9-41e5-9e47-2e5b196f9b58 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050681 Oct 28 20:12:26.063085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 548/1085] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:26 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:26.324746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60f6f2d7-c32c-4b1e-aa65-01d394617591 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:26.325385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60f6f2d7-c32c-4b1e-aa65-01d394617591 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:26.331330 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f6f2d7-c32c-4b1e-aa65-01d394617591 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:26.331823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f6f2d7-c32c-4b1e-aa65-01d394617591 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:26.332261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f6f2d7-c32c-4b1e-aa65-01d394617591 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:26.332950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f6f2d7-c32c-4b1e-aa65-01d394617591 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:26.333429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f6f2d7-c32c-4b1e-aa65-01d394617591 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:26.333858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f6f2d7-c32c-4b1e-aa65-01d394617591 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:26.462471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-60f6f2d7-c32c-4b1e-aa65-01d394617591 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:26.471059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-60f6f2d7-c32c-4b1e-aa65-01d394617591 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:26.472488 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-60f6f2d7-c32c-4b1e-aa65-01d394617591 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:26.473664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60f6f2d7-c32c-4b1e-aa65-01d394617591 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.153587 Oct 28 20:12:26.474212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 538/1086] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:26 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:26.997814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c5203323-211f-4ac8-a4b4-671f31a3066c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:26.998423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c5203323-211f-4ac8-a4b4-671f31a3066c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:27.005111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5203323-211f-4ac8-a4b4-671f31a3066c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:27.005629 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5203323-211f-4ac8-a4b4-671f31a3066c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:27.006070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5203323-211f-4ac8-a4b4-671f31a3066c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:27.006760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5203323-211f-4ac8-a4b4-671f31a3066c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:27.007255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5203323-211f-4ac8-a4b4-671f31a3066c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:27.007683 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5203323-211f-4ac8-a4b4-671f31a3066c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:27.069160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c5203323-211f-4ac8-a4b4-671f31a3066c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:27.074540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-58061e23-5b52-4e60-85d8-7c7044d0d9c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:27.076745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-58061e23-5b52-4e60-85d8-7c7044d0d9c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:27.078634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c5203323-211f-4ac8-a4b4-671f31a3066c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.086016 Oct 28 20:12:27.080595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 549/1087] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:26 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:27.084290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58061e23-5b52-4e60-85d8-7c7044d0d9c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:27.084290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58061e23-5b52-4e60-85d8-7c7044d0d9c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:27.084527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58061e23-5b52-4e60-85d8-7c7044d0d9c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:27.085121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58061e23-5b52-4e60-85d8-7c7044d0d9c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:27.085603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58061e23-5b52-4e60-85d8-7c7044d0d9c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:27.086358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58061e23-5b52-4e60-85d8-7c7044d0d9c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:27.117002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-58061e23-5b52-4e60-85d8-7c7044d0d9c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046745 Oct 28 20:12:27.117601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 539/1088] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:27 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:12:27.498886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b36f711b-f55f-4d96-9766-78e02128eff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:27.499492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b36f711b-f55f-4d96-9766-78e02128eff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:27.505314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b36f711b-f55f-4d96-9766-78e02128eff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:27.505824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b36f711b-f55f-4d96-9766-78e02128eff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:27.506255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b36f711b-f55f-4d96-9766-78e02128eff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:27.506929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b36f711b-f55f-4d96-9766-78e02128eff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:27.507372 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b36f711b-f55f-4d96-9766-78e02128eff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:27.507788 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b36f711b-f55f-4d96-9766-78e02128eff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:27.639423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b36f711b-f55f-4d96-9766-78e02128eff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:27.647957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b36f711b-f55f-4d96-9766-78e02128eff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:27.649431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b36f711b-f55f-4d96-9766-78e02128eff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:27.650591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b36f711b-f55f-4d96-9766-78e02128eff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.155910 Oct 28 20:12:27.652157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 550/1089] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:27 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:28.103035 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2ae5ae57-4494-4bb5-8051-c081ea3db062 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:28.103646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2ae5ae57-4494-4bb5-8051-c081ea3db062 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:28.110194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ae5ae57-4494-4bb5-8051-c081ea3db062 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:28.110675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ae5ae57-4494-4bb5-8051-c081ea3db062 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:28.111112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ae5ae57-4494-4bb5-8051-c081ea3db062 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:28.111796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ae5ae57-4494-4bb5-8051-c081ea3db062 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:28.112254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ae5ae57-4494-4bb5-8051-c081ea3db062 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:28.112679 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ae5ae57-4494-4bb5-8051-c081ea3db062 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:28.129794 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-81efafd6-e707-48c4-a452-9b189439d029 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:28.132014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-81efafd6-e707-48c4-a452-9b189439d029 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:28.139339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81efafd6-e707-48c4-a452-9b189439d029 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:28.139821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81efafd6-e707-48c4-a452-9b189439d029 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:28.140276 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81efafd6-e707-48c4-a452-9b189439d029 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:28.140967 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81efafd6-e707-48c4-a452-9b189439d029 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:28.141453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81efafd6-e707-48c4-a452-9b189439d029 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:28.141871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81efafd6-e707-48c4-a452-9b189439d029 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:28.176530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-81efafd6-e707-48c4-a452-9b189439d029 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050693 Oct 28 20:12:28.177522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 551/1090] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:28 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:12:28.186900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2ae5ae57-4494-4bb5-8051-c081ea3db062 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:28.194683 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2ae5ae57-4494-4bb5-8051-c081ea3db062 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.095674 Oct 28 20:12:28.195242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 540/1091] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:28 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:28.677424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9e194746-0b3b-4663-bdde-3637f4ad6f92 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:28.677973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9e194746-0b3b-4663-bdde-3637f4ad6f92 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:28.684564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e194746-0b3b-4663-bdde-3637f4ad6f92 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:28.685051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e194746-0b3b-4663-bdde-3637f4ad6f92 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:28.685516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e194746-0b3b-4663-bdde-3637f4ad6f92 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:28.686211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e194746-0b3b-4663-bdde-3637f4ad6f92 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:28.686666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e194746-0b3b-4663-bdde-3637f4ad6f92 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:28.687095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e194746-0b3b-4663-bdde-3637f4ad6f92 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:28.815078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9e194746-0b3b-4663-bdde-3637f4ad6f92 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:28.823722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9e194746-0b3b-4663-bdde-3637f4ad6f92 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:28.825166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9e194746-0b3b-4663-bdde-3637f4ad6f92 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:28.826352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9e194746-0b3b-4663-bdde-3637f4ad6f92 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.153046 Oct 28 20:12:28.826903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 552/1092] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:28 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:29.188735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-06cba99f-63ac-408a-8419-7729d0936679 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:29.190948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-06cba99f-63ac-408a-8419-7729d0936679 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:29.193210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:12:29.193380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:12:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments (ip 10.222.0.66) !!! Oct 28 20:12:29.203301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06cba99f-63ac-408a-8419-7729d0936679 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:29.203776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06cba99f-63ac-408a-8419-7729d0936679 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:29.204206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06cba99f-63ac-408a-8419-7729d0936679 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:29.204890 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06cba99f-63ac-408a-8419-7729d0936679 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:29.205359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06cba99f-63ac-408a-8419-7729d0936679 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:29.205780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06cba99f-63ac-408a-8419-7729d0936679 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:29.218178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48a65809-4d92-447c-8ead-66246dc583ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:29.218797 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48a65809-4d92-447c-8ead-66246dc583ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:29.219949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:29.225668 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48a65809-4d92-447c-8ead-66246dc583ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:29.230613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48a65809-4d92-447c-8ead-66246dc583ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:29.230613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48a65809-4d92-447c-8ead-66246dc583ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:29.230613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48a65809-4d92-447c-8ead-66246dc583ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:29.230613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48a65809-4d92-447c-8ead-66246dc583ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:29.230958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48a65809-4d92-447c-8ead-66246dc583ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:29.237300 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-06cba99f-63ac-408a-8419-7729d0936679 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052446 Oct 28 20:12:29.238202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 541/1093] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:29 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:29.298719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-48a65809-4d92-447c-8ead-66246dc583ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:29.306469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48a65809-4d92-447c-8ead-66246dc583ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.092108 Oct 28 20:12:29.307023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 553/1094] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:29 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:12:29.852654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9cc7a3bf-324d-4aff-a636-a2ce9a667692 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:29.853293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9cc7a3bf-324d-4aff-a636-a2ce9a667692 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:29.860220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cc7a3bf-324d-4aff-a636-a2ce9a667692 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:29.860705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cc7a3bf-324d-4aff-a636-a2ce9a667692 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:29.861143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cc7a3bf-324d-4aff-a636-a2ce9a667692 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:29.861851 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cc7a3bf-324d-4aff-a636-a2ce9a667692 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:29.862306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cc7a3bf-324d-4aff-a636-a2ce9a667692 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:29.862729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cc7a3bf-324d-4aff-a636-a2ce9a667692 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:29.992777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9cc7a3bf-324d-4aff-a636-a2ce9a667692 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:30.001935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9cc7a3bf-324d-4aff-a636-a2ce9a667692 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:30.003388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9cc7a3bf-324d-4aff-a636-a2ce9a667692 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:30.004543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9cc7a3bf-324d-4aff-a636-a2ce9a667692 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.155845 Oct 28 20:12:30.005101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 542/1095] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:29 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:30.250370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-093fb411-e216-4b8f-8997-42726c2fee29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:30.252518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-093fb411-e216-4b8f-8997-42726c2fee29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:30.259770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-093fb411-e216-4b8f-8997-42726c2fee29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:30.260282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-093fb411-e216-4b8f-8997-42726c2fee29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:30.260718 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-093fb411-e216-4b8f-8997-42726c2fee29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:30.261433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-093fb411-e216-4b8f-8997-42726c2fee29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:30.261886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-093fb411-e216-4b8f-8997-42726c2fee29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:30.262309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-093fb411-e216-4b8f-8997-42726c2fee29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:30.293041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-093fb411-e216-4b8f-8997-42726c2fee29 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045537 Oct 28 20:12:30.293771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 554/1096] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:30 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:30.332137 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-94358b16-8d2e-4cd7-a975-147370d228db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:30.332749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-94358b16-8d2e-4cd7-a975-147370d228db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:30.339976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94358b16-8d2e-4cd7-a975-147370d228db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:30.340456 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94358b16-8d2e-4cd7-a975-147370d228db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:30.340889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94358b16-8d2e-4cd7-a975-147370d228db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:30.341727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94358b16-8d2e-4cd7-a975-147370d228db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:30.342178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94358b16-8d2e-4cd7-a975-147370d228db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:30.342598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94358b16-8d2e-4cd7-a975-147370d228db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:30.407100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-94358b16-8d2e-4cd7-a975-147370d228db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:30.415279 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-94358b16-8d2e-4cd7-a975-147370d228db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.088379 Oct 28 20:12:30.415844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 543/1097] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:30 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:31.031171 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-67cfa1f9-23a4-4e56-8521-a9a048d2690b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:31.031781 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-67cfa1f9-23a4-4e56-8521-a9a048d2690b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:31.037703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cfa1f9-23a4-4e56-8521-a9a048d2690b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:31.038190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cfa1f9-23a4-4e56-8521-a9a048d2690b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:31.038628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cfa1f9-23a4-4e56-8521-a9a048d2690b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:31.039318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cfa1f9-23a4-4e56-8521-a9a048d2690b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:31.039770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cfa1f9-23a4-4e56-8521-a9a048d2690b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:31.040194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cfa1f9-23a4-4e56-8521-a9a048d2690b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:31.169706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-67cfa1f9-23a4-4e56-8521-a9a048d2690b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:31.178134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-67cfa1f9-23a4-4e56-8521-a9a048d2690b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:31.179565 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-67cfa1f9-23a4-4e56-8521-a9a048d2690b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:31.180710 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-67cfa1f9-23a4-4e56-8521-a9a048d2690b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.153619 Oct 28 20:12:31.181262 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 555/1098] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:31 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:31.305386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cbf1177f-6745-4dde-988a-2f44c585f718 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:31.307460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cbf1177f-6745-4dde-988a-2f44c585f718 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:31.313435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbf1177f-6745-4dde-988a-2f44c585f718 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:31.313923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbf1177f-6745-4dde-988a-2f44c585f718 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:31.314357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbf1177f-6745-4dde-988a-2f44c585f718 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:31.315069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbf1177f-6745-4dde-988a-2f44c585f718 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:31.315503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbf1177f-6745-4dde-988a-2f44c585f718 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:31.315925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbf1177f-6745-4dde-988a-2f44c585f718 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:31.346138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cbf1177f-6745-4dde-988a-2f44c585f718 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044720 Oct 28 20:12:31.346755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 544/1099] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:31 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:31.438696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0b8417a-3c04-4b71-9ad0-f15cbe44bba6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:31.439403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0b8417a-3c04-4b71-9ad0-f15cbe44bba6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:31.446243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0b8417a-3c04-4b71-9ad0-f15cbe44bba6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:31.446819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0b8417a-3c04-4b71-9ad0-f15cbe44bba6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:31.447259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0b8417a-3c04-4b71-9ad0-f15cbe44bba6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:31.448536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0b8417a-3c04-4b71-9ad0-f15cbe44bba6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:31.449041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0b8417a-3c04-4b71-9ad0-f15cbe44bba6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:31.449490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0b8417a-3c04-4b71-9ad0-f15cbe44bba6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:31.519924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0b8417a-3c04-4b71-9ad0-f15cbe44bba6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:31.528097 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0b8417a-3c04-4b71-9ad0-f15cbe44bba6 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.093184 Oct 28 20:12:31.541340 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 556/1100] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:31 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:32.206520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a7c3c87-a365-4894-9200-00295fe553c6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:32.211707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6a7c3c87-a365-4894-9200-00295fe553c6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:32.213983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a7c3c87-a365-4894-9200-00295fe553c6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:32.214473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a7c3c87-a365-4894-9200-00295fe553c6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:32.214927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a7c3c87-a365-4894-9200-00295fe553c6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:32.215619 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a7c3c87-a365-4894-9200-00295fe553c6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:32.216078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a7c3c87-a365-4894-9200-00295fe553c6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:32.216505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a7c3c87-a365-4894-9200-00295fe553c6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:32.348997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a7c3c87-a365-4894-9200-00295fe553c6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:32.358423 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a7c3c87-a365-4894-9200-00295fe553c6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:32.360604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f79806f3-e735-4663-a77e-983bee9b3813 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:32.360837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a7c3c87-a365-4894-9200-00295fe553c6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:32.360985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a7c3c87-a365-4894-9200-00295fe553c6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.158475 Oct 28 20:12:32.361562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 545/1101] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:32 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:12:32.361684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f79806f3-e735-4663-a77e-983bee9b3813 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:32.367722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f79806f3-e735-4663-a77e-983bee9b3813 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:32.368203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f79806f3-e735-4663-a77e-983bee9b3813 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:32.368640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f79806f3-e735-4663-a77e-983bee9b3813 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:32.369360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f79806f3-e735-4663-a77e-983bee9b3813 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:32.369911 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f79806f3-e735-4663-a77e-983bee9b3813 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:32.370339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f79806f3-e735-4663-a77e-983bee9b3813 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:32.399484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f79806f3-e735-4663-a77e-983bee9b3813 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044269 Oct 28 20:12:32.400041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 557/1102] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:32 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:12:32.551068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0e870806-9cd8-41ef-aaf4-c07f0048f967 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:32.551685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0e870806-9cd8-41ef-aaf4-c07f0048f967 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:32.559228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e870806-9cd8-41ef-aaf4-c07f0048f967 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:32.559893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e870806-9cd8-41ef-aaf4-c07f0048f967 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:32.560348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e870806-9cd8-41ef-aaf4-c07f0048f967 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:32.561153 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e870806-9cd8-41ef-aaf4-c07f0048f967 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:32.561673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e870806-9cd8-41ef-aaf4-c07f0048f967 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:32.562243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e870806-9cd8-41ef-aaf4-c07f0048f967 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:32.643569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0e870806-9cd8-41ef-aaf4-c07f0048f967 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:32.651648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0e870806-9cd8-41ef-aaf4-c07f0048f967 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.104263 Oct 28 20:12:32.652205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 546/1103] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:32 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:33.386850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-24fd2759-6f51-40df-9541-32463e57bcaa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:33.387472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-24fd2759-6f51-40df-9541-32463e57bcaa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:33.393854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24fd2759-6f51-40df-9541-32463e57bcaa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:33.394336 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24fd2759-6f51-40df-9541-32463e57bcaa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:33.394776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24fd2759-6f51-40df-9541-32463e57bcaa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:33.395609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24fd2759-6f51-40df-9541-32463e57bcaa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:33.396073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24fd2759-6f51-40df-9541-32463e57bcaa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:33.396503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24fd2759-6f51-40df-9541-32463e57bcaa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:33.412189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-87c3acc9-23de-4eed-8ce4-90d48dbc573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:33.415959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-87c3acc9-23de-4eed-8ce4-90d48dbc573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:33.417585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:33.423102 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87c3acc9-23de-4eed-8ce4-90d48dbc573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:33.423738 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87c3acc9-23de-4eed-8ce4-90d48dbc573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:33.424304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87c3acc9-23de-4eed-8ce4-90d48dbc573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:33.425059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87c3acc9-23de-4eed-8ce4-90d48dbc573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:33.425752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87c3acc9-23de-4eed-8ce4-90d48dbc573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:33.426238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87c3acc9-23de-4eed-8ce4-90d48dbc573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:33.458422 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-87c3acc9-23de-4eed-8ce4-90d48dbc573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050195 Oct 28 20:12:33.459422 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 547/1104] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:33 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:12:33.528979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-24fd2759-6f51-40df-9541-32463e57bcaa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:33.537571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-24fd2759-6f51-40df-9541-32463e57bcaa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:33.539115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-24fd2759-6f51-40df-9541-32463e57bcaa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:33.540282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-24fd2759-6f51-40df-9541-32463e57bcaa tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.158001 Oct 28 20:12:33.541040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 558/1105] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:33 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:33.777135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-434db2c7-254f-4981-a2a8-9ae2ccc3d41a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:33.777793 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-434db2c7-254f-4981-a2a8-9ae2ccc3d41a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:33.783898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-434db2c7-254f-4981-a2a8-9ae2ccc3d41a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:33.784380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-434db2c7-254f-4981-a2a8-9ae2ccc3d41a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:33.784821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-434db2c7-254f-4981-a2a8-9ae2ccc3d41a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:33.785548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-434db2c7-254f-4981-a2a8-9ae2ccc3d41a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:33.786004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-434db2c7-254f-4981-a2a8-9ae2ccc3d41a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:33.786428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-434db2c7-254f-4981-a2a8-9ae2ccc3d41a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:33.845959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-434db2c7-254f-4981-a2a8-9ae2ccc3d41a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:33.853464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-434db2c7-254f-4981-a2a8-9ae2ccc3d41a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.184438 Oct 28 20:12:33.854257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 548/1106] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:33 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:34.471425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c2687036-0dd1-46d2-be14-c1b240d7b180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:34.473626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c2687036-0dd1-46d2-be14-c1b240d7b180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:34.480524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2687036-0dd1-46d2-be14-c1b240d7b180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:34.481007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2687036-0dd1-46d2-be14-c1b240d7b180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:34.481474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2687036-0dd1-46d2-be14-c1b240d7b180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:34.482168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2687036-0dd1-46d2-be14-c1b240d7b180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:34.482626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2687036-0dd1-46d2-be14-c1b240d7b180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:34.483052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2687036-0dd1-46d2-be14-c1b240d7b180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:34.513838 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c2687036-0dd1-46d2-be14-c1b240d7b180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046401 Oct 28 20:12:34.514382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 559/1107] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:34 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:34.566707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b91197e-e473-43ce-9137-f996bb88960b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:34.567317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7b91197e-e473-43ce-9137-f996bb88960b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:34.574351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b91197e-e473-43ce-9137-f996bb88960b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:34.574913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b91197e-e473-43ce-9137-f996bb88960b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:34.575459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b91197e-e473-43ce-9137-f996bb88960b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:34.576401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b91197e-e473-43ce-9137-f996bb88960b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:34.576827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b91197e-e473-43ce-9137-f996bb88960b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:34.577645 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b91197e-e473-43ce-9137-f996bb88960b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:34.716805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b91197e-e473-43ce-9137-f996bb88960b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:34.724866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b91197e-e473-43ce-9137-f996bb88960b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:34.726286 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b91197e-e473-43ce-9137-f996bb88960b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:34.727470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7b91197e-e473-43ce-9137-f996bb88960b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.164616 Oct 28 20:12:34.728289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 549/1108] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:34 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:12:34.876524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e8a08941-f1db-47b1-91e1-b899a18fc672 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:34.877131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e8a08941-f1db-47b1-91e1-b899a18fc672 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:34.883018 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8a08941-f1db-47b1-91e1-b899a18fc672 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:34.883490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8a08941-f1db-47b1-91e1-b899a18fc672 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:34.883918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8a08941-f1db-47b1-91e1-b899a18fc672 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:34.884591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8a08941-f1db-47b1-91e1-b899a18fc672 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:34.886016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8a08941-f1db-47b1-91e1-b899a18fc672 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:34.886360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8a08941-f1db-47b1-91e1-b899a18fc672 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:34.945562 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e8a08941-f1db-47b1-91e1-b899a18fc672 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:34.953634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e8a08941-f1db-47b1-91e1-b899a18fc672 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081161 Oct 28 20:12:34.954185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 560/1109] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:34 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:35.525421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b61c87e6-e602-40c0-b58c-c5239f60c521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:35.528687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b61c87e6-e602-40c0-b58c-c5239f60c521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:35.534735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b61c87e6-e602-40c0-b58c-c5239f60c521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:35.535249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b61c87e6-e602-40c0-b58c-c5239f60c521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:35.535690 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b61c87e6-e602-40c0-b58c-c5239f60c521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:35.536380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b61c87e6-e602-40c0-b58c-c5239f60c521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:35.536835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b61c87e6-e602-40c0-b58c-c5239f60c521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:35.537260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b61c87e6-e602-40c0-b58c-c5239f60c521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:35.569836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b61c87e6-e602-40c0-b58c-c5239f60c521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048300 Oct 28 20:12:35.570515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 550/1110] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:35 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:35.754277 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4f51d3df-a93e-41ae-a885-b60e675cb765 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:35.755083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4f51d3df-a93e-41ae-a885-b60e675cb765 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:35.762366 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f51d3df-a93e-41ae-a885-b60e675cb765 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:35.762851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f51d3df-a93e-41ae-a885-b60e675cb765 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:35.763282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f51d3df-a93e-41ae-a885-b60e675cb765 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:35.763976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f51d3df-a93e-41ae-a885-b60e675cb765 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:35.764421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f51d3df-a93e-41ae-a885-b60e675cb765 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:35.764865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f51d3df-a93e-41ae-a885-b60e675cb765 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:35.893197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f51d3df-a93e-41ae-a885-b60e675cb765 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:35.902474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f51d3df-a93e-41ae-a885-b60e675cb765 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:35.903982 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f51d3df-a93e-41ae-a885-b60e675cb765 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:35.905148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4f51d3df-a93e-41ae-a885-b60e675cb765 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.154865 Oct 28 20:12:35.905767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 561/1111] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:35 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:35.976187 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bef99b90-e193-4b20-9504-9121297dd6e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:35.976796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bef99b90-e193-4b20-9504-9121297dd6e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:35.983229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bef99b90-e193-4b20-9504-9121297dd6e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:35.983699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bef99b90-e193-4b20-9504-9121297dd6e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:35.984125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bef99b90-e193-4b20-9504-9121297dd6e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:35.984793 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bef99b90-e193-4b20-9504-9121297dd6e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:35.985240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bef99b90-e193-4b20-9504-9121297dd6e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:35.985680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bef99b90-e193-4b20-9504-9121297dd6e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:36.050354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bef99b90-e193-4b20-9504-9121297dd6e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:36.058739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bef99b90-e193-4b20-9504-9121297dd6e9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.086331 Oct 28 20:12:36.059307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 551/1112] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:35 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:36.583034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4304d224-147d-4c57-9a11-669dd2abe788 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:36.585482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4304d224-147d-4c57-9a11-669dd2abe788 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:36.592049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4304d224-147d-4c57-9a11-669dd2abe788 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:36.592529 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4304d224-147d-4c57-9a11-669dd2abe788 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:36.592962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4304d224-147d-4c57-9a11-669dd2abe788 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:36.593680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4304d224-147d-4c57-9a11-669dd2abe788 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:36.594157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4304d224-147d-4c57-9a11-669dd2abe788 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:36.594550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4304d224-147d-4c57-9a11-669dd2abe788 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:36.624917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4304d224-147d-4c57-9a11-669dd2abe788 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045810 Oct 28 20:12:36.625493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 562/1113] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:36 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:36.930590 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e918974e-8c94-4a6d-942c-8a28d97f40ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:36.931204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e918974e-8c94-4a6d-942c-8a28d97f40ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:36.938043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e918974e-8c94-4a6d-942c-8a28d97f40ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:36.938532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e918974e-8c94-4a6d-942c-8a28d97f40ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:36.938968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e918974e-8c94-4a6d-942c-8a28d97f40ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:36.939655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e918974e-8c94-4a6d-942c-8a28d97f40ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:36.940108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e918974e-8c94-4a6d-942c-8a28d97f40ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:36.940534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e918974e-8c94-4a6d-942c-8a28d97f40ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:37.066128 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e918974e-8c94-4a6d-942c-8a28d97f40ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:37.074732 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e918974e-8c94-4a6d-942c-8a28d97f40ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:37.076174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e918974e-8c94-4a6d-942c-8a28d97f40ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:37.077359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e918974e-8c94-4a6d-942c-8a28d97f40ca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.150651 Oct 28 20:12:37.077914 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 552/1114] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:36 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:37.082271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-816bb21c-f79a-4513-8301-0a996c26d0e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:37.082886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-816bb21c-f79a-4513-8301-0a996c26d0e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:37.089674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-816bb21c-f79a-4513-8301-0a996c26d0e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:37.090249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-816bb21c-f79a-4513-8301-0a996c26d0e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:37.090692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-816bb21c-f79a-4513-8301-0a996c26d0e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:37.091375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-816bb21c-f79a-4513-8301-0a996c26d0e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:37.091827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-816bb21c-f79a-4513-8301-0a996c26d0e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:37.092431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-816bb21c-f79a-4513-8301-0a996c26d0e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:37.152465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-816bb21c-f79a-4513-8301-0a996c26d0e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:37.159954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-816bb21c-f79a-4513-8301-0a996c26d0e8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081789 Oct 28 20:12:37.160522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 563/1115] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:37 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:12:37.638654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ecd5e09-0faa-4d5a-b6bc-5ee5ba56aa7a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:37.640914 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ecd5e09-0faa-4d5a-b6bc-5ee5ba56aa7a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:37.647126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ecd5e09-0faa-4d5a-b6bc-5ee5ba56aa7a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:37.647626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ecd5e09-0faa-4d5a-b6bc-5ee5ba56aa7a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:37.648064 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ecd5e09-0faa-4d5a-b6bc-5ee5ba56aa7a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:37.648757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ecd5e09-0faa-4d5a-b6bc-5ee5ba56aa7a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:37.649218 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ecd5e09-0faa-4d5a-b6bc-5ee5ba56aa7a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:37.649782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ecd5e09-0faa-4d5a-b6bc-5ee5ba56aa7a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:37.682230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ecd5e09-0faa-4d5a-b6bc-5ee5ba56aa7a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048771 Oct 28 20:12:37.682811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 553/1116] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:37 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:38.103018 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e26fd723-019a-4508-968b-17a2b5f40c25 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:38.103646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e26fd723-019a-4508-968b-17a2b5f40c25 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:38.110064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e26fd723-019a-4508-968b-17a2b5f40c25 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:38.110542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e26fd723-019a-4508-968b-17a2b5f40c25 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:38.110978 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e26fd723-019a-4508-968b-17a2b5f40c25 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:38.111654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e26fd723-019a-4508-968b-17a2b5f40c25 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:38.112100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e26fd723-019a-4508-968b-17a2b5f40c25 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:38.112513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e26fd723-019a-4508-968b-17a2b5f40c25 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:38.183622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a445263e-c819-4ead-892e-a2d712cb96d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:38.184876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a445263e-c819-4ead-892e-a2d712cb96d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:38.190713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a445263e-c819-4ead-892e-a2d712cb96d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:38.191431 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a445263e-c819-4ead-892e-a2d712cb96d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:38.191622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a445263e-c819-4ead-892e-a2d712cb96d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:38.192317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a445263e-c819-4ead-892e-a2d712cb96d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:38.192765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a445263e-c819-4ead-892e-a2d712cb96d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:38.193196 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a445263e-c819-4ead-892e-a2d712cb96d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:38.273019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a445263e-c819-4ead-892e-a2d712cb96d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:38.278143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e26fd723-019a-4508-968b-17a2b5f40c25 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:38.282088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a445263e-c819-4ead-892e-a2d712cb96d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.102724 Oct 28 20:12:38.282892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 554/1117] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:38 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:12:38.286933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e26fd723-019a-4508-968b-17a2b5f40c25 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:38.288389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e26fd723-019a-4508-968b-17a2b5f40c25 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:38.290215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e26fd723-019a-4508-968b-17a2b5f40c25 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.190450 Oct 28 20:12:38.293487 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 564/1118] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:38 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:38.695274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-23ac7f47-3acf-4e6c-8662-68f8020d4046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:38.697505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-23ac7f47-3acf-4e6c-8662-68f8020d4046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:38.703308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23ac7f47-3acf-4e6c-8662-68f8020d4046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:38.703791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23ac7f47-3acf-4e6c-8662-68f8020d4046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:38.704215 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23ac7f47-3acf-4e6c-8662-68f8020d4046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:38.704893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23ac7f47-3acf-4e6c-8662-68f8020d4046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:38.705360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23ac7f47-3acf-4e6c-8662-68f8020d4046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:38.705784 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23ac7f47-3acf-4e6c-8662-68f8020d4046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:38.735500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-23ac7f47-3acf-4e6c-8662-68f8020d4046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044165 Oct 28 20:12:38.736053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 555/1119] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:38 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:39.304856 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-171998b4-0753-4c71-ac4d-7775ee9af605 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:39.305496 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-171998b4-0753-4c71-ac4d-7775ee9af605 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:39.311923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-171998b4-0753-4c71-ac4d-7775ee9af605 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:39.312408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-171998b4-0753-4c71-ac4d-7775ee9af605 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:39.312842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-171998b4-0753-4c71-ac4d-7775ee9af605 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:39.313591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-171998b4-0753-4c71-ac4d-7775ee9af605 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:39.314127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-171998b4-0753-4c71-ac4d-7775ee9af605 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:39.314465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-171998b4-0753-4c71-ac4d-7775ee9af605 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:39.318409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-72b4c1dd-7154-419b-97a4-c2f8ddd1261c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:39.319018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-72b4c1dd-7154-419b-97a4-c2f8ddd1261c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:39.326031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b4c1dd-7154-419b-97a4-c2f8ddd1261c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:39.329516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b4c1dd-7154-419b-97a4-c2f8ddd1261c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:39.329516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b4c1dd-7154-419b-97a4-c2f8ddd1261c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:39.329516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b4c1dd-7154-419b-97a4-c2f8ddd1261c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:39.329516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b4c1dd-7154-419b-97a4-c2f8ddd1261c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:39.329979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b4c1dd-7154-419b-97a4-c2f8ddd1261c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:39.387822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-171998b4-0753-4c71-ac4d-7775ee9af605 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:39.395477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-171998b4-0753-4c71-ac4d-7775ee9af605 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.094494 Oct 28 20:12:39.401369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 565/1120] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:39 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:39.475614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-72b4c1dd-7154-419b-97a4-c2f8ddd1261c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:39.485166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-72b4c1dd-7154-419b-97a4-c2f8ddd1261c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:39.486650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-72b4c1dd-7154-419b-97a4-c2f8ddd1261c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:39.487809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-72b4c1dd-7154-419b-97a4-c2f8ddd1261c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.173341 Oct 28 20:12:39.488362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 556/1121] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:39 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:12:39.749305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3b0d3cb2-35b6-48a6-90b2-406f4bea7212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:39.751511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3b0d3cb2-35b6-48a6-90b2-406f4bea7212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:39.757339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b0d3cb2-35b6-48a6-90b2-406f4bea7212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:39.757824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b0d3cb2-35b6-48a6-90b2-406f4bea7212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:39.758264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b0d3cb2-35b6-48a6-90b2-406f4bea7212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:39.758946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b0d3cb2-35b6-48a6-90b2-406f4bea7212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:39.759395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b0d3cb2-35b6-48a6-90b2-406f4bea7212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:39.759820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b0d3cb2-35b6-48a6-90b2-406f4bea7212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:39.788916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3b0d3cb2-35b6-48a6-90b2-406f4bea7212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043570 Oct 28 20:12:39.789482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 566/1122] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:39 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:40.419918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d8a8947d-637f-4500-ab5b-73b64897a55d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:40.420457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d8a8947d-637f-4500-ab5b-73b64897a55d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:40.422576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:12:40.422711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:12:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 (ip 10.222.0.66) !!! Oct 28 20:12:40.429228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8a8947d-637f-4500-ab5b-73b64897a55d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:40.429743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8a8947d-637f-4500-ab5b-73b64897a55d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:40.430193 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8a8947d-637f-4500-ab5b-73b64897a55d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:40.430888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8a8947d-637f-4500-ab5b-73b64897a55d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:40.431346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8a8947d-637f-4500-ab5b-73b64897a55d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:40.431779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8a8947d-637f-4500-ab5b-73b64897a55d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:40.493824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d8a8947d-637f-4500-ab5b-73b64897a55d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:40.501974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d8a8947d-637f-4500-ab5b-73b64897a55d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.087235 Oct 28 20:12:40.512410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 557/1123] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:40 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:40.514032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58214563-bc43-46c6-a2df-e2354b922100 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:40.514743 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-58214563-bc43-46c6-a2df-e2354b922100 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:40.521041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58214563-bc43-46c6-a2df-e2354b922100 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:40.521558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58214563-bc43-46c6-a2df-e2354b922100 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:40.521994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58214563-bc43-46c6-a2df-e2354b922100 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:40.522679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58214563-bc43-46c6-a2df-e2354b922100 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:40.523129 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58214563-bc43-46c6-a2df-e2354b922100 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:40.523604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58214563-bc43-46c6-a2df-e2354b922100 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:40.651239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-58214563-bc43-46c6-a2df-e2354b922100 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:40.659846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-58214563-bc43-46c6-a2df-e2354b922100 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:40.661282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-58214563-bc43-46c6-a2df-e2354b922100 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:40.662464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-58214563-bc43-46c6-a2df-e2354b922100 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.153290 Oct 28 20:12:40.663022 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 567/1124] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:40 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:40.802508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ab4ca098-f7a1-4cbd-ba5e-89be59887d81 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:40.804691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ab4ca098-f7a1-4cbd-ba5e-89be59887d81 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:40.811523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab4ca098-f7a1-4cbd-ba5e-89be59887d81 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:40.812004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab4ca098-f7a1-4cbd-ba5e-89be59887d81 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:40.812474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab4ca098-f7a1-4cbd-ba5e-89be59887d81 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:40.813161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab4ca098-f7a1-4cbd-ba5e-89be59887d81 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:40.813637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab4ca098-f7a1-4cbd-ba5e-89be59887d81 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:40.814063 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab4ca098-f7a1-4cbd-ba5e-89be59887d81 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:40.816382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:40.844777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ab4ca098-f7a1-4cbd-ba5e-89be59887d81 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046178 Oct 28 20:12:40.845351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 558/1125] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:40 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:41.531140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-065e51ed-91cd-4239-80f6-e6812530050a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:41.531749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-065e51ed-91cd-4239-80f6-e6812530050a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:41.538054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-065e51ed-91cd-4239-80f6-e6812530050a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:41.538535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-065e51ed-91cd-4239-80f6-e6812530050a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:41.538959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-065e51ed-91cd-4239-80f6-e6812530050a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:41.539630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-065e51ed-91cd-4239-80f6-e6812530050a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:41.540078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-065e51ed-91cd-4239-80f6-e6812530050a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:41.540493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-065e51ed-91cd-4239-80f6-e6812530050a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:41.603304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-065e51ed-91cd-4239-80f6-e6812530050a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:41.611539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-065e51ed-91cd-4239-80f6-e6812530050a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084390 Oct 28 20:12:41.612097 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 568/1126] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:41 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:41.689226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f1efe615-d766-4c04-8a18-0ef39e4ca876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:41.689878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f1efe615-d766-4c04-8a18-0ef39e4ca876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:41.696428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efe615-d766-4c04-8a18-0ef39e4ca876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:41.696913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efe615-d766-4c04-8a18-0ef39e4ca876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:41.697411 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efe615-d766-4c04-8a18-0ef39e4ca876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:41.698103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efe615-d766-4c04-8a18-0ef39e4ca876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:41.698721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efe615-d766-4c04-8a18-0ef39e4ca876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:41.699353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efe615-d766-4c04-8a18-0ef39e4ca876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:41.825168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f1efe615-d766-4c04-8a18-0ef39e4ca876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:41.833593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f1efe615-d766-4c04-8a18-0ef39e4ca876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:41.835290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f1efe615-d766-4c04-8a18-0ef39e4ca876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:41.836435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f1efe615-d766-4c04-8a18-0ef39e4ca876 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.152763 Oct 28 20:12:41.836987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 559/1127] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:41 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:41.857013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b5448776-796a-4d3b-94d2-aa0408762906 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:41.859204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b5448776-796a-4d3b-94d2-aa0408762906 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:41.864867 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5448776-796a-4d3b-94d2-aa0408762906 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:41.865363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5448776-796a-4d3b-94d2-aa0408762906 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:41.865798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5448776-796a-4d3b-94d2-aa0408762906 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:41.866473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5448776-796a-4d3b-94d2-aa0408762906 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:41.866918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5448776-796a-4d3b-94d2-aa0408762906 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:41.867339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5448776-796a-4d3b-94d2-aa0408762906 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:41.896961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b5448776-796a-4d3b-94d2-aa0408762906 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043701 Oct 28 20:12:41.897770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 569/1128] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:41 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:42.634702 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-35ac29f3-350a-4658-a6c3-c2749a408ea2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:42.635322 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-35ac29f3-350a-4658-a6c3-c2749a408ea2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:42.642478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35ac29f3-350a-4658-a6c3-c2749a408ea2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:42.642962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35ac29f3-350a-4658-a6c3-c2749a408ea2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:42.643405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35ac29f3-350a-4658-a6c3-c2749a408ea2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:42.644092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35ac29f3-350a-4658-a6c3-c2749a408ea2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:42.644549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35ac29f3-350a-4658-a6c3-c2749a408ea2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:42.644974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35ac29f3-350a-4658-a6c3-c2749a408ea2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:42.705214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-35ac29f3-350a-4658-a6c3-c2749a408ea2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:42.713172 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-35ac29f3-350a-4658-a6c3-c2749a408ea2 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082370 Oct 28 20:12:42.713761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 560/1129] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:42 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:42.861621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32c8bf27-65af-4b91-b140-338cf6ec0bc2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:42.862233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-32c8bf27-65af-4b91-b140-338cf6ec0bc2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:42.868607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32c8bf27-65af-4b91-b140-338cf6ec0bc2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:42.869085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32c8bf27-65af-4b91-b140-338cf6ec0bc2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:42.869556 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32c8bf27-65af-4b91-b140-338cf6ec0bc2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:42.870871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32c8bf27-65af-4b91-b140-338cf6ec0bc2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:42.871328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32c8bf27-65af-4b91-b140-338cf6ec0bc2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:42.871754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32c8bf27-65af-4b91-b140-338cf6ec0bc2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:42.908425 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b455b0b9-1e3d-4a28-9b8e-493c51e551a3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:42.910543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b455b0b9-1e3d-4a28-9b8e-493c51e551a3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:42.916380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b455b0b9-1e3d-4a28-9b8e-493c51e551a3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:42.916867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b455b0b9-1e3d-4a28-9b8e-493c51e551a3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:42.917850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b455b0b9-1e3d-4a28-9b8e-493c51e551a3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:42.918543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b455b0b9-1e3d-4a28-9b8e-493c51e551a3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:42.918999 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b455b0b9-1e3d-4a28-9b8e-493c51e551a3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:42.919424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b455b0b9-1e3d-4a28-9b8e-493c51e551a3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:42.950000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b455b0b9-1e3d-4a28-9b8e-493c51e551a3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045449 Oct 28 20:12:42.950563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 561/1130] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:42 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:12:43.000848 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-32c8bf27-65af-4b91-b140-338cf6ec0bc2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:43.009761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-32c8bf27-65af-4b91-b140-338cf6ec0bc2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:43.012387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-32c8bf27-65af-4b91-b140-338cf6ec0bc2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:43.013631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-32c8bf27-65af-4b91-b140-338cf6ec0bc2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.155922 Oct 28 20:12:43.014207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 570/1131] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:42 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:43.736811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-83916ccc-6738-4368-8d55-12eebaa5f76d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:43.737487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-83916ccc-6738-4368-8d55-12eebaa5f76d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:43.748430 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83916ccc-6738-4368-8d55-12eebaa5f76d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:43.748918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83916ccc-6738-4368-8d55-12eebaa5f76d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:43.749397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83916ccc-6738-4368-8d55-12eebaa5f76d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:43.750112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83916ccc-6738-4368-8d55-12eebaa5f76d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:43.750572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83916ccc-6738-4368-8d55-12eebaa5f76d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:43.751003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83916ccc-6738-4368-8d55-12eebaa5f76d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:43.818582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-83916ccc-6738-4368-8d55-12eebaa5f76d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:43.826873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-83916ccc-6738-4368-8d55-12eebaa5f76d tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.093810 Oct 28 20:12:43.827448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 562/1132] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:43 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:43.962921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-000c2c79-183c-4cfb-ad4c-7c72c9766c0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:43.965877 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-000c2c79-183c-4cfb-ad4c-7c72c9766c0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:43.972454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-000c2c79-183c-4cfb-ad4c-7c72c9766c0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:43.972933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-000c2c79-183c-4cfb-ad4c-7c72c9766c0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:43.973379 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-000c2c79-183c-4cfb-ad4c-7c72c9766c0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:43.974068 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-000c2c79-183c-4cfb-ad4c-7c72c9766c0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:43.974515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-000c2c79-183c-4cfb-ad4c-7c72c9766c0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:43.974924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-000c2c79-183c-4cfb-ad4c-7c72c9766c0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:44.009068 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-000c2c79-183c-4cfb-ad4c-7c72c9766c0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050343 Oct 28 20:12:44.009587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 571/1133] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:43 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:44.039547 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fe0713cd-427e-43e1-a82c-dc01bdd865c9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:44.040151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fe0713cd-427e-43e1-a82c-dc01bdd865c9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:44.046695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe0713cd-427e-43e1-a82c-dc01bdd865c9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:44.047172 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe0713cd-427e-43e1-a82c-dc01bdd865c9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:44.047611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe0713cd-427e-43e1-a82c-dc01bdd865c9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:44.048291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe0713cd-427e-43e1-a82c-dc01bdd865c9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:44.048758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe0713cd-427e-43e1-a82c-dc01bdd865c9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:44.049211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe0713cd-427e-43e1-a82c-dc01bdd865c9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:44.178210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fe0713cd-427e-43e1-a82c-dc01bdd865c9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:44.186643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fe0713cd-427e-43e1-a82c-dc01bdd865c9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:44.188084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fe0713cd-427e-43e1-a82c-dc01bdd865c9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:44.189234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fe0713cd-427e-43e1-a82c-dc01bdd865c9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.153649 Oct 28 20:12:44.189837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 563/1134] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:44 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:44.850117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-acbfcb6a-f86b-4392-ac25-75bfeb2ed226 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:44.850878 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-acbfcb6a-f86b-4392-ac25-75bfeb2ed226 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:44.858086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acbfcb6a-f86b-4392-ac25-75bfeb2ed226 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:44.858572 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acbfcb6a-f86b-4392-ac25-75bfeb2ed226 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:44.859014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acbfcb6a-f86b-4392-ac25-75bfeb2ed226 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:44.859703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acbfcb6a-f86b-4392-ac25-75bfeb2ed226 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:44.860159 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acbfcb6a-f86b-4392-ac25-75bfeb2ed226 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:44.860585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acbfcb6a-f86b-4392-ac25-75bfeb2ed226 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:44.923902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-acbfcb6a-f86b-4392-ac25-75bfeb2ed226 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:44.931434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-acbfcb6a-f86b-4392-ac25-75bfeb2ed226 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085286 Oct 28 20:12:44.931995 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 572/1135] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:44 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:45.021357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b0c6a78a-3fd9-4ff1-8ad4-9177cbe84f72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:45.023502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b0c6a78a-3fd9-4ff1-8ad4-9177cbe84f72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:45.030561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0c6a78a-3fd9-4ff1-8ad4-9177cbe84f72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:45.031040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0c6a78a-3fd9-4ff1-8ad4-9177cbe84f72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:45.031473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0c6a78a-3fd9-4ff1-8ad4-9177cbe84f72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:45.032154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0c6a78a-3fd9-4ff1-8ad4-9177cbe84f72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:45.032600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0c6a78a-3fd9-4ff1-8ad4-9177cbe84f72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:45.033584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0c6a78a-3fd9-4ff1-8ad4-9177cbe84f72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:45.061959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b0c6a78a-3fd9-4ff1-8ad4-9177cbe84f72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044533 Oct 28 20:12:45.062502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 564/1136] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:45 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:45.215484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5a83a3a4-9999-4492-a749-5590fdea37e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:45.216098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5a83a3a4-9999-4492-a749-5590fdea37e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:45.222558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a83a3a4-9999-4492-a749-5590fdea37e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:45.223042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a83a3a4-9999-4492-a749-5590fdea37e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:45.223482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a83a3a4-9999-4492-a749-5590fdea37e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:45.224170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a83a3a4-9999-4492-a749-5590fdea37e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:45.224622 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a83a3a4-9999-4492-a749-5590fdea37e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:45.225046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a83a3a4-9999-4492-a749-5590fdea37e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:45.351837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5a83a3a4-9999-4492-a749-5590fdea37e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:45.360897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5a83a3a4-9999-4492-a749-5590fdea37e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:45.362373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5a83a3a4-9999-4492-a749-5590fdea37e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:45.363532 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5a83a3a4-9999-4492-a749-5590fdea37e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.152113 Oct 28 20:12:45.364094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 573/1137] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:45 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:45.953973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01d418ce-100a-43b5-9976-5b507017b789 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:45.954583 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-01d418ce-100a-43b5-9976-5b507017b789 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:45.960687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01d418ce-100a-43b5-9976-5b507017b789 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:45.961159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01d418ce-100a-43b5-9976-5b507017b789 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:45.961614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01d418ce-100a-43b5-9976-5b507017b789 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:45.962290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01d418ce-100a-43b5-9976-5b507017b789 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:45.962740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01d418ce-100a-43b5-9976-5b507017b789 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:45.963157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01d418ce-100a-43b5-9976-5b507017b789 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:46.023294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-01d418ce-100a-43b5-9976-5b507017b789 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:46.031090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-01d418ce-100a-43b5-9976-5b507017b789 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.080942 Oct 28 20:12:46.031653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 565/1138] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:45 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:46.074492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-568c7af3-1ef0-4829-8a51-f141a173e252 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:46.076640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-568c7af3-1ef0-4829-8a51-f141a173e252 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:46.082732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-568c7af3-1ef0-4829-8a51-f141a173e252 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:46.083215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-568c7af3-1ef0-4829-8a51-f141a173e252 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:46.083714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-568c7af3-1ef0-4829-8a51-f141a173e252 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:46.084633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-568c7af3-1ef0-4829-8a51-f141a173e252 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:46.085088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-568c7af3-1ef0-4829-8a51-f141a173e252 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:46.085543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-568c7af3-1ef0-4829-8a51-f141a173e252 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:46.119180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-568c7af3-1ef0-4829-8a51-f141a173e252 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048715 Oct 28 20:12:46.119737 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 574/1139] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:46 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:46.388207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-437083b3-c581-4b90-8eab-19bd3af8fec9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:46.388735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-437083b3-c581-4b90-8eab-19bd3af8fec9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:46.394683 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-437083b3-c581-4b90-8eab-19bd3af8fec9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:46.395169 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-437083b3-c581-4b90-8eab-19bd3af8fec9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:46.395611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-437083b3-c581-4b90-8eab-19bd3af8fec9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:46.396299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-437083b3-c581-4b90-8eab-19bd3af8fec9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:46.396757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-437083b3-c581-4b90-8eab-19bd3af8fec9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:46.397184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-437083b3-c581-4b90-8eab-19bd3af8fec9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:46.532889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-437083b3-c581-4b90-8eab-19bd3af8fec9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:46.541627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-437083b3-c581-4b90-8eab-19bd3af8fec9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:46.544328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-437083b3-c581-4b90-8eab-19bd3af8fec9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:46.545806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-437083b3-c581-4b90-8eab-19bd3af8fec9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.161417 Oct 28 20:12:46.546364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 566/1140] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:46 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:47.054494 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3c0015cc-5ff8-43de-8fe2-81e19e463abc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:47.055110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3c0015cc-5ff8-43de-8fe2-81e19e463abc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:47.061922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c0015cc-5ff8-43de-8fe2-81e19e463abc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:47.062406 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c0015cc-5ff8-43de-8fe2-81e19e463abc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:47.062841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c0015cc-5ff8-43de-8fe2-81e19e463abc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:47.063523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c0015cc-5ff8-43de-8fe2-81e19e463abc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:47.063973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c0015cc-5ff8-43de-8fe2-81e19e463abc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:47.064395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c0015cc-5ff8-43de-8fe2-81e19e463abc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:47.068336 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:47.124121 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3c0015cc-5ff8-43de-8fe2-81e19e463abc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:47.131975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3c0015cc-5ff8-43de-8fe2-81e19e463abc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081301 Oct 28 20:12:47.132190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aed0e927-db42-468f-b4cd-3d0557b25de9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:47.132598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 575/1141] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:47 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:47.134562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aed0e927-db42-468f-b4cd-3d0557b25de9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:47.142206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aed0e927-db42-468f-b4cd-3d0557b25de9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:47.142686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aed0e927-db42-468f-b4cd-3d0557b25de9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:47.143131 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aed0e927-db42-468f-b4cd-3d0557b25de9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:47.143823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aed0e927-db42-468f-b4cd-3d0557b25de9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:47.144278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aed0e927-db42-468f-b4cd-3d0557b25de9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:47.144706 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aed0e927-db42-468f-b4cd-3d0557b25de9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:47.174923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aed0e927-db42-468f-b4cd-3d0557b25de9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046803 Oct 28 20:12:47.175483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 567/1142] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:47 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:12:47.572115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a8f62be0-561a-4628-bebe-756b4f4186bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:47.573597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a8f62be0-561a-4628-bebe-756b4f4186bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:47.579483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8f62be0-561a-4628-bebe-756b4f4186bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:47.580004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8f62be0-561a-4628-bebe-756b4f4186bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:47.580442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8f62be0-561a-4628-bebe-756b4f4186bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:47.581135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8f62be0-561a-4628-bebe-756b4f4186bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:47.581613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8f62be0-561a-4628-bebe-756b4f4186bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:47.582045 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8f62be0-561a-4628-bebe-756b4f4186bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:47.712348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a8f62be0-561a-4628-bebe-756b4f4186bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:47.721311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a8f62be0-561a-4628-bebe-756b4f4186bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:47.722755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a8f62be0-561a-4628-bebe-756b4f4186bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:47.723893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a8f62be0-561a-4628-bebe-756b4f4186bd tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.155656 Oct 28 20:12:47.724437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 576/1143] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:47 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:48.155661 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e1974ac5-05ab-4354-a064-53a8efa65115 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:48.156277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e1974ac5-05ab-4354-a064-53a8efa65115 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:48.162771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1974ac5-05ab-4354-a064-53a8efa65115 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:48.163260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1974ac5-05ab-4354-a064-53a8efa65115 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:48.163699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1974ac5-05ab-4354-a064-53a8efa65115 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:48.164392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1974ac5-05ab-4354-a064-53a8efa65115 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:48.164848 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1974ac5-05ab-4354-a064-53a8efa65115 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:48.165275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1974ac5-05ab-4354-a064-53a8efa65115 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:48.187905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bed21cf5-b2d5-49b8-89ef-ed366a07af00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:48.190088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bed21cf5-b2d5-49b8-89ef-ed366a07af00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:48.196320 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bed21cf5-b2d5-49b8-89ef-ed366a07af00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:48.196797 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bed21cf5-b2d5-49b8-89ef-ed366a07af00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:48.197226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bed21cf5-b2d5-49b8-89ef-ed366a07af00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:48.197941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bed21cf5-b2d5-49b8-89ef-ed366a07af00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:48.199272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bed21cf5-b2d5-49b8-89ef-ed366a07af00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:48.199488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bed21cf5-b2d5-49b8-89ef-ed366a07af00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:48.230336 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e1974ac5-05ab-4354-a064-53a8efa65115 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:48.231357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bed21cf5-b2d5-49b8-89ef-ed366a07af00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047569 Oct 28 20:12:48.232132 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 577/1144] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:48 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:12:48.238335 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e1974ac5-05ab-4354-a064-53a8efa65115 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.087215 Oct 28 20:12:48.238894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 568/1145] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:48 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:48.750585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7da30dd3-b63e-467e-9d54-f176b574ab2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:48.751204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7da30dd3-b63e-467e-9d54-f176b574ab2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:48.756281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=80 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:48.758164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7da30dd3-b63e-467e-9d54-f176b574ab2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:48.762052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7da30dd3-b63e-467e-9d54-f176b574ab2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:48.762052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7da30dd3-b63e-467e-9d54-f176b574ab2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:48.762052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7da30dd3-b63e-467e-9d54-f176b574ab2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:48.762052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7da30dd3-b63e-467e-9d54-f176b574ab2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:48.762428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7da30dd3-b63e-467e-9d54-f176b574ab2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:48.892649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7da30dd3-b63e-467e-9d54-f176b574ab2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:48.901047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7da30dd3-b63e-467e-9d54-f176b574ab2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:48.902637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7da30dd3-b63e-467e-9d54-f176b574ab2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:48.903799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7da30dd3-b63e-467e-9d54-f176b574ab2f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.157058 Oct 28 20:12:48.904358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 578/1146] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:48 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:49.243692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aa21ce2a-433f-4b09-8903-d99a77d1a3c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:49.246024 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aa21ce2a-433f-4b09-8903-d99a77d1a3c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:49.252351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa21ce2a-433f-4b09-8903-d99a77d1a3c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:49.252833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa21ce2a-433f-4b09-8903-d99a77d1a3c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:49.253270 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa21ce2a-433f-4b09-8903-d99a77d1a3c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:49.253983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa21ce2a-433f-4b09-8903-d99a77d1a3c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:49.254438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa21ce2a-433f-4b09-8903-d99a77d1a3c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:49.254866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa21ce2a-433f-4b09-8903-d99a77d1a3c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:49.263395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-482e2c96-c358-43f6-ab2e-ce0b813a015c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:49.264037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-482e2c96-c358-43f6-ab2e-ce0b813a015c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:49.270594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-482e2c96-c358-43f6-ab2e-ce0b813a015c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:49.270838 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-482e2c96-c358-43f6-ab2e-ce0b813a015c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:49.271280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-482e2c96-c358-43f6-ab2e-ce0b813a015c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:49.272001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-482e2c96-c358-43f6-ab2e-ce0b813a015c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:49.272430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-482e2c96-c358-43f6-ab2e-ce0b813a015c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:49.272860 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-482e2c96-c358-43f6-ab2e-ce0b813a015c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:49.285094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aa21ce2a-433f-4b09-8903-d99a77d1a3c5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045273 Oct 28 20:12:49.285681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 569/1147] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:49 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:49.335427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-482e2c96-c358-43f6-ab2e-ce0b813a015c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:49.344115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-482e2c96-c358-43f6-ab2e-ce0b813a015c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084660 Oct 28 20:12:49.344664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 579/1148] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:49 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:49.929461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-98a21a3a-67f6-467d-9b57-85c380bd9111 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:49.930014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-98a21a3a-67f6-467d-9b57-85c380bd9111 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:49.936389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a21a3a-67f6-467d-9b57-85c380bd9111 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:49.936871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a21a3a-67f6-467d-9b57-85c380bd9111 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:49.937308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a21a3a-67f6-467d-9b57-85c380bd9111 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:49.938033 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a21a3a-67f6-467d-9b57-85c380bd9111 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:49.938472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a21a3a-67f6-467d-9b57-85c380bd9111 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:49.938897 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a21a3a-67f6-467d-9b57-85c380bd9111 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:50.066419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-98a21a3a-67f6-467d-9b57-85c380bd9111 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:50.075571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-98a21a3a-67f6-467d-9b57-85c380bd9111 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:50.077024 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-98a21a3a-67f6-467d-9b57-85c380bd9111 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:50.078307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-98a21a3a-67f6-467d-9b57-85c380bd9111 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.152698 Oct 28 20:12:50.078922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 570/1149] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:49 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:50.297977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0c372f07-c5dd-4967-be20-baef4dc06713 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:50.300134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0c372f07-c5dd-4967-be20-baef4dc06713 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:50.306558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c372f07-c5dd-4967-be20-baef4dc06713 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:50.307037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c372f07-c5dd-4967-be20-baef4dc06713 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:50.307504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c372f07-c5dd-4967-be20-baef4dc06713 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:50.308184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c372f07-c5dd-4967-be20-baef4dc06713 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:50.308668 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c372f07-c5dd-4967-be20-baef4dc06713 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:50.309118 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c372f07-c5dd-4967-be20-baef4dc06713 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:50.340304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0c372f07-c5dd-4967-be20-baef4dc06713 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046238 Oct 28 20:12:50.340859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 580/1150] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:50 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:50.367186 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ad518f4-2ceb-4453-bcc1-87bdcfab9d26 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:50.367826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6ad518f4-2ceb-4453-bcc1-87bdcfab9d26 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:50.374216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad518f4-2ceb-4453-bcc1-87bdcfab9d26 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:50.374695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad518f4-2ceb-4453-bcc1-87bdcfab9d26 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:50.375129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad518f4-2ceb-4453-bcc1-87bdcfab9d26 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:50.375814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad518f4-2ceb-4453-bcc1-87bdcfab9d26 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:50.376296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad518f4-2ceb-4453-bcc1-87bdcfab9d26 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:50.376749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad518f4-2ceb-4453-bcc1-87bdcfab9d26 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:50.438219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6ad518f4-2ceb-4453-bcc1-87bdcfab9d26 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:50.445760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6ad518f4-2ceb-4453-bcc1-87bdcfab9d26 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082369 Oct 28 20:12:50.446321 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 571/1151] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:50 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:51.106143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d77dd79e-c9ad-43de-a354-803461a1c69b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:51.106471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d77dd79e-c9ad-43de-a354-803461a1c69b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:51.112399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d77dd79e-c9ad-43de-a354-803461a1c69b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:51.112912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d77dd79e-c9ad-43de-a354-803461a1c69b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:51.113371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d77dd79e-c9ad-43de-a354-803461a1c69b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:51.114056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d77dd79e-c9ad-43de-a354-803461a1c69b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:51.114512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d77dd79e-c9ad-43de-a354-803461a1c69b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:51.114936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d77dd79e-c9ad-43de-a354-803461a1c69b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:51.243189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d77dd79e-c9ad-43de-a354-803461a1c69b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:51.252138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d77dd79e-c9ad-43de-a354-803461a1c69b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:51.253682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d77dd79e-c9ad-43de-a354-803461a1c69b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:51.254846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d77dd79e-c9ad-43de-a354-803461a1c69b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.153375 Oct 28 20:12:51.255407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 581/1152] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:51 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:51.352118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2a4763aa-8ff1-4cfe-83ac-66c235782858 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:51.354257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2a4763aa-8ff1-4cfe-83ac-66c235782858 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:51.356917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=84 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:51.362448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a4763aa-8ff1-4cfe-83ac-66c235782858 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:51.362935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a4763aa-8ff1-4cfe-83ac-66c235782858 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:51.363376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a4763aa-8ff1-4cfe-83ac-66c235782858 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:51.364068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a4763aa-8ff1-4cfe-83ac-66c235782858 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:51.364526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a4763aa-8ff1-4cfe-83ac-66c235782858 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:51.364954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a4763aa-8ff1-4cfe-83ac-66c235782858 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:51.395546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2a4763aa-8ff1-4cfe-83ac-66c235782858 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047455 Oct 28 20:12:51.396210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 572/1153] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:51 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:51.469996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9f7c4ec4-36e4-4326-bf50-8e93ad84084b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:51.470615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9f7c4ec4-36e4-4326-bf50-8e93ad84084b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:51.476923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f7c4ec4-36e4-4326-bf50-8e93ad84084b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:51.477449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f7c4ec4-36e4-4326-bf50-8e93ad84084b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:51.477926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f7c4ec4-36e4-4326-bf50-8e93ad84084b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:51.478618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f7c4ec4-36e4-4326-bf50-8e93ad84084b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:51.479076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f7c4ec4-36e4-4326-bf50-8e93ad84084b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:51.479503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f7c4ec4-36e4-4326-bf50-8e93ad84084b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:51.544783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9f7c4ec4-36e4-4326-bf50-8e93ad84084b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:51.552369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9f7c4ec4-36e4-4326-bf50-8e93ad84084b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.087018 Oct 28 20:12:51.552936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 582/1154] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:51 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:52.280728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6687dde9-587e-4dce-9b45-7c3cbb447a9c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:52.281393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6687dde9-587e-4dce-9b45-7c3cbb447a9c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:52.287363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6687dde9-587e-4dce-9b45-7c3cbb447a9c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:52.287853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6687dde9-587e-4dce-9b45-7c3cbb447a9c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:52.288292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6687dde9-587e-4dce-9b45-7c3cbb447a9c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:52.288983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6687dde9-587e-4dce-9b45-7c3cbb447a9c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:52.289463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6687dde9-587e-4dce-9b45-7c3cbb447a9c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:52.289889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6687dde9-587e-4dce-9b45-7c3cbb447a9c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:52.408349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0618013f-c608-414d-baf6-ab6ff72975f1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:52.410533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0618013f-c608-414d-baf6-ab6ff72975f1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:52.416457 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0618013f-c608-414d-baf6-ab6ff72975f1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:52.416941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0618013f-c608-414d-baf6-ab6ff72975f1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:52.417403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0618013f-c608-414d-baf6-ab6ff72975f1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:52.418147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0618013f-c608-414d-baf6-ab6ff72975f1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:52.418414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6687dde9-587e-4dce-9b45-7c3cbb447a9c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:52.419082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0618013f-c608-414d-baf6-ab6ff72975f1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:52.419233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0618013f-c608-414d-baf6-ab6ff72975f1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:52.427021 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6687dde9-587e-4dce-9b45-7c3cbb447a9c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:52.428468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6687dde9-587e-4dce-9b45-7c3cbb447a9c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:52.429655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6687dde9-587e-4dce-9b45-7c3cbb447a9c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.153849 Oct 28 20:12:52.430217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 573/1155] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:52 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:52.448920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0618013f-c608-414d-baf6-ab6ff72975f1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044589 Oct 28 20:12:52.450125 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 583/1156] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:52 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:12:52.575079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-711bcd60-a3d1-440e-947e-9d54e394e1fc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:52.575691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-711bcd60-a3d1-440e-947e-9d54e394e1fc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:52.581540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-711bcd60-a3d1-440e-947e-9d54e394e1fc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:52.582015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-711bcd60-a3d1-440e-947e-9d54e394e1fc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:52.582444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-711bcd60-a3d1-440e-947e-9d54e394e1fc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:52.583131 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-711bcd60-a3d1-440e-947e-9d54e394e1fc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:52.583573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-711bcd60-a3d1-440e-947e-9d54e394e1fc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:52.584291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-711bcd60-a3d1-440e-947e-9d54e394e1fc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:52.645921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-711bcd60-a3d1-440e-947e-9d54e394e1fc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:52.648092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:52.654658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-711bcd60-a3d1-440e-947e-9d54e394e1fc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.083610 Oct 28 20:12:52.655224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 574/1157] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:52 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:53.456532 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2ed4fddb-7b62-4264-9dd5-7f5321ca6452 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:53.457123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2ed4fddb-7b62-4264-9dd5-7f5321ca6452 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:53.460027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:12:53.460184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:12:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 (ip 10.222.0.66) !!! Oct 28 20:12:53.464268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-50410cae-1154-4a5f-9cdf-08dac378a511 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:53.468617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-50410cae-1154-4a5f-9cdf-08dac378a511 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:53.469544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed4fddb-7b62-4264-9dd5-7f5321ca6452 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:53.470039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed4fddb-7b62-4264-9dd5-7f5321ca6452 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:53.470487 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed4fddb-7b62-4264-9dd5-7f5321ca6452 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:53.471190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed4fddb-7b62-4264-9dd5-7f5321ca6452 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:53.471648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed4fddb-7b62-4264-9dd5-7f5321ca6452 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:53.472077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed4fddb-7b62-4264-9dd5-7f5321ca6452 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:53.476645 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50410cae-1154-4a5f-9cdf-08dac378a511 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:53.478219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50410cae-1154-4a5f-9cdf-08dac378a511 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:53.478219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50410cae-1154-4a5f-9cdf-08dac378a511 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:53.478465 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50410cae-1154-4a5f-9cdf-08dac378a511 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:53.478702 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50410cae-1154-4a5f-9cdf-08dac378a511 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:53.479123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50410cae-1154-4a5f-9cdf-08dac378a511 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:53.508596 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-50410cae-1154-4a5f-9cdf-08dac378a511 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050718 Oct 28 20:12:53.509313 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 575/1158] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:53 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:12:53.606714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ed4fddb-7b62-4264-9dd5-7f5321ca6452 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:53.615232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ed4fddb-7b62-4264-9dd5-7f5321ca6452 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:53.616658 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ed4fddb-7b62-4264-9dd5-7f5321ca6452 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:53.617836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2ed4fddb-7b62-4264-9dd5-7f5321ca6452 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.165263 Oct 28 20:12:53.618385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 584/1159] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:53 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:53.677604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d8b27791-a583-48e2-aeb1-c5cf6a52e8db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:53.678222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d8b27791-a583-48e2-aeb1-c5cf6a52e8db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:53.684806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8b27791-a583-48e2-aeb1-c5cf6a52e8db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:53.685342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8b27791-a583-48e2-aeb1-c5cf6a52e8db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:53.685782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8b27791-a583-48e2-aeb1-c5cf6a52e8db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:53.686476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8b27791-a583-48e2-aeb1-c5cf6a52e8db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:53.686931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8b27791-a583-48e2-aeb1-c5cf6a52e8db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:53.687360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8b27791-a583-48e2-aeb1-c5cf6a52e8db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:53.746963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d8b27791-a583-48e2-aeb1-c5cf6a52e8db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:53.754393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d8b27791-a583-48e2-aeb1-c5cf6a52e8db tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.080664 Oct 28 20:12:53.754956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 576/1160] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:53 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:54.521659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fd5f68a6-982c-472d-8ab8-5a38e2a01fb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:54.523820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fd5f68a6-982c-472d-8ab8-5a38e2a01fb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:54.530933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd5f68a6-982c-472d-8ab8-5a38e2a01fb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:54.531418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd5f68a6-982c-472d-8ab8-5a38e2a01fb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:54.531857 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd5f68a6-982c-472d-8ab8-5a38e2a01fb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:54.532549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd5f68a6-982c-472d-8ab8-5a38e2a01fb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:54.533021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd5f68a6-982c-472d-8ab8-5a38e2a01fb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:54.533470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd5f68a6-982c-472d-8ab8-5a38e2a01fb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:54.562940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fd5f68a6-982c-472d-8ab8-5a38e2a01fb8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045296 Oct 28 20:12:54.563485 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 585/1161] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:54 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:54.644077 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-21a74b60-bcac-49b3-a507-f953deb5cc95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:54.644746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-21a74b60-bcac-49b3-a507-f953deb5cc95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:54.650732 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21a74b60-bcac-49b3-a507-f953deb5cc95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:54.651219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21a74b60-bcac-49b3-a507-f953deb5cc95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:54.651659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21a74b60-bcac-49b3-a507-f953deb5cc95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:54.652881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21a74b60-bcac-49b3-a507-f953deb5cc95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:54.653365 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21a74b60-bcac-49b3-a507-f953deb5cc95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:54.653794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21a74b60-bcac-49b3-a507-f953deb5cc95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:54.776437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e30a8740-7384-440f-aef2-f267fd925b6a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:54.776963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e30a8740-7384-440f-aef2-f267fd925b6a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:54.780193 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-21a74b60-bcac-49b3-a507-f953deb5cc95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:54.783575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e30a8740-7384-440f-aef2-f267fd925b6a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:54.784125 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e30a8740-7384-440f-aef2-f267fd925b6a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:54.784626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e30a8740-7384-440f-aef2-f267fd925b6a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:54.785425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e30a8740-7384-440f-aef2-f267fd925b6a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:54.785945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e30a8740-7384-440f-aef2-f267fd925b6a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:54.786435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e30a8740-7384-440f-aef2-f267fd925b6a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:54.788699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-21a74b60-bcac-49b3-a507-f953deb5cc95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:54.790196 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-21a74b60-bcac-49b3-a507-f953deb5cc95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:54.791414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-21a74b60-bcac-49b3-a507-f953deb5cc95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.151475 Oct 28 20:12:54.791972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 577/1162] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:54 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:54.851924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e30a8740-7384-440f-aef2-f267fd925b6a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:54.860004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e30a8740-7384-440f-aef2-f267fd925b6a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.087511 Oct 28 20:12:54.860557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 586/1163] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:54 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:12:55.575776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-de7220b4-e0ca-42cd-8d1c-73249ec9764c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:55.577987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-de7220b4-e0ca-42cd-8d1c-73249ec9764c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:55.584164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de7220b4-e0ca-42cd-8d1c-73249ec9764c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.593525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de7220b4-e0ca-42cd-8d1c-73249ec9764c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.593525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de7220b4-e0ca-42cd-8d1c-73249ec9764c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.593525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de7220b4-e0ca-42cd-8d1c-73249ec9764c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.593525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de7220b4-e0ca-42cd-8d1c-73249ec9764c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.593890 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de7220b4-e0ca-42cd-8d1c-73249ec9764c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.616541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-de7220b4-e0ca-42cd-8d1c-73249ec9764c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045447 Oct 28 20:12:55.617099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 578/1164] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:55 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:55.817484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2c5af473-fa25-4146-bf02-9f05b92d99d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:55.818099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2c5af473-fa25-4146-bf02-9f05b92d99d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:55.824440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5af473-fa25-4146-bf02-9f05b92d99d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.824924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5af473-fa25-4146-bf02-9f05b92d99d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.825414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5af473-fa25-4146-bf02-9f05b92d99d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.827044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5af473-fa25-4146-bf02-9f05b92d99d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.827480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5af473-fa25-4146-bf02-9f05b92d99d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.827910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5af473-fa25-4146-bf02-9f05b92d99d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.883593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f6e78f8f-0bf3-4475-ba4d-9592e70e0116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:55.884204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f6e78f8f-0bf3-4475-ba4d-9592e70e0116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:55.891337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6e78f8f-0bf3-4475-ba4d-9592e70e0116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.891844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6e78f8f-0bf3-4475-ba4d-9592e70e0116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.892279 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6e78f8f-0bf3-4475-ba4d-9592e70e0116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.892969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6e78f8f-0bf3-4475-ba4d-9592e70e0116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.893443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6e78f8f-0bf3-4475-ba4d-9592e70e0116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.893863 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6e78f8f-0bf3-4475-ba4d-9592e70e0116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.964020 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f6e78f8f-0bf3-4475-ba4d-9592e70e0116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:55.971754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f6e78f8f-0bf3-4475-ba4d-9592e70e0116 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.092017 Oct 28 20:12:55.972323 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 579/1165] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:55 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:12:55.980260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2c5af473-fa25-4146-bf02-9f05b92d99d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:55.988835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2c5af473-fa25-4146-bf02-9f05b92d99d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:55.990306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2c5af473-fa25-4146-bf02-9f05b92d99d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:55.991460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2c5af473-fa25-4146-bf02-9f05b92d99d2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.177933 Oct 28 20:12:55.992010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 587/1166] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:55 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:56.629575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b261033f-a33a-4f1f-a49d-7dac2c04170d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:56.631822 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b261033f-a33a-4f1f-a49d-7dac2c04170d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:56.637795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b261033f-a33a-4f1f-a49d-7dac2c04170d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:56.638272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b261033f-a33a-4f1f-a49d-7dac2c04170d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:56.638699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b261033f-a33a-4f1f-a49d-7dac2c04170d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:56.639375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b261033f-a33a-4f1f-a49d-7dac2c04170d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:56.640488 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b261033f-a33a-4f1f-a49d-7dac2c04170d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:56.640954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b261033f-a33a-4f1f-a49d-7dac2c04170d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:56.670331 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b261033f-a33a-4f1f-a49d-7dac2c04170d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044803 Oct 28 20:12:56.671540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 580/1167] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:56 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:56.994393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3743007b-1ac3-4432-9d8c-ad4b679ec3e3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:56.995006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3743007b-1ac3-4432-9d8c-ad4b679ec3e3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:57.002096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3743007b-1ac3-4432-9d8c-ad4b679ec3e3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:57.002554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3743007b-1ac3-4432-9d8c-ad4b679ec3e3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:57.002989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3743007b-1ac3-4432-9d8c-ad4b679ec3e3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:57.003668 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3743007b-1ac3-4432-9d8c-ad4b679ec3e3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:57.004119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3743007b-1ac3-4432-9d8c-ad4b679ec3e3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:57.004541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3743007b-1ac3-4432-9d8c-ad4b679ec3e3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:57.017019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2c1b6c96-a0dc-41db-9e35-b273ec21a978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:57.017663 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2c1b6c96-a0dc-41db-9e35-b273ec21a978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:57.023912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c1b6c96-a0dc-41db-9e35-b273ec21a978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:57.024399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c1b6c96-a0dc-41db-9e35-b273ec21a978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:57.024838 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c1b6c96-a0dc-41db-9e35-b273ec21a978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:57.025598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c1b6c96-a0dc-41db-9e35-b273ec21a978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:57.026059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c1b6c96-a0dc-41db-9e35-b273ec21a978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:57.026486 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c1b6c96-a0dc-41db-9e35-b273ec21a978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:57.067964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3743007b-1ac3-4432-9d8c-ad4b679ec3e3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:57.075756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3743007b-1ac3-4432-9d8c-ad4b679ec3e3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085187 Oct 28 20:12:57.076327 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 588/1168] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:56 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:57.164673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2c1b6c96-a0dc-41db-9e35-b273ec21a978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:57.173668 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2c1b6c96-a0dc-41db-9e35-b273ec21a978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:57.175104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2c1b6c96-a0dc-41db-9e35-b273ec21a978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:57.176244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2c1b6c96-a0dc-41db-9e35-b273ec21a978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.163113 Oct 28 20:12:57.176796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 581/1169] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:57 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:12:57.683767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-276ed07a-64f6-4eaa-bf28-9260411fb44a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:57.685951 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-276ed07a-64f6-4eaa-bf28-9260411fb44a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:57.692263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-276ed07a-64f6-4eaa-bf28-9260411fb44a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:57.692744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-276ed07a-64f6-4eaa-bf28-9260411fb44a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:57.693178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-276ed07a-64f6-4eaa-bf28-9260411fb44a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:57.693894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-276ed07a-64f6-4eaa-bf28-9260411fb44a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:57.694350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-276ed07a-64f6-4eaa-bf28-9260411fb44a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:57.694776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-276ed07a-64f6-4eaa-bf28-9260411fb44a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:57.725611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-276ed07a-64f6-4eaa-bf28-9260411fb44a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045876 Oct 28 20:12:57.726157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 589/1170] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:57 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:58.098891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f348ed3a-d0dd-4919-a9ea-8e50a471cf86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:58.099533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f348ed3a-d0dd-4919-a9ea-8e50a471cf86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:58.106230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f348ed3a-d0dd-4919-a9ea-8e50a471cf86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:58.106712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f348ed3a-d0dd-4919-a9ea-8e50a471cf86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:58.107151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f348ed3a-d0dd-4919-a9ea-8e50a471cf86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:58.107876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f348ed3a-d0dd-4919-a9ea-8e50a471cf86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:58.108483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f348ed3a-d0dd-4919-a9ea-8e50a471cf86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:58.109168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f348ed3a-d0dd-4919-a9ea-8e50a471cf86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:58.180851 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f348ed3a-d0dd-4919-a9ea-8e50a471cf86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:58.188578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f348ed3a-d0dd-4919-a9ea-8e50a471cf86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.093584 Oct 28 20:12:58.189148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 582/1171] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:58 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:58.202057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32984765-e715-4d85-9a2c-b0c5405109f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:58.202681 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-32984765-e715-4d85-9a2c-b0c5405109f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:58.209366 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32984765-e715-4d85-9a2c-b0c5405109f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:58.209812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32984765-e715-4d85-9a2c-b0c5405109f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:58.210232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32984765-e715-4d85-9a2c-b0c5405109f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:58.210945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32984765-e715-4d85-9a2c-b0c5405109f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:58.211398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32984765-e715-4d85-9a2c-b0c5405109f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:58.211816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32984765-e715-4d85-9a2c-b0c5405109f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:58.343935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-32984765-e715-4d85-9a2c-b0c5405109f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:58.353206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-32984765-e715-4d85-9a2c-b0c5405109f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:58.354683 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-32984765-e715-4d85-9a2c-b0c5405109f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:58.355901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-32984765-e715-4d85-9a2c-b0c5405109f1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1753 microversion: 2.20 time: 0.157806 Oct 28 20:12:58.356439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 590/1172] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:58 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:58.739298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-65f8b437-df4f-4745-b219-f071661cf5d1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:58.741501 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-65f8b437-df4f-4745-b219-f071661cf5d1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:58.747524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65f8b437-df4f-4745-b219-f071661cf5d1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:58.748135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65f8b437-df4f-4745-b219-f071661cf5d1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:58.748575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65f8b437-df4f-4745-b219-f071661cf5d1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:58.750294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65f8b437-df4f-4745-b219-f071661cf5d1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:58.750759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65f8b437-df4f-4745-b219-f071661cf5d1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:58.751188 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65f8b437-df4f-4745-b219-f071661cf5d1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:58.782229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-65f8b437-df4f-4745-b219-f071661cf5d1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047438 Oct 28 20:12:58.782785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 583/1173] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:58 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:59.211272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b86d826b-10b7-419a-b178-24910ab7f7f3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:59.211900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b86d826b-10b7-419a-b178-24910ab7f7f3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:59.218973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b86d826b-10b7-419a-b178-24910ab7f7f3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:59.219451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b86d826b-10b7-419a-b178-24910ab7f7f3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:59.219892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b86d826b-10b7-419a-b178-24910ab7f7f3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:59.220576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b86d826b-10b7-419a-b178-24910ab7f7f3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:59.221035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b86d826b-10b7-419a-b178-24910ab7f7f3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:59.221484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b86d826b-10b7-419a-b178-24910ab7f7f3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:59.285051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b86d826b-10b7-419a-b178-24910ab7f7f3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:59.288380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:59.292834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b86d826b-10b7-419a-b178-24910ab7f7f3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085634 Oct 28 20:12:59.293409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 591/1174] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:59 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:59.381480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-55c7567c-e7ec-48a3-93f7-fb05cc0b5e1d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:59.382104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-55c7567c-e7ec-48a3-93f7-fb05cc0b5e1d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:59.388913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55c7567c-e7ec-48a3-93f7-fb05cc0b5e1d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:59.389949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55c7567c-e7ec-48a3-93f7-fb05cc0b5e1d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:59.391084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55c7567c-e7ec-48a3-93f7-fb05cc0b5e1d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:59.391796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55c7567c-e7ec-48a3-93f7-fb05cc0b5e1d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:59.392259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55c7567c-e7ec-48a3-93f7-fb05cc0b5e1d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:59.392686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55c7567c-e7ec-48a3-93f7-fb05cc0b5e1d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:59.531818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-55c7567c-e7ec-48a3-93f7-fb05cc0b5e1d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:59.540338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-55c7567c-e7ec-48a3-93f7-fb05cc0b5e1d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:59.541741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-55c7567c-e7ec-48a3-93f7-fb05cc0b5e1d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:59.542883 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-55c7567c-e7ec-48a3-93f7-fb05cc0b5e1d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.165569 Oct 28 20:12:59.543424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 584/1175] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:12:59 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:12:59.795120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d7da970f-5ae8-4498-9f0e-afd9f4f7877c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:59.797574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d7da970f-5ae8-4498-9f0e-afd9f4f7877c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:59.803625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7da970f-5ae8-4498-9f0e-afd9f4f7877c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:59.804101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7da970f-5ae8-4498-9f0e-afd9f4f7877c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:59.804538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7da970f-5ae8-4498-9f0e-afd9f4f7877c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:59.805236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7da970f-5ae8-4498-9f0e-afd9f4f7877c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:59.805699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7da970f-5ae8-4498-9f0e-afd9f4f7877c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:59.806123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7da970f-5ae8-4498-9f0e-afd9f4f7877c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:59.835858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d7da970f-5ae8-4498-9f0e-afd9f4f7877c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045090 Oct 28 20:12:59.836402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 592/1176] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:59 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:00.314851 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a433610-eb54-4b4b-923b-8b15509293fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:00.315469 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a433610-eb54-4b4b-923b-8b15509293fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:00.321427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a433610-eb54-4b4b-923b-8b15509293fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:00.321918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a433610-eb54-4b4b-923b-8b15509293fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:00.322362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a433610-eb54-4b4b-923b-8b15509293fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:00.323053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a433610-eb54-4b4b-923b-8b15509293fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:00.323511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a433610-eb54-4b4b-923b-8b15509293fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:00.323940 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a433610-eb54-4b4b-923b-8b15509293fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:00.384364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1a433610-eb54-4b4b-923b-8b15509293fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:00.393409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a433610-eb54-4b4b-923b-8b15509293fa tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082895 Oct 28 20:13:00.393970 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 585/1177] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:00 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:00.569133 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-16c90219-8531-45f9-8fe0-735c384cab81 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:00.569777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-16c90219-8531-45f9-8fe0-735c384cab81 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:00.576359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16c90219-8531-45f9-8fe0-735c384cab81 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:00.576842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16c90219-8531-45f9-8fe0-735c384cab81 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:00.577882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16c90219-8531-45f9-8fe0-735c384cab81 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:00.578659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16c90219-8531-45f9-8fe0-735c384cab81 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:00.579015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16c90219-8531-45f9-8fe0-735c384cab81 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:00.588789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16c90219-8531-45f9-8fe0-735c384cab81 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:00.711753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-16c90219-8531-45f9-8fe0-735c384cab81 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:00.720840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-16c90219-8531-45f9-8fe0-735c384cab81 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:00.722302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-16c90219-8531-45f9-8fe0-735c384cab81 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:00.723455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-16c90219-8531-45f9-8fe0-735c384cab81 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.158182 Oct 28 20:13:00.724012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 593/1178] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:00 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:00.848334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ec7b9dbe-65d2-4db0-9e48-952e87ad839d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:00.850466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ec7b9dbe-65d2-4db0-9e48-952e87ad839d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:00.856368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7b9dbe-65d2-4db0-9e48-952e87ad839d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:00.856850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7b9dbe-65d2-4db0-9e48-952e87ad839d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:00.857285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7b9dbe-65d2-4db0-9e48-952e87ad839d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:00.857994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7b9dbe-65d2-4db0-9e48-952e87ad839d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:00.859198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7b9dbe-65d2-4db0-9e48-952e87ad839d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:00.859563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7b9dbe-65d2-4db0-9e48-952e87ad839d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:00.888376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ec7b9dbe-65d2-4db0-9e48-952e87ad839d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044076 Oct 28 20:13:00.888915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 586/1179] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:00 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:01.416411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bfef6747-b1a9-4e4b-8044-bd3a224a9ba0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:01.416940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bfef6747-b1a9-4e4b-8044-bd3a224a9ba0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:01.423576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfef6747-b1a9-4e4b-8044-bd3a224a9ba0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:01.424056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfef6747-b1a9-4e4b-8044-bd3a224a9ba0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:01.424488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfef6747-b1a9-4e4b-8044-bd3a224a9ba0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:01.425172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfef6747-b1a9-4e4b-8044-bd3a224a9ba0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:01.425661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfef6747-b1a9-4e4b-8044-bd3a224a9ba0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:01.426086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfef6747-b1a9-4e4b-8044-bd3a224a9ba0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:01.485635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bfef6747-b1a9-4e4b-8044-bd3a224a9ba0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:01.493182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bfef6747-b1a9-4e4b-8044-bd3a224a9ba0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.080696 Oct 28 20:13:01.493797 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 594/1180] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:01 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:01.748604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-65c7305b-78fc-4c37-b421-c4b163edd00e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:01.749228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-65c7305b-78fc-4c37-b421-c4b163edd00e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:01.755604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65c7305b-78fc-4c37-b421-c4b163edd00e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:01.756080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65c7305b-78fc-4c37-b421-c4b163edd00e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:01.756512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65c7305b-78fc-4c37-b421-c4b163edd00e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:01.757189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65c7305b-78fc-4c37-b421-c4b163edd00e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:01.757662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65c7305b-78fc-4c37-b421-c4b163edd00e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:01.758080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65c7305b-78fc-4c37-b421-c4b163edd00e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:01.883538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-65c7305b-78fc-4c37-b421-c4b163edd00e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:01.892971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-65c7305b-78fc-4c37-b421-c4b163edd00e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:01.894457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-65c7305b-78fc-4c37-b421-c4b163edd00e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:01.896609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-65c7305b-78fc-4c37-b421-c4b163edd00e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.151805 Oct 28 20:13:01.897164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 587/1181] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:01 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:01.901466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-99c76f40-42f3-4cf3-beeb-6ed1c9684d68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:01.903712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-99c76f40-42f3-4cf3-beeb-6ed1c9684d68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:01.917558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99c76f40-42f3-4cf3-beeb-6ed1c9684d68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:01.918048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99c76f40-42f3-4cf3-beeb-6ed1c9684d68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:01.918488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99c76f40-42f3-4cf3-beeb-6ed1c9684d68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:01.919191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99c76f40-42f3-4cf3-beeb-6ed1c9684d68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:01.919645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99c76f40-42f3-4cf3-beeb-6ed1c9684d68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:01.920075 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99c76f40-42f3-4cf3-beeb-6ed1c9684d68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:01.949648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-99c76f40-42f3-4cf3-beeb-6ed1c9684d68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052284 Oct 28 20:13:01.950240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 595/1182] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:01 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:13:02.516671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c95bf90b-6a63-4237-940e-ed98da7638fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:02.517333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c95bf90b-6a63-4237-940e-ed98da7638fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:02.523227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c95bf90b-6a63-4237-940e-ed98da7638fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:02.523705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c95bf90b-6a63-4237-940e-ed98da7638fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:02.524138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c95bf90b-6a63-4237-940e-ed98da7638fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:02.524845 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c95bf90b-6a63-4237-940e-ed98da7638fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:02.525291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c95bf90b-6a63-4237-940e-ed98da7638fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:02.525734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c95bf90b-6a63-4237-940e-ed98da7638fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:02.589417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c95bf90b-6a63-4237-940e-ed98da7638fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:02.598135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c95bf90b-6a63-4237-940e-ed98da7638fe tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.086024 Oct 28 20:13:02.598716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 588/1183] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:02 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:02.922033 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eb5b34a9-1699-41df-bc9d-fcc232dca2f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:02.922551 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eb5b34a9-1699-41df-bc9d-fcc232dca2f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:02.928863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb5b34a9-1699-41df-bc9d-fcc232dca2f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:02.929493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb5b34a9-1699-41df-bc9d-fcc232dca2f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:02.929937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb5b34a9-1699-41df-bc9d-fcc232dca2f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:02.930619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb5b34a9-1699-41df-bc9d-fcc232dca2f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:02.931071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb5b34a9-1699-41df-bc9d-fcc232dca2f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:02.931493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb5b34a9-1699-41df-bc9d-fcc232dca2f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:02.963157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ebc1a2a-cdf5-4e8b-a5dd-1ed4945f6659 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:02.965352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ebc1a2a-cdf5-4e8b-a5dd-1ed4945f6659 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:02.971950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ebc1a2a-cdf5-4e8b-a5dd-1ed4945f6659 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:02.972435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ebc1a2a-cdf5-4e8b-a5dd-1ed4945f6659 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:02.972878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ebc1a2a-cdf5-4e8b-a5dd-1ed4945f6659 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:02.973598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ebc1a2a-cdf5-4e8b-a5dd-1ed4945f6659 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:02.974053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ebc1a2a-cdf5-4e8b-a5dd-1ed4945f6659 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:02.974475 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ebc1a2a-cdf5-4e8b-a5dd-1ed4945f6659 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:03.004760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ebc1a2a-cdf5-4e8b-a5dd-1ed4945f6659 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045783 Oct 28 20:13:03.005341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 589/1184] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:02 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:13:03.062269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-eb5b34a9-1699-41df-bc9d-fcc232dca2f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:03.070705 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-eb5b34a9-1699-41df-bc9d-fcc232dca2f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:03.072144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-eb5b34a9-1699-41df-bc9d-fcc232dca2f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:03.073301 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eb5b34a9-1699-41df-bc9d-fcc232dca2f0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.155422 Oct 28 20:13:03.073877 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 596/1185] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:02 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:03.621285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ead2ef7-3b4c-4d1b-97c9-6580f6f2a85e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:03.621849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ead2ef7-3b4c-4d1b-97c9-6580f6f2a85e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:03.628678 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ead2ef7-3b4c-4d1b-97c9-6580f6f2a85e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:03.629167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ead2ef7-3b4c-4d1b-97c9-6580f6f2a85e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:03.629648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ead2ef7-3b4c-4d1b-97c9-6580f6f2a85e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:03.630341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ead2ef7-3b4c-4d1b-97c9-6580f6f2a85e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:03.632290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ead2ef7-3b4c-4d1b-97c9-6580f6f2a85e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:03.632290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ead2ef7-3b4c-4d1b-97c9-6580f6f2a85e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:03.694422 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0ead2ef7-3b4c-4d1b-97c9-6580f6f2a85e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:03.703397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ead2ef7-3b4c-4d1b-97c9-6580f6f2a85e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085920 Oct 28 20:13:03.704161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 590/1186] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:03 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:04.017092 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7961c1cf-6a88-495c-993e-e9f317a2b898 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:04.019265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7961c1cf-6a88-495c-993e-e9f317a2b898 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:04.025783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7961c1cf-6a88-495c-993e-e9f317a2b898 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:04.026270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7961c1cf-6a88-495c-993e-e9f317a2b898 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:04.026711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7961c1cf-6a88-495c-993e-e9f317a2b898 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:04.027402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7961c1cf-6a88-495c-993e-e9f317a2b898 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:04.027854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7961c1cf-6a88-495c-993e-e9f317a2b898 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:04.028275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7961c1cf-6a88-495c-993e-e9f317a2b898 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:04.057417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7961c1cf-6a88-495c-993e-e9f317a2b898 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044211 Oct 28 20:13:04.057963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 597/1187] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:04 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:04.102392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-75a2f6f8-4488-4d7d-970c-cd3e4bb475c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:04.103041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-75a2f6f8-4488-4d7d-970c-cd3e4bb475c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:04.110516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75a2f6f8-4488-4d7d-970c-cd3e4bb475c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:04.111005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75a2f6f8-4488-4d7d-970c-cd3e4bb475c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:04.111449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75a2f6f8-4488-4d7d-970c-cd3e4bb475c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:04.112140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75a2f6f8-4488-4d7d-970c-cd3e4bb475c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:04.112601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75a2f6f8-4488-4d7d-970c-cd3e4bb475c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:04.113027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75a2f6f8-4488-4d7d-970c-cd3e4bb475c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:04.127974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:04.472897 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-75a2f6f8-4488-4d7d-970c-cd3e4bb475c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:04.481406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-75a2f6f8-4488-4d7d-970c-cd3e4bb475c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:04.482838 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-75a2f6f8-4488-4d7d-970c-cd3e4bb475c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:04.484495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-75a2f6f8-4488-4d7d-970c-cd3e4bb475c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.388006 Oct 28 20:13:04.485058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 591/1188] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:04 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:04.726469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4b03661f-1493-474a-a7bd-fd856bde678e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:04.728556 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4b03661f-1493-474a-a7bd-fd856bde678e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:04.733148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b03661f-1493-474a-a7bd-fd856bde678e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:04.733674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b03661f-1493-474a-a7bd-fd856bde678e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:04.734668 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b03661f-1493-474a-a7bd-fd856bde678e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:04.735440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b03661f-1493-474a-a7bd-fd856bde678e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:04.735905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b03661f-1493-474a-a7bd-fd856bde678e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:04.736332 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b03661f-1493-474a-a7bd-fd856bde678e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:04.796368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4b03661f-1493-474a-a7bd-fd856bde678e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:04.804969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4b03661f-1493-474a-a7bd-fd856bde678e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082409 Oct 28 20:13:04.805571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 598/1189] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:04 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:05.070709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-80dc9b0b-0755-42b2-be4a-2deca1040224 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:05.072923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-80dc9b0b-0755-42b2-be4a-2deca1040224 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:05.078910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80dc9b0b-0755-42b2-be4a-2deca1040224 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:05.079391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80dc9b0b-0755-42b2-be4a-2deca1040224 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:05.079825 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80dc9b0b-0755-42b2-be4a-2deca1040224 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:05.080512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80dc9b0b-0755-42b2-be4a-2deca1040224 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:05.080960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80dc9b0b-0755-42b2-be4a-2deca1040224 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:05.081408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80dc9b0b-0755-42b2-be4a-2deca1040224 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:05.112630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-80dc9b0b-0755-42b2-be4a-2deca1040224 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045908 Oct 28 20:13:05.113230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 592/1190] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:05 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:05.510414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c56f2e62-5763-42ed-b76a-10f85fc59ad0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:05.511028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c56f2e62-5763-42ed-b76a-10f85fc59ad0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:05.518194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56f2e62-5763-42ed-b76a-10f85fc59ad0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:05.518677 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56f2e62-5763-42ed-b76a-10f85fc59ad0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:05.519119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56f2e62-5763-42ed-b76a-10f85fc59ad0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:05.519808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56f2e62-5763-42ed-b76a-10f85fc59ad0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:05.520272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56f2e62-5763-42ed-b76a-10f85fc59ad0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:05.520701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56f2e62-5763-42ed-b76a-10f85fc59ad0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:05.650292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c56f2e62-5763-42ed-b76a-10f85fc59ad0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:05.659444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c56f2e62-5763-42ed-b76a-10f85fc59ad0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:05.660868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c56f2e62-5763-42ed-b76a-10f85fc59ad0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:05.662036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c56f2e62-5763-42ed-b76a-10f85fc59ad0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.155587 Oct 28 20:13:05.662589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 599/1191] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:05 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:13:05.830482 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2da175d2-bd79-4f48-aa16-40d17d91a788 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:05.831020 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2da175d2-bd79-4f48-aa16-40d17d91a788 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:05.837393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2da175d2-bd79-4f48-aa16-40d17d91a788 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:05.837759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2da175d2-bd79-4f48-aa16-40d17d91a788 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:05.838195 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2da175d2-bd79-4f48-aa16-40d17d91a788 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:05.838879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2da175d2-bd79-4f48-aa16-40d17d91a788 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:05.839332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2da175d2-bd79-4f48-aa16-40d17d91a788 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:05.839751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2da175d2-bd79-4f48-aa16-40d17d91a788 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:05.908702 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2da175d2-bd79-4f48-aa16-40d17d91a788 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:05.916841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2da175d2-bd79-4f48-aa16-40d17d91a788 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.090290 Oct 28 20:13:05.917436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 593/1192] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:05 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:06.124138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed8868b2-a9b0-45eb-8e07-7dbedfb56a92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:06.127011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ed8868b2-a9b0-45eb-8e07-7dbedfb56a92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:06.132805 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed8868b2-a9b0-45eb-8e07-7dbedfb56a92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:06.133277 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed8868b2-a9b0-45eb-8e07-7dbedfb56a92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:06.133739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed8868b2-a9b0-45eb-8e07-7dbedfb56a92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:06.134446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed8868b2-a9b0-45eb-8e07-7dbedfb56a92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:06.134889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed8868b2-a9b0-45eb-8e07-7dbedfb56a92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:06.135304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed8868b2-a9b0-45eb-8e07-7dbedfb56a92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:06.164720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ed8868b2-a9b0-45eb-8e07-7dbedfb56a92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044550 Oct 28 20:13:06.165273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 600/1193] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:06 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:06.687964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d87ae930-5e4a-4115-92b0-4a945dca7f20 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:06.689269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d87ae930-5e4a-4115-92b0-4a945dca7f20 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:06.695782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d87ae930-5e4a-4115-92b0-4a945dca7f20 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:06.696259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d87ae930-5e4a-4115-92b0-4a945dca7f20 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:06.696691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d87ae930-5e4a-4115-92b0-4a945dca7f20 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:06.697401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d87ae930-5e4a-4115-92b0-4a945dca7f20 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:06.697846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d87ae930-5e4a-4115-92b0-4a945dca7f20 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:06.698263 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d87ae930-5e4a-4115-92b0-4a945dca7f20 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:06.824627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d87ae930-5e4a-4115-92b0-4a945dca7f20 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:06.834419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d87ae930-5e4a-4115-92b0-4a945dca7f20 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:06.835851 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d87ae930-5e4a-4115-92b0-4a945dca7f20 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:06.836989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d87ae930-5e4a-4115-92b0-4a945dca7f20 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.152896 Oct 28 20:13:06.837576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 594/1194] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:06 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:06.939177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fab14f6e-e452-4356-9e3d-ce1937732e99 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:06.939764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fab14f6e-e452-4356-9e3d-ce1937732e99 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:06.946130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab14f6e-e452-4356-9e3d-ce1937732e99 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:06.946823 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab14f6e-e452-4356-9e3d-ce1937732e99 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:06.947265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab14f6e-e452-4356-9e3d-ce1937732e99 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:06.947967 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab14f6e-e452-4356-9e3d-ce1937732e99 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:06.948425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab14f6e-e452-4356-9e3d-ce1937732e99 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:06.948853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab14f6e-e452-4356-9e3d-ce1937732e99 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:07.011234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fab14f6e-e452-4356-9e3d-ce1937732e99 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:07.021256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fab14f6e-e452-4356-9e3d-ce1937732e99 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.086065 Oct 28 20:13:07.021858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 601/1195] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:06 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:07.177657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-99df3e5a-9798-4b7c-94ae-62c49fe989bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:07.179806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-99df3e5a-9798-4b7c-94ae-62c49fe989bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:07.185790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99df3e5a-9798-4b7c-94ae-62c49fe989bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:07.186271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99df3e5a-9798-4b7c-94ae-62c49fe989bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:07.186732 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99df3e5a-9798-4b7c-94ae-62c49fe989bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:07.187412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99df3e5a-9798-4b7c-94ae-62c49fe989bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:07.187864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99df3e5a-9798-4b7c-94ae-62c49fe989bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:07.188308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99df3e5a-9798-4b7c-94ae-62c49fe989bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:07.216955 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-99df3e5a-9798-4b7c-94ae-62c49fe989bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043266 Oct 28 20:13:07.217533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 595/1196] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:07 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:07.863212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7aa16b4d-581d-471e-88d7-4b524519dfee tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:07.863823 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7aa16b4d-581d-471e-88d7-4b524519dfee tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:07.869736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7aa16b4d-581d-471e-88d7-4b524519dfee tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:07.870223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7aa16b4d-581d-471e-88d7-4b524519dfee tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:07.870660 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7aa16b4d-581d-471e-88d7-4b524519dfee tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:07.871351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7aa16b4d-581d-471e-88d7-4b524519dfee tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:07.871807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7aa16b4d-581d-471e-88d7-4b524519dfee tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:07.872234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7aa16b4d-581d-471e-88d7-4b524519dfee tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:08.003890 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7aa16b4d-581d-471e-88d7-4b524519dfee tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:08.012599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7aa16b4d-581d-471e-88d7-4b524519dfee tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:08.014078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7aa16b4d-581d-471e-88d7-4b524519dfee tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:08.015388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7aa16b4d-581d-471e-88d7-4b524519dfee tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.157143 Oct 28 20:13:08.016016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 602/1197] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:07 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:08.044248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d15bbc10-913b-4adc-af2c-06e4802620df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:08.044861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d15bbc10-913b-4adc-af2c-06e4802620df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:08.051592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d15bbc10-913b-4adc-af2c-06e4802620df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:08.052076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d15bbc10-913b-4adc-af2c-06e4802620df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:08.052513 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d15bbc10-913b-4adc-af2c-06e4802620df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:08.053203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d15bbc10-913b-4adc-af2c-06e4802620df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:08.053684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d15bbc10-913b-4adc-af2c-06e4802620df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:08.054292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d15bbc10-913b-4adc-af2c-06e4802620df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:08.115610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d15bbc10-913b-4adc-af2c-06e4802620df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:08.123123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d15bbc10-913b-4adc-af2c-06e4802620df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082659 Oct 28 20:13:08.123804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 596/1198] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:08 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:08.230426 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fd46a3f4-a42b-46da-b1da-8f13709d404e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:08.232567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fd46a3f4-a42b-46da-b1da-8f13709d404e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:08.239215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd46a3f4-a42b-46da-b1da-8f13709d404e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:08.239695 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd46a3f4-a42b-46da-b1da-8f13709d404e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:08.240127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd46a3f4-a42b-46da-b1da-8f13709d404e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:08.240811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd46a3f4-a42b-46da-b1da-8f13709d404e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:08.241262 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd46a3f4-a42b-46da-b1da-8f13709d404e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:08.241718 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd46a3f4-a42b-46da-b1da-8f13709d404e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:08.271013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fd46a3f4-a42b-46da-b1da-8f13709d404e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044498 Oct 28 20:13:08.271568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 603/1199] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:08 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:09.042812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-51e94d8f-e1b2-4601-9369-b06f9cb2f159 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:09.043457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-51e94d8f-e1b2-4601-9369-b06f9cb2f159 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:09.051142 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51e94d8f-e1b2-4601-9369-b06f9cb2f159 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:09.051708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51e94d8f-e1b2-4601-9369-b06f9cb2f159 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:09.052055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51e94d8f-e1b2-4601-9369-b06f9cb2f159 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:09.052742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51e94d8f-e1b2-4601-9369-b06f9cb2f159 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:09.053203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51e94d8f-e1b2-4601-9369-b06f9cb2f159 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:09.053658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51e94d8f-e1b2-4601-9369-b06f9cb2f159 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:09.147432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-73111470-176f-4bdf-9f83-c501e9d28b6e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:09.148181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-73111470-176f-4bdf-9f83-c501e9d28b6e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:09.154598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73111470-176f-4bdf-9f83-c501e9d28b6e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:09.155328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73111470-176f-4bdf-9f83-c501e9d28b6e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:09.155968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73111470-176f-4bdf-9f83-c501e9d28b6e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:09.157620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73111470-176f-4bdf-9f83-c501e9d28b6e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:09.158528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73111470-176f-4bdf-9f83-c501e9d28b6e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:09.159020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73111470-176f-4bdf-9f83-c501e9d28b6e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:09.200663 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-51e94d8f-e1b2-4601-9369-b06f9cb2f159 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:09.217703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-51e94d8f-e1b2-4601-9369-b06f9cb2f159 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:09.217703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-51e94d8f-e1b2-4601-9369-b06f9cb2f159 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:09.218929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-51e94d8f-e1b2-4601-9369-b06f9cb2f159 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.180159 Oct 28 20:13:09.219929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 597/1200] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:09 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:09.232017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-73111470-176f-4bdf-9f83-c501e9d28b6e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:09.241083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-73111470-176f-4bdf-9f83-c501e9d28b6e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.097438 Oct 28 20:13:09.241697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 604/1201] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:09 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:09.283983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c5bd2ba5-e9ee-45ac-9962-1c1c45b5d1f4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:09.286089 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c5bd2ba5-e9ee-45ac-9962-1c1c45b5d1f4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:09.291960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5bd2ba5-e9ee-45ac-9962-1c1c45b5d1f4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:09.292440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5bd2ba5-e9ee-45ac-9962-1c1c45b5d1f4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:09.292873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5bd2ba5-e9ee-45ac-9962-1c1c45b5d1f4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:09.293625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5bd2ba5-e9ee-45ac-9962-1c1c45b5d1f4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:09.294080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5bd2ba5-e9ee-45ac-9962-1c1c45b5d1f4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:09.294503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5bd2ba5-e9ee-45ac-9962-1c1c45b5d1f4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:09.323752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c5bd2ba5-e9ee-45ac-9962-1c1c45b5d1f4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044395 Oct 28 20:13:09.324310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 598/1202] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:09 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:10.245912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2815fbf9-3b96-44b1-a32f-67e217370956 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:10.246530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2815fbf9-3b96-44b1-a32f-67e217370956 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:10.254059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2815fbf9-3b96-44b1-a32f-67e217370956 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:10.254550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2815fbf9-3b96-44b1-a32f-67e217370956 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:10.255021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2815fbf9-3b96-44b1-a32f-67e217370956 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:10.255708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2815fbf9-3b96-44b1-a32f-67e217370956 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:10.256153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2815fbf9-3b96-44b1-a32f-67e217370956 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:10.256583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2815fbf9-3b96-44b1-a32f-67e217370956 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:10.268374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-273fb107-9701-40b2-9bcb-f86352cbec56 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:10.270398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-273fb107-9701-40b2-9bcb-f86352cbec56 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:10.276786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-273fb107-9701-40b2-9bcb-f86352cbec56 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:10.277276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-273fb107-9701-40b2-9bcb-f86352cbec56 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:10.277742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-273fb107-9701-40b2-9bcb-f86352cbec56 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:10.278451 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-273fb107-9701-40b2-9bcb-f86352cbec56 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:10.278908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-273fb107-9701-40b2-9bcb-f86352cbec56 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:10.279362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-273fb107-9701-40b2-9bcb-f86352cbec56 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:10.355105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-273fb107-9701-40b2-9bcb-f86352cbec56 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:10.362870 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-273fb107-9701-40b2-9bcb-f86352cbec56 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.099879 Oct 28 20:13:10.363441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 599/1203] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:10 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:13:10.367897 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-299afcee-942d-437b-9b81-8969780b9476 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:10.370064 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-299afcee-942d-437b-9b81-8969780b9476 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:10.376507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-299afcee-942d-437b-9b81-8969780b9476 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:10.376994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-299afcee-942d-437b-9b81-8969780b9476 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:10.377462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-299afcee-942d-437b-9b81-8969780b9476 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:10.378174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-299afcee-942d-437b-9b81-8969780b9476 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:10.378602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-299afcee-942d-437b-9b81-8969780b9476 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:10.379027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-299afcee-942d-437b-9b81-8969780b9476 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:10.410985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-299afcee-942d-437b-9b81-8969780b9476 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046278 Oct 28 20:13:10.411302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 600/1204] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:10 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:10.413707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2815fbf9-3b96-44b1-a32f-67e217370956 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:10.422188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2815fbf9-3b96-44b1-a32f-67e217370956 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:10.424247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2815fbf9-3b96-44b1-a32f-67e217370956 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:10.425448 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2815fbf9-3b96-44b1-a32f-67e217370956 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.183354 Oct 28 20:13:10.425994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 605/1205] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:10 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:11.386228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-87825c06-ed5f-4dda-bf65-6be22390d2be tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:11.386840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-87825c06-ed5f-4dda-bf65-6be22390d2be tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:11.393653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87825c06-ed5f-4dda-bf65-6be22390d2be tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:11.394140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87825c06-ed5f-4dda-bf65-6be22390d2be tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:11.394578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87825c06-ed5f-4dda-bf65-6be22390d2be tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:11.395257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87825c06-ed5f-4dda-bf65-6be22390d2be tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:11.395710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87825c06-ed5f-4dda-bf65-6be22390d2be tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:11.396128 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87825c06-ed5f-4dda-bf65-6be22390d2be tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:11.423255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8c823eb0-8687-4969-b9de-d86b6c4d092f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:11.425472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8c823eb0-8687-4969-b9de-d86b6c4d092f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:11.431898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c823eb0-8687-4969-b9de-d86b6c4d092f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:11.432379 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c823eb0-8687-4969-b9de-d86b6c4d092f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:11.432814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c823eb0-8687-4969-b9de-d86b6c4d092f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:11.433546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c823eb0-8687-4969-b9de-d86b6c4d092f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:11.433998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c823eb0-8687-4969-b9de-d86b6c4d092f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:11.434452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c823eb0-8687-4969-b9de-d86b6c4d092f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:11.459524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-87825c06-ed5f-4dda-bf65-6be22390d2be tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:11.465176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8c823eb0-8687-4969-b9de-d86b6c4d092f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045895 Oct 28 20:13:11.465772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 606/1206] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:11 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:13:11.467222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-87825c06-ed5f-4dda-bf65-6be22390d2be tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084869 Oct 28 20:13:11.468005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 601/1207] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:11 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:11.470930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d8ca0b69-b3c5-48f9-bec2-ed72eef3a52a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:11.471539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d8ca0b69-b3c5-48f9-bec2-ed72eef3a52a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:11.477110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8ca0b69-b3c5-48f9-bec2-ed72eef3a52a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:11.477624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8ca0b69-b3c5-48f9-bec2-ed72eef3a52a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:11.478063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8ca0b69-b3c5-48f9-bec2-ed72eef3a52a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:11.478754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8ca0b69-b3c5-48f9-bec2-ed72eef3a52a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:11.479203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8ca0b69-b3c5-48f9-bec2-ed72eef3a52a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:11.479625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8ca0b69-b3c5-48f9-bec2-ed72eef3a52a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:11.604969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d8ca0b69-b3c5-48f9-bec2-ed72eef3a52a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:11.613650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d8ca0b69-b3c5-48f9-bec2-ed72eef3a52a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:11.615100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d8ca0b69-b3c5-48f9-bec2-ed72eef3a52a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:11.616260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d8ca0b69-b3c5-48f9-bec2-ed72eef3a52a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.149586 Oct 28 20:13:11.616816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 607/1208] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:11 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:12.478495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-26803b1b-e1b1-4c67-b144-4c934c8be9ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:12.480719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-26803b1b-e1b1-4c67-b144-4c934c8be9ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:12.487978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26803b1b-e1b1-4c67-b144-4c934c8be9ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:12.488466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26803b1b-e1b1-4c67-b144-4c934c8be9ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:12.488900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26803b1b-e1b1-4c67-b144-4c934c8be9ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:12.489622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26803b1b-e1b1-4c67-b144-4c934c8be9ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:12.490081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26803b1b-e1b1-4c67-b144-4c934c8be9ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:12.490501 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26803b1b-e1b1-4c67-b144-4c934c8be9ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:12.491093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9aae6d2e-35e8-4c75-af8c-f35207384da5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:12.491711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9aae6d2e-35e8-4c75-af8c-f35207384da5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:12.498202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aae6d2e-35e8-4c75-af8c-f35207384da5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:12.505130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aae6d2e-35e8-4c75-af8c-f35207384da5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:12.505130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aae6d2e-35e8-4c75-af8c-f35207384da5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:12.505130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aae6d2e-35e8-4c75-af8c-f35207384da5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:12.505130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aae6d2e-35e8-4c75-af8c-f35207384da5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:12.505615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aae6d2e-35e8-4c75-af8c-f35207384da5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:12.519847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-26803b1b-e1b1-4c67-b144-4c934c8be9ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045271 Oct 28 20:13:12.520404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:12.520563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 602/1209] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:12 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:13:12.562645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9aae6d2e-35e8-4c75-af8c-f35207384da5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:12.570192 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9aae6d2e-35e8-4c75-af8c-f35207384da5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082929 Oct 28 20:13:12.570746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 608/1210] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:12 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:13:12.642177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-836d132f-bc52-40f6-9949-89f48ad6b65e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:12.642765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-836d132f-bc52-40f6-9949-89f48ad6b65e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:12.648878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-836d132f-bc52-40f6-9949-89f48ad6b65e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:12.649406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-836d132f-bc52-40f6-9949-89f48ad6b65e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:12.649846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-836d132f-bc52-40f6-9949-89f48ad6b65e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:12.650540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-836d132f-bc52-40f6-9949-89f48ad6b65e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:12.650994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-836d132f-bc52-40f6-9949-89f48ad6b65e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:12.651418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-836d132f-bc52-40f6-9949-89f48ad6b65e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:12.778085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-836d132f-bc52-40f6-9949-89f48ad6b65e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:12.787025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-836d132f-bc52-40f6-9949-89f48ad6b65e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:12.788471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-836d132f-bc52-40f6-9949-89f48ad6b65e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:12.789658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-836d132f-bc52-40f6-9949-89f48ad6b65e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.151849 Oct 28 20:13:12.790221 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 603/1211] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:12 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:13.532965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ad8693c5-0d2d-4685-8ef6-44215722e72f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:13.535200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ad8693c5-0d2d-4685-8ef6-44215722e72f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:13.541790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad8693c5-0d2d-4685-8ef6-44215722e72f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:13.542267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad8693c5-0d2d-4685-8ef6-44215722e72f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:13.542696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad8693c5-0d2d-4685-8ef6-44215722e72f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:13.543386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad8693c5-0d2d-4685-8ef6-44215722e72f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:13.543861 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad8693c5-0d2d-4685-8ef6-44215722e72f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:13.544279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad8693c5-0d2d-4685-8ef6-44215722e72f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:13.574054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ad8693c5-0d2d-4685-8ef6-44215722e72f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045978 Oct 28 20:13:13.574598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 609/1212] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:13 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:13.592897 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8496ea12-a13a-4231-9a5b-81518ec10087 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:13.593574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8496ea12-a13a-4231-9a5b-81518ec10087 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:13.600177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8496ea12-a13a-4231-9a5b-81518ec10087 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:13.600653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8496ea12-a13a-4231-9a5b-81518ec10087 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:13.601085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8496ea12-a13a-4231-9a5b-81518ec10087 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:13.601797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8496ea12-a13a-4231-9a5b-81518ec10087 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:13.602248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8496ea12-a13a-4231-9a5b-81518ec10087 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:13.602667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8496ea12-a13a-4231-9a5b-81518ec10087 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:13.663048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8496ea12-a13a-4231-9a5b-81518ec10087 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:13.670668 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8496ea12-a13a-4231-9a5b-81518ec10087 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081655 Oct 28 20:13:13.671227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 604/1213] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:13 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:13.815560 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-924bd5c4-810d-4a55-ac0d-bd9a2cc021f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:13.816168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-924bd5c4-810d-4a55-ac0d-bd9a2cc021f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:13.822072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-924bd5c4-810d-4a55-ac0d-bd9a2cc021f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:13.822554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-924bd5c4-810d-4a55-ac0d-bd9a2cc021f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:13.822994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-924bd5c4-810d-4a55-ac0d-bd9a2cc021f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:13.823684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-924bd5c4-810d-4a55-ac0d-bd9a2cc021f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:13.824135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-924bd5c4-810d-4a55-ac0d-bd9a2cc021f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:13.824557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-924bd5c4-810d-4a55-ac0d-bd9a2cc021f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:13.953868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-924bd5c4-810d-4a55-ac0d-bd9a2cc021f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:13.962469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-924bd5c4-810d-4a55-ac0d-bd9a2cc021f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:13.963932 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-924bd5c4-810d-4a55-ac0d-bd9a2cc021f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:13.965085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-924bd5c4-810d-4a55-ac0d-bd9a2cc021f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.153557 Oct 28 20:13:13.965688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 610/1214] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:13 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:14.587427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b30bd6cc-14ab-42db-b882-065eb5092c68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:14.590186 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b30bd6cc-14ab-42db-b882-065eb5092c68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:14.596394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b30bd6cc-14ab-42db-b882-065eb5092c68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:14.613183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b30bd6cc-14ab-42db-b882-065eb5092c68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:14.613183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b30bd6cc-14ab-42db-b882-065eb5092c68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:14.613183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b30bd6cc-14ab-42db-b882-065eb5092c68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:14.613183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b30bd6cc-14ab-42db-b882-065eb5092c68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:14.613775 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b30bd6cc-14ab-42db-b882-065eb5092c68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:14.628977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b30bd6cc-14ab-42db-b882-065eb5092c68 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046211 Oct 28 20:13:14.629568 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 605/1215] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:14 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:14.693624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05d08e26-cf9b-4e65-a34d-7797684c509f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:14.694239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-05d08e26-cf9b-4e65-a34d-7797684c509f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:14.700738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05d08e26-cf9b-4e65-a34d-7797684c509f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:14.701163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05d08e26-cf9b-4e65-a34d-7797684c509f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:14.701661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05d08e26-cf9b-4e65-a34d-7797684c509f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:14.702356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05d08e26-cf9b-4e65-a34d-7797684c509f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:14.702811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05d08e26-cf9b-4e65-a34d-7797684c509f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:14.703238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05d08e26-cf9b-4e65-a34d-7797684c509f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:14.767793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-05d08e26-cf9b-4e65-a34d-7797684c509f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:14.775374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05d08e26-cf9b-4e65-a34d-7797684c509f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085612 Oct 28 20:13:14.778178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 611/1216] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:14 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:14.991043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32fa283e-63b9-44bf-ba78-6964eff1cd0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:14.991568 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-32fa283e-63b9-44bf-ba78-6964eff1cd0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:14.997461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32fa283e-63b9-44bf-ba78-6964eff1cd0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:14.997949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32fa283e-63b9-44bf-ba78-6964eff1cd0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:14.998389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32fa283e-63b9-44bf-ba78-6964eff1cd0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:14.999108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32fa283e-63b9-44bf-ba78-6964eff1cd0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:14.999563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32fa283e-63b9-44bf-ba78-6964eff1cd0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:14.999989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32fa283e-63b9-44bf-ba78-6964eff1cd0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:15.127122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-32fa283e-63b9-44bf-ba78-6964eff1cd0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:15.135547 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-32fa283e-63b9-44bf-ba78-6964eff1cd0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:15.137023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-32fa283e-63b9-44bf-ba78-6964eff1cd0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:15.138188 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-32fa283e-63b9-44bf-ba78-6964eff1cd0d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.151169 Oct 28 20:13:15.138737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 606/1217] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:14 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:15.641619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ff567cca-2e71-4f8a-85ba-03a4dd77f60e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:15.644035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ff567cca-2e71-4f8a-85ba-03a4dd77f60e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:15.649795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff567cca-2e71-4f8a-85ba-03a4dd77f60e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:15.650333 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff567cca-2e71-4f8a-85ba-03a4dd77f60e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:15.650766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff567cca-2e71-4f8a-85ba-03a4dd77f60e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:15.651449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff567cca-2e71-4f8a-85ba-03a4dd77f60e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:15.651899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff567cca-2e71-4f8a-85ba-03a4dd77f60e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:15.652442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff567cca-2e71-4f8a-85ba-03a4dd77f60e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:15.682419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ff567cca-2e71-4f8a-85ba-03a4dd77f60e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045132 Oct 28 20:13:15.682972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 612/1218] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:15 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:15.798319 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-514f0c99-ca40-4dbe-8d46-baef1652fab8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:15.798919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-514f0c99-ca40-4dbe-8d46-baef1652fab8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:15.805292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-514f0c99-ca40-4dbe-8d46-baef1652fab8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:15.805805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-514f0c99-ca40-4dbe-8d46-baef1652fab8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:15.806239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-514f0c99-ca40-4dbe-8d46-baef1652fab8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:15.806952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-514f0c99-ca40-4dbe-8d46-baef1652fab8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:15.807401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-514f0c99-ca40-4dbe-8d46-baef1652fab8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:15.807815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-514f0c99-ca40-4dbe-8d46-baef1652fab8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:15.869639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-514f0c99-ca40-4dbe-8d46-baef1652fab8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:15.877989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-514f0c99-ca40-4dbe-8d46-baef1652fab8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.083713 Oct 28 20:13:15.878555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 607/1219] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:15 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:16.164026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2874839-7658-4ed4-ba02-7f45a2a54b7c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:16.164562 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2874839-7658-4ed4-ba02-7f45a2a54b7c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:16.170983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2874839-7658-4ed4-ba02-7f45a2a54b7c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:16.171466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2874839-7658-4ed4-ba02-7f45a2a54b7c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:16.171937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2874839-7658-4ed4-ba02-7f45a2a54b7c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:16.173166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2874839-7658-4ed4-ba02-7f45a2a54b7c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:16.173652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2874839-7658-4ed4-ba02-7f45a2a54b7c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:16.174083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2874839-7658-4ed4-ba02-7f45a2a54b7c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:16.307962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2874839-7658-4ed4-ba02-7f45a2a54b7c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:16.317501 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2874839-7658-4ed4-ba02-7f45a2a54b7c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:16.318956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2874839-7658-4ed4-ba02-7f45a2a54b7c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:16.320096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2874839-7658-4ed4-ba02-7f45a2a54b7c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.160048 Oct 28 20:13:16.320677 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 613/1220] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:16 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:16.697239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8d8104df-b284-4e4b-84c5-dc517a16d7e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:16.701425 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8d8104df-b284-4e4b-84c5-dc517a16d7e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:16.708711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d8104df-b284-4e4b-84c5-dc517a16d7e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:16.710226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d8104df-b284-4e4b-84c5-dc517a16d7e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:16.710226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d8104df-b284-4e4b-84c5-dc517a16d7e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:16.710688 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d8104df-b284-4e4b-84c5-dc517a16d7e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:16.711207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d8104df-b284-4e4b-84c5-dc517a16d7e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:16.711561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d8104df-b284-4e4b-84c5-dc517a16d7e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:16.714048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:16.743142 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8d8104df-b284-4e4b-84c5-dc517a16d7e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050948 Oct 28 20:13:16.743698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 608/1221] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:16 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:16.901518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-484defee-95b1-4e9a-87b0-e42893f02151 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:16.902062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-484defee-95b1-4e9a-87b0-e42893f02151 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:16.908506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484defee-95b1-4e9a-87b0-e42893f02151 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:16.908987 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484defee-95b1-4e9a-87b0-e42893f02151 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:16.909449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484defee-95b1-4e9a-87b0-e42893f02151 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:16.910136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484defee-95b1-4e9a-87b0-e42893f02151 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:16.910589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484defee-95b1-4e9a-87b0-e42893f02151 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:16.911011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484defee-95b1-4e9a-87b0-e42893f02151 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:16.971065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-484defee-95b1-4e9a-87b0-e42893f02151 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:16.978627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-484defee-95b1-4e9a-87b0-e42893f02151 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081023 Oct 28 20:13:16.979188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 614/1222] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:16 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:17.346989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6230f65b-9298-4b31-85e5-1d0a4b909ff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:17.347610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6230f65b-9298-4b31-85e5-1d0a4b909ff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:17.354524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6230f65b-9298-4b31-85e5-1d0a4b909ff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:17.355012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6230f65b-9298-4b31-85e5-1d0a4b909ff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:17.355457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6230f65b-9298-4b31-85e5-1d0a4b909ff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:17.356144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6230f65b-9298-4b31-85e5-1d0a4b909ff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:17.356598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6230f65b-9298-4b31-85e5-1d0a4b909ff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:17.357025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6230f65b-9298-4b31-85e5-1d0a4b909ff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:17.484917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6230f65b-9298-4b31-85e5-1d0a4b909ff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:17.493403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6230f65b-9298-4b31-85e5-1d0a4b909ff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:17.494849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6230f65b-9298-4b31-85e5-1d0a4b909ff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:17.496002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6230f65b-9298-4b31-85e5-1d0a4b909ff1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.153623 Oct 28 20:13:17.496566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 609/1223] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:17 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:17.756580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a4f767d2-8cc0-4c4a-a903-18bef1e83f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:17.758910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a4f767d2-8cc0-4c4a-a903-18bef1e83f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:17.765314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4f767d2-8cc0-4c4a-a903-18bef1e83f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:17.766429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4f767d2-8cc0-4c4a-a903-18bef1e83f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:17.766872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4f767d2-8cc0-4c4a-a903-18bef1e83f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:17.767563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4f767d2-8cc0-4c4a-a903-18bef1e83f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:17.768012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4f767d2-8cc0-4c4a-a903-18bef1e83f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:17.768476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4f767d2-8cc0-4c4a-a903-18bef1e83f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:17.816887 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a4f767d2-8cc0-4c4a-a903-18bef1e83f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064100 Oct 28 20:13:17.818250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 615/1224] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:17 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:18.002146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-131ececa-d094-421e-9e13-17506c65d49a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:18.002770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-131ececa-d094-421e-9e13-17506c65d49a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:18.008650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-131ececa-d094-421e-9e13-17506c65d49a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:18.009158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-131ececa-d094-421e-9e13-17506c65d49a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:18.009605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-131ececa-d094-421e-9e13-17506c65d49a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:18.010299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-131ececa-d094-421e-9e13-17506c65d49a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:18.010755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-131ececa-d094-421e-9e13-17506c65d49a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:18.011182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-131ececa-d094-421e-9e13-17506c65d49a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:18.074534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-131ececa-d094-421e-9e13-17506c65d49a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:18.082846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-131ececa-d094-421e-9e13-17506c65d49a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084965 Oct 28 20:13:18.083398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 610/1225] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:17 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:18.522015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-469f8f23-a299-496f-8496-05b4ce7ed259 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:18.522627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-469f8f23-a299-496f-8496-05b4ce7ed259 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:18.528546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-469f8f23-a299-496f-8496-05b4ce7ed259 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:18.529030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-469f8f23-a299-496f-8496-05b4ce7ed259 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:18.529503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-469f8f23-a299-496f-8496-05b4ce7ed259 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:18.530193 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-469f8f23-a299-496f-8496-05b4ce7ed259 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:18.530648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-469f8f23-a299-496f-8496-05b4ce7ed259 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:18.531073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-469f8f23-a299-496f-8496-05b4ce7ed259 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:18.660332 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-469f8f23-a299-496f-8496-05b4ce7ed259 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:18.668860 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-469f8f23-a299-496f-8496-05b4ce7ed259 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:18.670318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-469f8f23-a299-496f-8496-05b4ce7ed259 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:18.671469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-469f8f23-a299-496f-8496-05b4ce7ed259 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.153368 Oct 28 20:13:18.672591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 616/1226] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:18 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:18.829514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-41a90707-2423-49e3-a7d1-2ab1032d98a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:18.831694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-41a90707-2423-49e3-a7d1-2ab1032d98a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:18.837903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41a90707-2423-49e3-a7d1-2ab1032d98a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:18.838382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41a90707-2423-49e3-a7d1-2ab1032d98a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:18.838809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41a90707-2423-49e3-a7d1-2ab1032d98a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:18.839499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41a90707-2423-49e3-a7d1-2ab1032d98a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:18.839944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41a90707-2423-49e3-a7d1-2ab1032d98a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:18.840362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41a90707-2423-49e3-a7d1-2ab1032d98a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:18.871958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-41a90707-2423-49e3-a7d1-2ab1032d98a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046297 Oct 28 20:13:18.872516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 611/1227] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:18 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:19.105922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a7d86d9-5bc9-46a8-aba2-1de36d54ed94 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:19.106537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2a7d86d9-5bc9-46a8-aba2-1de36d54ed94 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:19.108774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=78 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:19.114116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a7d86d9-5bc9-46a8-aba2-1de36d54ed94 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:19.114598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a7d86d9-5bc9-46a8-aba2-1de36d54ed94 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:19.115034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a7d86d9-5bc9-46a8-aba2-1de36d54ed94 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:19.115722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a7d86d9-5bc9-46a8-aba2-1de36d54ed94 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:19.116643 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a7d86d9-5bc9-46a8-aba2-1de36d54ed94 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:19.116643 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a7d86d9-5bc9-46a8-aba2-1de36d54ed94 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:19.179269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2a7d86d9-5bc9-46a8-aba2-1de36d54ed94 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:19.186951 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a7d86d9-5bc9-46a8-aba2-1de36d54ed94 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084825 Oct 28 20:13:19.187513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 617/1228] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:19 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:19.697667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ee81054-b614-4033-9b3b-6e12af7dde0a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:19.698277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6ee81054-b614-4033-9b3b-6e12af7dde0a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:19.704759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ee81054-b614-4033-9b3b-6e12af7dde0a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:19.705241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ee81054-b614-4033-9b3b-6e12af7dde0a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:19.705709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ee81054-b614-4033-9b3b-6e12af7dde0a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:19.706385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ee81054-b614-4033-9b3b-6e12af7dde0a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:19.706833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ee81054-b614-4033-9b3b-6e12af7dde0a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:19.707257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ee81054-b614-4033-9b3b-6e12af7dde0a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:19.838555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6ee81054-b614-4033-9b3b-6e12af7dde0a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:19.847649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6ee81054-b614-4033-9b3b-6e12af7dde0a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:19.849110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6ee81054-b614-4033-9b3b-6e12af7dde0a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:19.850405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6ee81054-b614-4033-9b3b-6e12af7dde0a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.156718 Oct 28 20:13:19.850948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 612/1229] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:19 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:19.892964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-668a7c05-31e7-4a05-a3aa-0b3f4f46b684 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:19.892964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-668a7c05-31e7-4a05-a3aa-0b3f4f46b684 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:19.894624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-668a7c05-31e7-4a05-a3aa-0b3f4f46b684 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:19.895057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-668a7c05-31e7-4a05-a3aa-0b3f4f46b684 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:19.895561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-668a7c05-31e7-4a05-a3aa-0b3f4f46b684 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:19.896249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-668a7c05-31e7-4a05-a3aa-0b3f4f46b684 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:19.896705 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-668a7c05-31e7-4a05-a3aa-0b3f4f46b684 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:19.897120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-668a7c05-31e7-4a05-a3aa-0b3f4f46b684 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:19.926312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-668a7c05-31e7-4a05-a3aa-0b3f4f46b684 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Oct 28 20:13:19.926867 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 618/1230] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:19 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:20.210177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-113342df-5687-4138-85b0-9572f5bcae86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:20.210795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-113342df-5687-4138-85b0-9572f5bcae86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:20.216723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-113342df-5687-4138-85b0-9572f5bcae86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:20.217151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-113342df-5687-4138-85b0-9572f5bcae86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:20.217634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-113342df-5687-4138-85b0-9572f5bcae86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:20.218317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-113342df-5687-4138-85b0-9572f5bcae86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:20.218774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-113342df-5687-4138-85b0-9572f5bcae86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:20.219196 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-113342df-5687-4138-85b0-9572f5bcae86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:20.281146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-113342df-5687-4138-85b0-9572f5bcae86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:20.288860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-113342df-5687-4138-85b0-9572f5bcae86 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082800 Oct 28 20:13:20.289450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 613/1231] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:20 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:20.875672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4f23ddad-c3a2-4a13-a802-99f024cc777b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:20.876317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4f23ddad-c3a2-4a13-a802-99f024cc777b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:20.882795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f23ddad-c3a2-4a13-a802-99f024cc777b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:20.883273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f23ddad-c3a2-4a13-a802-99f024cc777b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:20.883707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f23ddad-c3a2-4a13-a802-99f024cc777b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:20.884387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f23ddad-c3a2-4a13-a802-99f024cc777b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:20.884841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f23ddad-c3a2-4a13-a802-99f024cc777b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:20.885258 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f23ddad-c3a2-4a13-a802-99f024cc777b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:20.939764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d722ba49-1027-4deb-9dd6-f9e9edab8554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:20.942252 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d722ba49-1027-4deb-9dd6-f9e9edab8554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:20.948507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d722ba49-1027-4deb-9dd6-f9e9edab8554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:20.949250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d722ba49-1027-4deb-9dd6-f9e9edab8554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:20.949611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d722ba49-1027-4deb-9dd6-f9e9edab8554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:20.950315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d722ba49-1027-4deb-9dd6-f9e9edab8554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:20.950776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d722ba49-1027-4deb-9dd6-f9e9edab8554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:20.951205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d722ba49-1027-4deb-9dd6-f9e9edab8554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:20.989456 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d722ba49-1027-4deb-9dd6-f9e9edab8554 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054488 Oct 28 20:13:20.990044 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 614/1232] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:20 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:21.044437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f23ddad-c3a2-4a13-a802-99f024cc777b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:21.053781 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f23ddad-c3a2-4a13-a802-99f024cc777b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:21.055234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f23ddad-c3a2-4a13-a802-99f024cc777b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:21.056397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4f23ddad-c3a2-4a13-a802-99f024cc777b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.184642 Oct 28 20:13:21.056958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 619/1233] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:20 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:21.311862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a2a857f-9ebb-47ae-b629-004c00338201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:21.312503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0a2a857f-9ebb-47ae-b629-004c00338201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:21.318509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a2a857f-9ebb-47ae-b629-004c00338201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:21.318987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a2a857f-9ebb-47ae-b629-004c00338201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:21.319424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a2a857f-9ebb-47ae-b629-004c00338201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:21.320104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a2a857f-9ebb-47ae-b629-004c00338201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:21.320555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a2a857f-9ebb-47ae-b629-004c00338201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:21.320974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a2a857f-9ebb-47ae-b629-004c00338201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:21.383514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a2a857f-9ebb-47ae-b629-004c00338201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:21.391032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0a2a857f-9ebb-47ae-b629-004c00338201 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.083190 Oct 28 20:13:21.392138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 615/1234] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:21 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:22.002088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c5cdd3d3-c5cd-46f6-aa68-6c25b91310c3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:22.004328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c5cdd3d3-c5cd-46f6-aa68-6c25b91310c3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:22.010693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5cdd3d3-c5cd-46f6-aa68-6c25b91310c3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:22.011187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5cdd3d3-c5cd-46f6-aa68-6c25b91310c3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:22.011628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5cdd3d3-c5cd-46f6-aa68-6c25b91310c3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:22.012325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5cdd3d3-c5cd-46f6-aa68-6c25b91310c3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:22.012785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5cdd3d3-c5cd-46f6-aa68-6c25b91310c3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:22.013209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5cdd3d3-c5cd-46f6-aa68-6c25b91310c3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:22.052265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c5cdd3d3-c5cd-46f6-aa68-6c25b91310c3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054412 Oct 28 20:13:22.052832 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 620/1235] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:21 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:22.082177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-66b36579-6b30-48c6-9628-09d454a84c75 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:22.082793 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-66b36579-6b30-48c6-9628-09d454a84c75 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:22.089665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66b36579-6b30-48c6-9628-09d454a84c75 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:22.090156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66b36579-6b30-48c6-9628-09d454a84c75 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:22.090595 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66b36579-6b30-48c6-9628-09d454a84c75 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:22.091292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66b36579-6b30-48c6-9628-09d454a84c75 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:22.091749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66b36579-6b30-48c6-9628-09d454a84c75 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:22.092181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66b36579-6b30-48c6-9628-09d454a84c75 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:22.220190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-66b36579-6b30-48c6-9628-09d454a84c75 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:22.228701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-66b36579-6b30-48c6-9628-09d454a84c75 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:22.230230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-66b36579-6b30-48c6-9628-09d454a84c75 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:22.231328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-66b36579-6b30-48c6-9628-09d454a84c75 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.153728 Oct 28 20:13:22.231881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 616/1236] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:22 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:22.413730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ebb6e500-4f44-4300-ae20-35023e0f0f2e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:22.414341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ebb6e500-4f44-4300-ae20-35023e0f0f2e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:22.420211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb6e500-4f44-4300-ae20-35023e0f0f2e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:22.420687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb6e500-4f44-4300-ae20-35023e0f0f2e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:22.421118 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb6e500-4f44-4300-ae20-35023e0f0f2e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:22.421830 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb6e500-4f44-4300-ae20-35023e0f0f2e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:22.422280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb6e500-4f44-4300-ae20-35023e0f0f2e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:22.423573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb6e500-4f44-4300-ae20-35023e0f0f2e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:22.484697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ebb6e500-4f44-4300-ae20-35023e0f0f2e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:22.493798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ebb6e500-4f44-4300-ae20-35023e0f0f2e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.083998 Oct 28 20:13:22.494368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 621/1237] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:22 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:23.063980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6818fc4a-9417-4002-9dd0-187e5fecb872 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:23.066195 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6818fc4a-9417-4002-9dd0-187e5fecb872 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:23.068114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=90 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:23.072682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6818fc4a-9417-4002-9dd0-187e5fecb872 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:23.073160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6818fc4a-9417-4002-9dd0-187e5fecb872 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:23.073633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6818fc4a-9417-4002-9dd0-187e5fecb872 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:23.074316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6818fc4a-9417-4002-9dd0-187e5fecb872 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:23.074763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6818fc4a-9417-4002-9dd0-187e5fecb872 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:23.075183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6818fc4a-9417-4002-9dd0-187e5fecb872 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:23.107376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6818fc4a-9417-4002-9dd0-187e5fecb872 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047255 Oct 28 20:13:23.107980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 617/1238] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:23 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:23.261109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f028a4a5-8d8c-4d71-86a8-920ceda18b79 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:23.261748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f028a4a5-8d8c-4d71-86a8-920ceda18b79 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:23.268642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f028a4a5-8d8c-4d71-86a8-920ceda18b79 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:23.269121 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f028a4a5-8d8c-4d71-86a8-920ceda18b79 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:23.269591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f028a4a5-8d8c-4d71-86a8-920ceda18b79 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:23.270277 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f028a4a5-8d8c-4d71-86a8-920ceda18b79 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:23.270727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f028a4a5-8d8c-4d71-86a8-920ceda18b79 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:23.271148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f028a4a5-8d8c-4d71-86a8-920ceda18b79 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:23.399798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f028a4a5-8d8c-4d71-86a8-920ceda18b79 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:23.408764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f028a4a5-8d8c-4d71-86a8-920ceda18b79 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:23.410227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f028a4a5-8d8c-4d71-86a8-920ceda18b79 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:23.411386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f028a4a5-8d8c-4d71-86a8-920ceda18b79 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.154173 Oct 28 20:13:23.411936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 622/1239] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:23 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:23.517862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9e51d1c0-2137-4759-879e-16a849694f9b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:23.518530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9e51d1c0-2137-4759-879e-16a849694f9b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:23.524702 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e51d1c0-2137-4759-879e-16a849694f9b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:23.525178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e51d1c0-2137-4759-879e-16a849694f9b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:23.525648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e51d1c0-2137-4759-879e-16a849694f9b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:23.526327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e51d1c0-2137-4759-879e-16a849694f9b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:23.526802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e51d1c0-2137-4759-879e-16a849694f9b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:23.527221 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e51d1c0-2137-4759-879e-16a849694f9b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:23.587029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9e51d1c0-2137-4759-879e-16a849694f9b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:23.594484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9e51d1c0-2137-4759-879e-16a849694f9b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.080998 Oct 28 20:13:23.595730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 618/1240] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:23 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:24.120402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-975a507e-a04c-4ea3-aa8e-e7552039fc42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:24.122566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-975a507e-a04c-4ea3-aa8e-e7552039fc42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:24.128654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-975a507e-a04c-4ea3-aa8e-e7552039fc42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:24.129128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-975a507e-a04c-4ea3-aa8e-e7552039fc42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:24.129603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-975a507e-a04c-4ea3-aa8e-e7552039fc42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:24.130369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-975a507e-a04c-4ea3-aa8e-e7552039fc42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:24.130824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-975a507e-a04c-4ea3-aa8e-e7552039fc42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:24.131244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-975a507e-a04c-4ea3-aa8e-e7552039fc42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:24.161147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-975a507e-a04c-4ea3-aa8e-e7552039fc42 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044679 Oct 28 20:13:24.161744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 623/1241] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:24 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:24.437391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0e0c39e-a2db-4773-afc8-5ecf922af428 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:24.437997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0e0c39e-a2db-4773-afc8-5ecf922af428 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:24.444518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0e0c39e-a2db-4773-afc8-5ecf922af428 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:24.444991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0e0c39e-a2db-4773-afc8-5ecf922af428 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:24.445449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0e0c39e-a2db-4773-afc8-5ecf922af428 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:24.446124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0e0c39e-a2db-4773-afc8-5ecf922af428 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:24.446569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0e0c39e-a2db-4773-afc8-5ecf922af428 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:24.446984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0e0c39e-a2db-4773-afc8-5ecf922af428 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:24.575718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c0e0c39e-a2db-4773-afc8-5ecf922af428 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:24.585225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c0e0c39e-a2db-4773-afc8-5ecf922af428 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:24.587127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c0e0c39e-a2db-4773-afc8-5ecf922af428 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:24.587864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c0e0c39e-a2db-4773-afc8-5ecf922af428 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.154357 Oct 28 20:13:24.588414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 619/1242] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:24 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:24.617518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2dc803c6-53a5-4c02-bfcc-fb90d06724ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:24.618124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2dc803c6-53a5-4c02-bfcc-fb90d06724ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:24.624354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dc803c6-53a5-4c02-bfcc-fb90d06724ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:24.624865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dc803c6-53a5-4c02-bfcc-fb90d06724ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:24.625291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dc803c6-53a5-4c02-bfcc-fb90d06724ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:24.625995 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dc803c6-53a5-4c02-bfcc-fb90d06724ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:24.626486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dc803c6-53a5-4c02-bfcc-fb90d06724ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:24.626907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dc803c6-53a5-4c02-bfcc-fb90d06724ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:24.692348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2dc803c6-53a5-4c02-bfcc-fb90d06724ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:24.700233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2dc803c6-53a5-4c02-bfcc-fb90d06724ff tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.086702 Oct 28 20:13:24.700784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 624/1243] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:24 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:25.174139 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8f44de59-a4b0-4a08-a0f3-e70692bde6d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:25.176271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8f44de59-a4b0-4a08-a0f3-e70692bde6d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:25.182333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f44de59-a4b0-4a08-a0f3-e70692bde6d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:25.182811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f44de59-a4b0-4a08-a0f3-e70692bde6d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:25.183242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f44de59-a4b0-4a08-a0f3-e70692bde6d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:25.183923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f44de59-a4b0-4a08-a0f3-e70692bde6d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:25.184372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f44de59-a4b0-4a08-a0f3-e70692bde6d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:25.184790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f44de59-a4b0-4a08-a0f3-e70692bde6d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:25.214555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8f44de59-a4b0-4a08-a0f3-e70692bde6d9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044919 Oct 28 20:13:25.215116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 620/1244] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:25 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:25.614899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-26a17164-be4c-4ac8-a9f0-9982141d2960 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:25.615512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-26a17164-be4c-4ac8-a9f0-9982141d2960 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:25.621839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26a17164-be4c-4ac8-a9f0-9982141d2960 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:25.622434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26a17164-be4c-4ac8-a9f0-9982141d2960 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:25.622731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26a17164-be4c-4ac8-a9f0-9982141d2960 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:25.623411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26a17164-be4c-4ac8-a9f0-9982141d2960 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:25.623858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26a17164-be4c-4ac8-a9f0-9982141d2960 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:25.624274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26a17164-be4c-4ac8-a9f0-9982141d2960 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:25.628387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:25.724253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3aa71161-0a30-4979-9335-2f9149fbc7bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:25.724875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3aa71161-0a30-4979-9335-2f9149fbc7bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:25.731302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa71161-0a30-4979-9335-2f9149fbc7bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:25.731786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa71161-0a30-4979-9335-2f9149fbc7bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:25.732224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa71161-0a30-4979-9335-2f9149fbc7bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:25.732916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa71161-0a30-4979-9335-2f9149fbc7bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:25.733458 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa71161-0a30-4979-9335-2f9149fbc7bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:25.733886 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa71161-0a30-4979-9335-2f9149fbc7bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:25.752242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-26a17164-be4c-4ac8-a9f0-9982141d2960 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:25.760789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-26a17164-be4c-4ac8-a9f0-9982141d2960 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:25.762281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-26a17164-be4c-4ac8-a9f0-9982141d2960 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:25.763455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-26a17164-be4c-4ac8-a9f0-9982141d2960 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.153162 Oct 28 20:13:25.764028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 625/1245] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:25 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:25.796434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3aa71161-0a30-4979-9335-2f9149fbc7bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:25.804284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3aa71161-0a30-4979-9335-2f9149fbc7bf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084575 Oct 28 20:13:25.804840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 621/1246] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:25 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:13:26.226547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b239f386-14a5-46ce-b363-1cc5a3a4adf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:26.228734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b239f386-14a5-46ce-b363-1cc5a3a4adf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:26.234700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b239f386-14a5-46ce-b363-1cc5a3a4adf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:26.235178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b239f386-14a5-46ce-b363-1cc5a3a4adf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:26.236251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b239f386-14a5-46ce-b363-1cc5a3a4adf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:26.236943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b239f386-14a5-46ce-b363-1cc5a3a4adf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:26.237426 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b239f386-14a5-46ce-b363-1cc5a3a4adf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:26.237855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b239f386-14a5-46ce-b363-1cc5a3a4adf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:26.276308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b239f386-14a5-46ce-b363-1cc5a3a4adf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053639 Oct 28 20:13:26.276878 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 626/1247] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:26 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:26.790015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a0da9cb-291b-4d61-a05e-83cf928f36c7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:26.790661 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3a0da9cb-291b-4d61-a05e-83cf928f36c7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:26.796984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0da9cb-291b-4d61-a05e-83cf928f36c7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:26.797504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0da9cb-291b-4d61-a05e-83cf928f36c7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:26.797952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0da9cb-291b-4d61-a05e-83cf928f36c7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:26.798721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0da9cb-291b-4d61-a05e-83cf928f36c7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:26.799187 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0da9cb-291b-4d61-a05e-83cf928f36c7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:26.799616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0da9cb-291b-4d61-a05e-83cf928f36c7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:26.825708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d700cb8f-2f5d-40fe-b41a-1dbc0f4b52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:26.826328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d700cb8f-2f5d-40fe-b41a-1dbc0f4b52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:26.833435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d700cb8f-2f5d-40fe-b41a-1dbc0f4b52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:26.834174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d700cb8f-2f5d-40fe-b41a-1dbc0f4b52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:26.834607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d700cb8f-2f5d-40fe-b41a-1dbc0f4b52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:26.835290 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d700cb8f-2f5d-40fe-b41a-1dbc0f4b52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:26.835739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d700cb8f-2f5d-40fe-b41a-1dbc0f4b52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:26.836157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d700cb8f-2f5d-40fe-b41a-1dbc0f4b52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:26.915304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d700cb8f-2f5d-40fe-b41a-1dbc0f4b52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:26.923187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d700cb8f-2f5d-40fe-b41a-1dbc0f4b52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.101056 Oct 28 20:13:26.924006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 627/1248] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:26 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:13:26.960436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a0da9cb-291b-4d61-a05e-83cf928f36c7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:26.968804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a0da9cb-291b-4d61-a05e-83cf928f36c7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:26.970379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a0da9cb-291b-4d61-a05e-83cf928f36c7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:26.971552 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a0da9cb-291b-4d61-a05e-83cf928f36c7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.185539 Oct 28 20:13:26.972101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 622/1249] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:26 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:27.289167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe15a9d0-9fcc-43b7-a66c-feb5f6569273 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:27.291311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fe15a9d0-9fcc-43b7-a66c-feb5f6569273 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:27.297197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe15a9d0-9fcc-43b7-a66c-feb5f6569273 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:27.297702 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe15a9d0-9fcc-43b7-a66c-feb5f6569273 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:27.298141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe15a9d0-9fcc-43b7-a66c-feb5f6569273 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:27.298968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe15a9d0-9fcc-43b7-a66c-feb5f6569273 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:27.299450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe15a9d0-9fcc-43b7-a66c-feb5f6569273 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:27.299869 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe15a9d0-9fcc-43b7-a66c-feb5f6569273 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:27.328322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fe15a9d0-9fcc-43b7-a66c-feb5f6569273 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043108 Oct 28 20:13:27.328858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 628/1250] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:27 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:27.945681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-629d8402-a452-4f1a-9074-8a0f9adb5741 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:27.946325 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-629d8402-a452-4f1a-9074-8a0f9adb5741 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:27.952870 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-629d8402-a452-4f1a-9074-8a0f9adb5741 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:27.953384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-629d8402-a452-4f1a-9074-8a0f9adb5741 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:27.953858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-629d8402-a452-4f1a-9074-8a0f9adb5741 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:27.955162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-629d8402-a452-4f1a-9074-8a0f9adb5741 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:27.955613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-629d8402-a452-4f1a-9074-8a0f9adb5741 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:27.956036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-629d8402-a452-4f1a-9074-8a0f9adb5741 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:27.996833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-37b09656-e169-49ad-9ee4-f7446af860e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:27.997516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-37b09656-e169-49ad-9ee4-f7446af860e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:28.004674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37b09656-e169-49ad-9ee4-f7446af860e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:28.005150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37b09656-e169-49ad-9ee4-f7446af860e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:28.009557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37b09656-e169-49ad-9ee4-f7446af860e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:28.009557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37b09656-e169-49ad-9ee4-f7446af860e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:28.009557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37b09656-e169-49ad-9ee4-f7446af860e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:28.009557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37b09656-e169-49ad-9ee4-f7446af860e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:28.019379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-629d8402-a452-4f1a-9074-8a0f9adb5741 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:28.027288 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-629d8402-a452-4f1a-9074-8a0f9adb5741 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085347 Oct 28 20:13:28.027858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 623/1251] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:27 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:28.141053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-37b09656-e169-49ad-9ee4-f7446af860e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:28.149836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-37b09656-e169-49ad-9ee4-f7446af860e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:28.151258 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-37b09656-e169-49ad-9ee4-f7446af860e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:28.152404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-37b09656-e169-49ad-9ee4-f7446af860e4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.159413 Oct 28 20:13:28.152968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 629/1252] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:27 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:13:28.341284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c9dec6b5-a5ef-42cb-a01f-6d82baf7f000 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:28.343697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c9dec6b5-a5ef-42cb-a01f-6d82baf7f000 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:28.350777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9dec6b5-a5ef-42cb-a01f-6d82baf7f000 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:28.351264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9dec6b5-a5ef-42cb-a01f-6d82baf7f000 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:28.351704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9dec6b5-a5ef-42cb-a01f-6d82baf7f000 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:28.352391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9dec6b5-a5ef-42cb-a01f-6d82baf7f000 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:28.352869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9dec6b5-a5ef-42cb-a01f-6d82baf7f000 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:28.353293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9dec6b5-a5ef-42cb-a01f-6d82baf7f000 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:28.378038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:28.382574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c9dec6b5-a5ef-42cb-a01f-6d82baf7f000 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Oct 28 20:13:28.383124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 624/1253] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:28 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:29.050020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5e10b451-7929-49cc-9c84-5f8e43c9d3b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:29.050631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5e10b451-7929-49cc-9c84-5f8e43c9d3b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:29.056907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e10b451-7929-49cc-9c84-5f8e43c9d3b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:29.057420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e10b451-7929-49cc-9c84-5f8e43c9d3b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:29.057854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e10b451-7929-49cc-9c84-5f8e43c9d3b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:29.058531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e10b451-7929-49cc-9c84-5f8e43c9d3b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:29.058974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e10b451-7929-49cc-9c84-5f8e43c9d3b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:29.059389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e10b451-7929-49cc-9c84-5f8e43c9d3b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:29.121697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5e10b451-7929-49cc-9c84-5f8e43c9d3b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:29.129840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5e10b451-7929-49cc-9c84-5f8e43c9d3b1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.083656 Oct 28 20:13:29.130400 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 630/1254] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:29 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:29.178609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9d864697-247a-44e5-b972-1304e900d2c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:29.179222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9d864697-247a-44e5-b972-1304e900d2c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:29.185701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d864697-247a-44e5-b972-1304e900d2c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:29.186177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d864697-247a-44e5-b972-1304e900d2c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:29.186605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d864697-247a-44e5-b972-1304e900d2c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:29.187275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d864697-247a-44e5-b972-1304e900d2c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:29.187720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d864697-247a-44e5-b972-1304e900d2c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:29.188135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d864697-247a-44e5-b972-1304e900d2c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:29.317357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9d864697-247a-44e5-b972-1304e900d2c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:29.325753 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9d864697-247a-44e5-b972-1304e900d2c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:29.327182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9d864697-247a-44e5-b972-1304e900d2c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:29.328315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9d864697-247a-44e5-b972-1304e900d2c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.154159 Oct 28 20:13:29.328862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 625/1255] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:29 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:13:29.398451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e0fe1f9c-6112-48c2-bb74-969b3374ceca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:29.400679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e0fe1f9c-6112-48c2-bb74-969b3374ceca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:29.407373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0fe1f9c-6112-48c2-bb74-969b3374ceca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:29.407881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0fe1f9c-6112-48c2-bb74-969b3374ceca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:29.408561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0fe1f9c-6112-48c2-bb74-969b3374ceca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:29.409253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0fe1f9c-6112-48c2-bb74-969b3374ceca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:29.409733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0fe1f9c-6112-48c2-bb74-969b3374ceca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:29.410149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0fe1f9c-6112-48c2-bb74-969b3374ceca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:29.439780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e0fe1f9c-6112-48c2-bb74-969b3374ceca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044830 Oct 28 20:13:29.440323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 631/1256] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:29 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:30.153234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a79662f7-8776-4d91-87e5-a4a635fa52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:30.153907 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a79662f7-8776-4d91-87e5-a4a635fa52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:30.160868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a79662f7-8776-4d91-87e5-a4a635fa52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:30.161391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a79662f7-8776-4d91-87e5-a4a635fa52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:30.161833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a79662f7-8776-4d91-87e5-a4a635fa52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:30.162528 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a79662f7-8776-4d91-87e5-a4a635fa52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:30.162985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a79662f7-8776-4d91-87e5-a4a635fa52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:30.163410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a79662f7-8776-4d91-87e5-a4a635fa52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:30.226169 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a79662f7-8776-4d91-87e5-a4a635fa52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:30.233978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a79662f7-8776-4d91-87e5-a4a635fa52f9 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084565 Oct 28 20:13:30.234545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 626/1257] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:30 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:30.354522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c15905c3-a172-48e0-bf40-cdd1be847497 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:30.355136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c15905c3-a172-48e0-bf40-cdd1be847497 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:30.362110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c15905c3-a172-48e0-bf40-cdd1be847497 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:30.362597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c15905c3-a172-48e0-bf40-cdd1be847497 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:30.363042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c15905c3-a172-48e0-bf40-cdd1be847497 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:30.363769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c15905c3-a172-48e0-bf40-cdd1be847497 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:30.364227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c15905c3-a172-48e0-bf40-cdd1be847497 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:30.364652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c15905c3-a172-48e0-bf40-cdd1be847497 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:30.451254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-676acdc5-6481-4a24-9ea6-58cdd5527acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:30.453468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-676acdc5-6481-4a24-9ea6-58cdd5527acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:30.460212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-676acdc5-6481-4a24-9ea6-58cdd5527acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:30.460696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-676acdc5-6481-4a24-9ea6-58cdd5527acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:30.461127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-676acdc5-6481-4a24-9ea6-58cdd5527acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:30.461843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-676acdc5-6481-4a24-9ea6-58cdd5527acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:30.462295 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-676acdc5-6481-4a24-9ea6-58cdd5527acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:30.462714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-676acdc5-6481-4a24-9ea6-58cdd5527acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:30.493110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-676acdc5-6481-4a24-9ea6-58cdd5527acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045780 Oct 28 20:13:30.493719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 627/1258] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:30 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:13:30.496926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c15905c3-a172-48e0-bf40-cdd1be847497 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:30.506180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c15905c3-a172-48e0-bf40-cdd1be847497 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:30.507627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c15905c3-a172-48e0-bf40-cdd1be847497 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:30.508790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c15905c3-a172-48e0-bf40-cdd1be847497 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.158262 Oct 28 20:13:30.509351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 632/1259] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:30 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:31.257828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7826fe9c-1061-406c-b477-17578592f20c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:31.258433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7826fe9c-1061-406c-b477-17578592f20c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:31.264934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7826fe9c-1061-406c-b477-17578592f20c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:31.265462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7826fe9c-1061-406c-b477-17578592f20c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:31.265905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7826fe9c-1061-406c-b477-17578592f20c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:31.266637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7826fe9c-1061-406c-b477-17578592f20c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:31.268094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7826fe9c-1061-406c-b477-17578592f20c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:31.268534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7826fe9c-1061-406c-b477-17578592f20c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:31.329974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7826fe9c-1061-406c-b477-17578592f20c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:31.338357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7826fe9c-1061-406c-b477-17578592f20c tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084358 Oct 28 20:13:31.338916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 628/1260] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:31 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:31.506680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-71f71f68-3baf-4ff8-a9bc-a3637307f30c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:31.508867 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-71f71f68-3baf-4ff8-a9bc-a3637307f30c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:31.515254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71f71f68-3baf-4ff8-a9bc-a3637307f30c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:31.515741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71f71f68-3baf-4ff8-a9bc-a3637307f30c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:31.516178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71f71f68-3baf-4ff8-a9bc-a3637307f30c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:31.516870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71f71f68-3baf-4ff8-a9bc-a3637307f30c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:31.518041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71f71f68-3baf-4ff8-a9bc-a3637307f30c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:31.518472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71f71f68-3baf-4ff8-a9bc-a3637307f30c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:31.534637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8bad1c5e-13ff-4d8e-b5e1-a040686c2999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:31.535257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8bad1c5e-13ff-4d8e-b5e1-a040686c2999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:31.541021 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bad1c5e-13ff-4d8e-b5e1-a040686c2999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:31.541547 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bad1c5e-13ff-4d8e-b5e1-a040686c2999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:31.541986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bad1c5e-13ff-4d8e-b5e1-a040686c2999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:31.542672 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bad1c5e-13ff-4d8e-b5e1-a040686c2999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:31.543122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bad1c5e-13ff-4d8e-b5e1-a040686c2999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:31.543545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bad1c5e-13ff-4d8e-b5e1-a040686c2999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:31.547981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-71f71f68-3baf-4ff8-a9bc-a3637307f30c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046240 Oct 28 20:13:31.548575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 633/1261] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:31 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:31.670417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8bad1c5e-13ff-4d8e-b5e1-a040686c2999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:31.679756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8bad1c5e-13ff-4d8e-b5e1-a040686c2999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:31.681177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8bad1c5e-13ff-4d8e-b5e1-a040686c2999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:31.682986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8bad1c5e-13ff-4d8e-b5e1-a040686c2999 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.152210 Oct 28 20:13:31.683534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 629/1262] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:31 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:13:32.362369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9737166-ff02-48f9-ab1d-e79ce661ac30 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:32.362918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f9737166-ff02-48f9-ab1d-e79ce661ac30 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:32.368818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9737166-ff02-48f9-ab1d-e79ce661ac30 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:32.369302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9737166-ff02-48f9-ab1d-e79ce661ac30 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:32.369777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9737166-ff02-48f9-ab1d-e79ce661ac30 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:32.370469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9737166-ff02-48f9-ab1d-e79ce661ac30 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:32.370925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9737166-ff02-48f9-ab1d-e79ce661ac30 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:32.371349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9737166-ff02-48f9-ab1d-e79ce661ac30 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:32.435308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f9737166-ff02-48f9-ab1d-e79ce661ac30 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:32.444146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f9737166-ff02-48f9-ab1d-e79ce661ac30 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.086096 Oct 28 20:13:32.444709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 634/1263] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:32 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:32.560346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e19853e4-1cb6-4408-aa68-1705de105f24 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:32.562551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e19853e4-1cb6-4408-aa68-1705de105f24 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:32.569510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e19853e4-1cb6-4408-aa68-1705de105f24 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:32.569985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e19853e4-1cb6-4408-aa68-1705de105f24 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:32.570412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e19853e4-1cb6-4408-aa68-1705de105f24 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:32.571086 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e19853e4-1cb6-4408-aa68-1705de105f24 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:32.571531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e19853e4-1cb6-4408-aa68-1705de105f24 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:32.571949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e19853e4-1cb6-4408-aa68-1705de105f24 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:32.600834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e19853e4-1cb6-4408-aa68-1705de105f24 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044475 Oct 28 20:13:32.601389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 630/1264] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:32 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:32.710014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a786cd57-9251-45f7-a882-855c57c591e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:32.710631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a786cd57-9251-45f7-a882-855c57c591e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:32.716968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a786cd57-9251-45f7-a882-855c57c591e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:32.717482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a786cd57-9251-45f7-a882-855c57c591e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:32.717921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a786cd57-9251-45f7-a882-855c57c591e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:32.718639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a786cd57-9251-45f7-a882-855c57c591e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:32.719098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a786cd57-9251-45f7-a882-855c57c591e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:32.719524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a786cd57-9251-45f7-a882-855c57c591e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:32.853231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a786cd57-9251-45f7-a882-855c57c591e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:32.868100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a786cd57-9251-45f7-a882-855c57c591e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:32.869599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a786cd57-9251-45f7-a882-855c57c591e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:32.870827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a786cd57-9251-45f7-a882-855c57c591e1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.165026 Oct 28 20:13:32.871382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 635/1265] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:32 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:33.467620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3f984951-9c88-4f00-b69f-c23cddccdaa5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:33.468262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3f984951-9c88-4f00-b69f-c23cddccdaa5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:33.474997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f984951-9c88-4f00-b69f-c23cddccdaa5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:33.475482 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f984951-9c88-4f00-b69f-c23cddccdaa5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:33.482028 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f984951-9c88-4f00-b69f-c23cddccdaa5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:33.482028 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f984951-9c88-4f00-b69f-c23cddccdaa5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:33.482028 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f984951-9c88-4f00-b69f-c23cddccdaa5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:33.482028 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f984951-9c88-4f00-b69f-c23cddccdaa5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:33.538412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3f984951-9c88-4f00-b69f-c23cddccdaa5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:33.546041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3f984951-9c88-4f00-b69f-c23cddccdaa5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082444 Oct 28 20:13:33.546598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 631/1266] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:33 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:33.613546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7ebfcf80-639e-42a3-b954-ea0bacc852cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:33.615646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7ebfcf80-639e-42a3-b954-ea0bacc852cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:33.621575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ebfcf80-639e-42a3-b954-ea0bacc852cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:33.622049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ebfcf80-639e-42a3-b954-ea0bacc852cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:33.622483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ebfcf80-639e-42a3-b954-ea0bacc852cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:33.623165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ebfcf80-639e-42a3-b954-ea0bacc852cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:33.623618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ebfcf80-639e-42a3-b954-ea0bacc852cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:33.624035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ebfcf80-639e-42a3-b954-ea0bacc852cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:33.653655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7ebfcf80-639e-42a3-b954-ea0bacc852cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044460 Oct 28 20:13:33.654204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 636/1267] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:33 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:33.896819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5c4f5de7-ebf7-4c12-9110-2f5eba92227f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:33.897458 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5c4f5de7-ebf7-4c12-9110-2f5eba92227f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:33.903791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c4f5de7-ebf7-4c12-9110-2f5eba92227f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:33.904271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c4f5de7-ebf7-4c12-9110-2f5eba92227f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:33.904701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c4f5de7-ebf7-4c12-9110-2f5eba92227f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:33.905415 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c4f5de7-ebf7-4c12-9110-2f5eba92227f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:33.905867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c4f5de7-ebf7-4c12-9110-2f5eba92227f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:33.906281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c4f5de7-ebf7-4c12-9110-2f5eba92227f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:34.041522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5c4f5de7-ebf7-4c12-9110-2f5eba92227f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:34.051112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5c4f5de7-ebf7-4c12-9110-2f5eba92227f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:34.052562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5c4f5de7-ebf7-4c12-9110-2f5eba92227f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:34.053748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5c4f5de7-ebf7-4c12-9110-2f5eba92227f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.161758 Oct 28 20:13:34.054311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 632/1268] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:33 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:34.568793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c13ccf9b-9efa-4268-8590-372002d41d21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:34.569433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c13ccf9b-9efa-4268-8590-372002d41d21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:34.575868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c13ccf9b-9efa-4268-8590-372002d41d21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:34.576349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c13ccf9b-9efa-4268-8590-372002d41d21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:34.576791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c13ccf9b-9efa-4268-8590-372002d41d21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:34.577508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c13ccf9b-9efa-4268-8590-372002d41d21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:34.577965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c13ccf9b-9efa-4268-8590-372002d41d21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:34.578396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c13ccf9b-9efa-4268-8590-372002d41d21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:34.640708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c13ccf9b-9efa-4268-8590-372002d41d21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:34.650099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c13ccf9b-9efa-4268-8590-372002d41d21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085235 Oct 28 20:13:34.650748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 637/1269] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:34 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:34.666508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-53f90d2f-3268-41f5-9846-bbf46a501ee8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:34.668696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-53f90d2f-3268-41f5-9846-bbf46a501ee8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:34.675519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53f90d2f-3268-41f5-9846-bbf46a501ee8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:34.676046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53f90d2f-3268-41f5-9846-bbf46a501ee8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:34.676482 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53f90d2f-3268-41f5-9846-bbf46a501ee8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:34.677276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53f90d2f-3268-41f5-9846-bbf46a501ee8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:34.677792 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53f90d2f-3268-41f5-9846-bbf46a501ee8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:34.678237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53f90d2f-3268-41f5-9846-bbf46a501ee8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:34.707543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-53f90d2f-3268-41f5-9846-bbf46a501ee8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044914 Oct 28 20:13:34.708095 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 633/1270] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:34 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:35.080257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1e78eccc-dea3-46a6-a693-a08629da6b5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:35.081672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1e78eccc-dea3-46a6-a693-a08629da6b5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:35.088592 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e78eccc-dea3-46a6-a693-a08629da6b5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.089081 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e78eccc-dea3-46a6-a693-a08629da6b5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.089560 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e78eccc-dea3-46a6-a693-a08629da6b5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.090252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e78eccc-dea3-46a6-a693-a08629da6b5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.090704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e78eccc-dea3-46a6-a693-a08629da6b5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.091127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e78eccc-dea3-46a6-a693-a08629da6b5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.218422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1e78eccc-dea3-46a6-a693-a08629da6b5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:35.227865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1e78eccc-dea3-46a6-a693-a08629da6b5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:35.229346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1e78eccc-dea3-46a6-a693-a08629da6b5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:35.230498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1e78eccc-dea3-46a6-a693-a08629da6b5a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.154200 Oct 28 20:13:35.231053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 638/1271] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:35 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:35.674092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0e7ae429-fd8d-4767-a5da-68edf1b6c833 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:35.675347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0e7ae429-fd8d-4767-a5da-68edf1b6c833 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:35.681857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e7ae429-fd8d-4767-a5da-68edf1b6c833 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.682350 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e7ae429-fd8d-4767-a5da-68edf1b6c833 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.682783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e7ae429-fd8d-4767-a5da-68edf1b6c833 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.683604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e7ae429-fd8d-4767-a5da-68edf1b6c833 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.684062 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e7ae429-fd8d-4767-a5da-68edf1b6c833 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.684509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e7ae429-fd8d-4767-a5da-68edf1b6c833 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.720033 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9e83576c-232d-4a27-be2c-b888d39971a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:35.722298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9e83576c-232d-4a27-be2c-b888d39971a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:35.728867 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e83576c-232d-4a27-be2c-b888d39971a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.730497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e83576c-232d-4a27-be2c-b888d39971a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.730497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e83576c-232d-4a27-be2c-b888d39971a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.730497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e83576c-232d-4a27-be2c-b888d39971a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.730929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e83576c-232d-4a27-be2c-b888d39971a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.731352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e83576c-232d-4a27-be2c-b888d39971a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.752042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0e7ae429-fd8d-4767-a5da-68edf1b6c833 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:35.760516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0e7ae429-fd8d-4767-a5da-68edf1b6c833 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.090383 Oct 28 20:13:35.761079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 634/1272] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:35 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:35.762530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9e83576c-232d-4a27-be2c-b888d39971a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046300 Oct 28 20:13:35.763081 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 639/1273] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:35 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:13:36.256029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b601084a-f50e-4f40-8720-634d9f8a41de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:36.256634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b601084a-f50e-4f40-8720-634d9f8a41de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:36.262814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b601084a-f50e-4f40-8720-634d9f8a41de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:36.263302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b601084a-f50e-4f40-8720-634d9f8a41de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:36.263738 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b601084a-f50e-4f40-8720-634d9f8a41de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:36.264432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b601084a-f50e-4f40-8720-634d9f8a41de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:36.264890 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b601084a-f50e-4f40-8720-634d9f8a41de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:36.265481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b601084a-f50e-4f40-8720-634d9f8a41de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:36.404306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b601084a-f50e-4f40-8720-634d9f8a41de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:36.412847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b601084a-f50e-4f40-8720-634d9f8a41de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:36.414310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b601084a-f50e-4f40-8720-634d9f8a41de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:36.415454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b601084a-f50e-4f40-8720-634d9f8a41de tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.163433 Oct 28 20:13:36.416007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 635/1274] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:36 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:36.774959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f34c801f-07b7-4c43-ae97-3c7179a42a9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:36.777140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f34c801f-07b7-4c43-ae97-3c7179a42a9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:36.782986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f8bf3982-5a8f-4d08-8c3e-33dfd356f8b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:36.783553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f34c801f-07b7-4c43-ae97-3c7179a42a9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:36.783721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f8bf3982-5a8f-4d08-8c3e-33dfd356f8b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:36.784605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f34c801f-07b7-4c43-ae97-3c7179a42a9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:36.785158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f34c801f-07b7-4c43-ae97-3c7179a42a9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:36.785882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f34c801f-07b7-4c43-ae97-3c7179a42a9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:36.786335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f34c801f-07b7-4c43-ae97-3c7179a42a9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:36.786757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f34c801f-07b7-4c43-ae97-3c7179a42a9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:36.790567 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bf3982-5a8f-4d08-8c3e-33dfd356f8b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:36.791050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bf3982-5a8f-4d08-8c3e-33dfd356f8b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:36.791488 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bf3982-5a8f-4d08-8c3e-33dfd356f8b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:36.792175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bf3982-5a8f-4d08-8c3e-33dfd356f8b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:36.792625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bf3982-5a8f-4d08-8c3e-33dfd356f8b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:36.793101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bf3982-5a8f-4d08-8c3e-33dfd356f8b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:36.818757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f34c801f-07b7-4c43-ae97-3c7179a42a9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047647 Oct 28 20:13:36.819543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 640/1275] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:36 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:36.855939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f8bf3982-5a8f-4d08-8c3e-33dfd356f8b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:36.864262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f8bf3982-5a8f-4d08-8c3e-33dfd356f8b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085077 Oct 28 20:13:36.864823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 636/1276] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:36 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:13:37.441954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ffb71c26-e132-4be0-b0e3-19a82dd1814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:37.442594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ffb71c26-e132-4be0-b0e3-19a82dd1814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:37.448570 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb71c26-e132-4be0-b0e3-19a82dd1814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:37.449054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb71c26-e132-4be0-b0e3-19a82dd1814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:37.449530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb71c26-e132-4be0-b0e3-19a82dd1814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:37.450222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb71c26-e132-4be0-b0e3-19a82dd1814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:37.450675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb71c26-e132-4be0-b0e3-19a82dd1814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:37.451100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb71c26-e132-4be0-b0e3-19a82dd1814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:37.584630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ffb71c26-e132-4be0-b0e3-19a82dd1814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:37.588013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:37.593421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ffb71c26-e132-4be0-b0e3-19a82dd1814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:37.594859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ffb71c26-e132-4be0-b0e3-19a82dd1814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:37.596020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ffb71c26-e132-4be0-b0e3-19a82dd1814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.158976 Oct 28 20:13:37.596727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 641/1277] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:37 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:37.831419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0bd7b6d5-11c3-4dd2-8be7-e8964a807e4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:37.833553 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0bd7b6d5-11c3-4dd2-8be7-e8964a807e4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:37.840155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bd7b6d5-11c3-4dd2-8be7-e8964a807e4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:37.840635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bd7b6d5-11c3-4dd2-8be7-e8964a807e4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:37.841068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bd7b6d5-11c3-4dd2-8be7-e8964a807e4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:37.841777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bd7b6d5-11c3-4dd2-8be7-e8964a807e4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:37.842228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bd7b6d5-11c3-4dd2-8be7-e8964a807e4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:37.842653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bd7b6d5-11c3-4dd2-8be7-e8964a807e4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:37.871224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0bd7b6d5-11c3-4dd2-8be7-e8964a807e4f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 Oct 28 20:13:37.871763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 637/1278] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:37 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:37.885298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1692cc73-7f72-45c1-a406-85a433a478d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:37.885926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1692cc73-7f72-45c1-a406-85a433a478d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:37.892608 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1692cc73-7f72-45c1-a406-85a433a478d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:37.893079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1692cc73-7f72-45c1-a406-85a433a478d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:37.893626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1692cc73-7f72-45c1-a406-85a433a478d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:37.894471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1692cc73-7f72-45c1-a406-85a433a478d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:37.894923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1692cc73-7f72-45c1-a406-85a433a478d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:37.895344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1692cc73-7f72-45c1-a406-85a433a478d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:37.955902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1692cc73-7f72-45c1-a406-85a433a478d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:37.963719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1692cc73-7f72-45c1-a406-85a433a478d3 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082183 Oct 28 20:13:37.964286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 642/1279] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:37 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:38.621332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9356ddf8-b124-4f7f-9cbf-9465bf13ccb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:38.621961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9356ddf8-b124-4f7f-9cbf-9465bf13ccb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:38.628500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9356ddf8-b124-4f7f-9cbf-9465bf13ccb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:38.629014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9356ddf8-b124-4f7f-9cbf-9465bf13ccb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:38.629507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9356ddf8-b124-4f7f-9cbf-9465bf13ccb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:38.630180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9356ddf8-b124-4f7f-9cbf-9465bf13ccb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:38.630627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9356ddf8-b124-4f7f-9cbf-9465bf13ccb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:38.631043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9356ddf8-b124-4f7f-9cbf-9465bf13ccb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:38.757802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9356ddf8-b124-4f7f-9cbf-9465bf13ccb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:38.766272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9356ddf8-b124-4f7f-9cbf-9465bf13ccb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:38.767691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9356ddf8-b124-4f7f-9cbf-9465bf13ccb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:38.769842 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9356ddf8-b124-4f7f-9cbf-9465bf13ccb6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.152172 Oct 28 20:13:38.770811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 638/1280] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:38 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:38.884831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-96a33e2f-bd81-43cd-a728-98a2a8ea207b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:38.887082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-96a33e2f-bd81-43cd-a728-98a2a8ea207b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:38.894910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96a33e2f-bd81-43cd-a728-98a2a8ea207b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:38.895384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96a33e2f-bd81-43cd-a728-98a2a8ea207b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:38.895818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96a33e2f-bd81-43cd-a728-98a2a8ea207b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:38.896509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96a33e2f-bd81-43cd-a728-98a2a8ea207b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:38.896961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96a33e2f-bd81-43cd-a728-98a2a8ea207b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:38.897412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96a33e2f-bd81-43cd-a728-98a2a8ea207b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:38.926708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-96a33e2f-bd81-43cd-a728-98a2a8ea207b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046534 Oct 28 20:13:38.927272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 643/1281] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:38 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:38.985564 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4ede3380-8bc7-4d38-a699-a55bddd35be0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:38.986236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4ede3380-8bc7-4d38-a699-a55bddd35be0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:38.992668 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ede3380-8bc7-4d38-a699-a55bddd35be0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:38.993148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ede3380-8bc7-4d38-a699-a55bddd35be0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:38.993617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ede3380-8bc7-4d38-a699-a55bddd35be0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:38.994307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ede3380-8bc7-4d38-a699-a55bddd35be0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:38.994762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ede3380-8bc7-4d38-a699-a55bddd35be0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:38.995186 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ede3380-8bc7-4d38-a699-a55bddd35be0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:39.058745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4ede3380-8bc7-4d38-a699-a55bddd35be0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:39.067463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4ede3380-8bc7-4d38-a699-a55bddd35be0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085750 Oct 28 20:13:39.068025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 639/1282] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:38 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:39.797090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cc01b5eb-e272-4083-9561-070bbc998c64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:39.797733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cc01b5eb-e272-4083-9561-070bbc998c64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:39.803753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc01b5eb-e272-4083-9561-070bbc998c64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:39.804264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc01b5eb-e272-4083-9561-070bbc998c64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:39.804703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc01b5eb-e272-4083-9561-070bbc998c64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:39.805423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc01b5eb-e272-4083-9561-070bbc998c64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:39.805882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc01b5eb-e272-4083-9561-070bbc998c64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:39.806308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc01b5eb-e272-4083-9561-070bbc998c64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:39.937624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cc01b5eb-e272-4083-9561-070bbc998c64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:39.939371 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-83a2c936-ef76-4cf6-866a-32975b71cd1d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:39.942399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-83a2c936-ef76-4cf6-866a-32975b71cd1d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:39.946941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cc01b5eb-e272-4083-9561-070bbc998c64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:39.948274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83a2c936-ef76-4cf6-866a-32975b71cd1d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:39.948396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cc01b5eb-e272-4083-9561-070bbc998c64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:39.948764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83a2c936-ef76-4cf6-866a-32975b71cd1d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:39.949204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83a2c936-ef76-4cf6-866a-32975b71cd1d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:39.949578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cc01b5eb-e272-4083-9561-070bbc998c64 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.156369 Oct 28 20:13:39.949928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83a2c936-ef76-4cf6-866a-32975b71cd1d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:39.950136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 644/1283] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:39 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:39.950386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83a2c936-ef76-4cf6-866a-32975b71cd1d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:39.950817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83a2c936-ef76-4cf6-866a-32975b71cd1d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:39.980682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-83a2c936-ef76-4cf6-866a-32975b71cd1d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045460 Oct 28 20:13:39.981240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 640/1284] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:39 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:13:40.090758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a849e01b-0f03-4c46-9f99-8d9f6ba0ad58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:40.091309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a849e01b-0f03-4c46-9f99-8d9f6ba0ad58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:40.097301 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a849e01b-0f03-4c46-9f99-8d9f6ba0ad58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:40.097812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a849e01b-0f03-4c46-9f99-8d9f6ba0ad58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:40.098247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a849e01b-0f03-4c46-9f99-8d9f6ba0ad58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:40.098930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a849e01b-0f03-4c46-9f99-8d9f6ba0ad58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:40.099382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a849e01b-0f03-4c46-9f99-8d9f6ba0ad58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:40.099805 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a849e01b-0f03-4c46-9f99-8d9f6ba0ad58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:40.159678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a849e01b-0f03-4c46-9f99-8d9f6ba0ad58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:40.167230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a849e01b-0f03-4c46-9f99-8d9f6ba0ad58 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.080503 Oct 28 20:13:40.167794 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 645/1285] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:40 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:40.976444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-881d839d-b959-4fb8-b25e-8e7256aed128 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:40.977056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-881d839d-b959-4fb8-b25e-8e7256aed128 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:40.983768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-881d839d-b959-4fb8-b25e-8e7256aed128 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:40.984251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-881d839d-b959-4fb8-b25e-8e7256aed128 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:40.984689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-881d839d-b959-4fb8-b25e-8e7256aed128 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:40.985391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-881d839d-b959-4fb8-b25e-8e7256aed128 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:40.985847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-881d839d-b959-4fb8-b25e-8e7256aed128 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:40.986268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-881d839d-b959-4fb8-b25e-8e7256aed128 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:40.993275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d3fde6cc-10c4-4e7c-99db-9f41f9f425b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:40.995486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d3fde6cc-10c4-4e7c-99db-9f41f9f425b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:41.001193 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:41.002027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3fde6cc-10c4-4e7c-99db-9f41f9f425b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:41.002361 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3fde6cc-10c4-4e7c-99db-9f41f9f425b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:41.002917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3fde6cc-10c4-4e7c-99db-9f41f9f425b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:41.003632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3fde6cc-10c4-4e7c-99db-9f41f9f425b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:41.004087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3fde6cc-10c4-4e7c-99db-9f41f9f425b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:41.004514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3fde6cc-10c4-4e7c-99db-9f41f9f425b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:41.038057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d3fde6cc-10c4-4e7c-99db-9f41f9f425b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048757 Oct 28 20:13:41.038635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 646/1286] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:40 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:41.120490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-881d839d-b959-4fb8-b25e-8e7256aed128 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:41.129859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-881d839d-b959-4fb8-b25e-8e7256aed128 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:41.131329 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-881d839d-b959-4fb8-b25e-8e7256aed128 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:41.132493 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-881d839d-b959-4fb8-b25e-8e7256aed128 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.159918 Oct 28 20:13:41.133149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 641/1287] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:40 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:41.189403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2d2644eb-c92e-4290-bc2a-6ddc1f2ba5df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:41.190611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2d2644eb-c92e-4290-bc2a-6ddc1f2ba5df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:41.196456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d2644eb-c92e-4290-bc2a-6ddc1f2ba5df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:41.196933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d2644eb-c92e-4290-bc2a-6ddc1f2ba5df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:41.197396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d2644eb-c92e-4290-bc2a-6ddc1f2ba5df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:41.198084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d2644eb-c92e-4290-bc2a-6ddc1f2ba5df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:41.198537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d2644eb-c92e-4290-bc2a-6ddc1f2ba5df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:41.198961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d2644eb-c92e-4290-bc2a-6ddc1f2ba5df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:41.259998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2d2644eb-c92e-4290-bc2a-6ddc1f2ba5df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:41.267536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2d2644eb-c92e-4290-bc2a-6ddc1f2ba5df tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082075 Oct 28 20:13:41.268721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 647/1288] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:41 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:42.051342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8b10b585-de04-4352-97c8-f1afbdb75be8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:42.053554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8b10b585-de04-4352-97c8-f1afbdb75be8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:42.059970 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b10b585-de04-4352-97c8-f1afbdb75be8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:42.060455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b10b585-de04-4352-97c8-f1afbdb75be8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:42.060892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b10b585-de04-4352-97c8-f1afbdb75be8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:42.061613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b10b585-de04-4352-97c8-f1afbdb75be8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:42.062069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b10b585-de04-4352-97c8-f1afbdb75be8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:42.062495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b10b585-de04-4352-97c8-f1afbdb75be8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:42.092323 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8b10b585-de04-4352-97c8-f1afbdb75be8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045835 Oct 28 20:13:42.092873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 642/1289] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:42 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:42.159850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ba9ae2f7-f91a-4d33-ac66-ed8b389ab0cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:42.160475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ba9ae2f7-f91a-4d33-ac66-ed8b389ab0cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:42.166870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba9ae2f7-f91a-4d33-ac66-ed8b389ab0cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:42.167351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba9ae2f7-f91a-4d33-ac66-ed8b389ab0cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:42.167793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba9ae2f7-f91a-4d33-ac66-ed8b389ab0cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:42.168482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba9ae2f7-f91a-4d33-ac66-ed8b389ab0cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:42.168935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba9ae2f7-f91a-4d33-ac66-ed8b389ab0cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:42.169383 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba9ae2f7-f91a-4d33-ac66-ed8b389ab0cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:42.291347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c2cee4af-c3b9-41a3-93c1-d38d4d1950c1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:42.291888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c2cee4af-c3b9-41a3-93c1-d38d4d1950c1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:42.297891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2cee4af-c3b9-41a3-93c1-d38d4d1950c1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:42.298384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2cee4af-c3b9-41a3-93c1-d38d4d1950c1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:42.298822 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2cee4af-c3b9-41a3-93c1-d38d4d1950c1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:42.299529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2cee4af-c3b9-41a3-93c1-d38d4d1950c1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:42.299855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba9ae2f7-f91a-4d33-ac66-ed8b389ab0cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:42.300340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2cee4af-c3b9-41a3-93c1-d38d4d1950c1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:42.300817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2cee4af-c3b9-41a3-93c1-d38d4d1950c1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:42.308861 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba9ae2f7-f91a-4d33-ac66-ed8b389ab0cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:42.310354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba9ae2f7-f91a-4d33-ac66-ed8b389ab0cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:42.311515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ba9ae2f7-f91a-4d33-ac66-ed8b389ab0cb tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.156364 Oct 28 20:13:42.312074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 648/1290] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:42 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:42.368286 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c2cee4af-c3b9-41a3-93c1-d38d4d1950c1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:42.375819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c2cee4af-c3b9-41a3-93c1-d38d4d1950c1 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.088756 Oct 28 20:13:42.376377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 643/1291] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:42 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:13:43.104673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ca496e9f-136f-4725-a75b-6aefeea2fb9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:43.106854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ca496e9f-136f-4725-a75b-6aefeea2fb9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:43.113282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca496e9f-136f-4725-a75b-6aefeea2fb9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:43.113805 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca496e9f-136f-4725-a75b-6aefeea2fb9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:43.114341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca496e9f-136f-4725-a75b-6aefeea2fb9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:43.115087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca496e9f-136f-4725-a75b-6aefeea2fb9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:43.115498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca496e9f-136f-4725-a75b-6aefeea2fb9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:43.116071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca496e9f-136f-4725-a75b-6aefeea2fb9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:43.151816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ca496e9f-136f-4725-a75b-6aefeea2fb9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050957 Oct 28 20:13:43.152450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 649/1292] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:43 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:43.339847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0bab2ca-6118-41f3-a547-cc41be34f64e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:43.340374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0bab2ca-6118-41f3-a547-cc41be34f64e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:43.349560 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0bab2ca-6118-41f3-a547-cc41be34f64e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:43.350049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0bab2ca-6118-41f3-a547-cc41be34f64e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:43.350488 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0bab2ca-6118-41f3-a547-cc41be34f64e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:43.351233 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0bab2ca-6118-41f3-a547-cc41be34f64e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:43.351683 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0bab2ca-6118-41f3-a547-cc41be34f64e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:43.352109 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0bab2ca-6118-41f3-a547-cc41be34f64e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:43.398816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc0ba052-2d25-429a-b7d1-82b48ec7b9d7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:43.399649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dc0ba052-2d25-429a-b7d1-82b48ec7b9d7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:43.408002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0ba052-2d25-429a-b7d1-82b48ec7b9d7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:43.408482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0ba052-2d25-429a-b7d1-82b48ec7b9d7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:43.409935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0ba052-2d25-429a-b7d1-82b48ec7b9d7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:43.411048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0ba052-2d25-429a-b7d1-82b48ec7b9d7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:43.411513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0ba052-2d25-429a-b7d1-82b48ec7b9d7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:43.411929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0ba052-2d25-429a-b7d1-82b48ec7b9d7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:43.504395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dc0ba052-2d25-429a-b7d1-82b48ec7b9d7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:43.518176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc0ba052-2d25-429a-b7d1-82b48ec7b9d7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.122946 Oct 28 20:13:43.519825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 650/1293] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:43 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:13:43.536839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c0bab2ca-6118-41f3-a547-cc41be34f64e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:43.546971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c0bab2ca-6118-41f3-a547-cc41be34f64e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:43.548559 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c0bab2ca-6118-41f3-a547-cc41be34f64e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:43.550502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c0bab2ca-6118-41f3-a547-cc41be34f64e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.215998 Oct 28 20:13:43.551152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 644/1294] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:43 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:44.168619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9de3603a-c95c-41dd-9244-91e6327ab2be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:44.170799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9de3603a-c95c-41dd-9244-91e6327ab2be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:44.177000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9de3603a-c95c-41dd-9244-91e6327ab2be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:44.177513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9de3603a-c95c-41dd-9244-91e6327ab2be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:44.177950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9de3603a-c95c-41dd-9244-91e6327ab2be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:44.178642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9de3603a-c95c-41dd-9244-91e6327ab2be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:44.179093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9de3603a-c95c-41dd-9244-91e6327ab2be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:44.179515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9de3603a-c95c-41dd-9244-91e6327ab2be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:44.209943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9de3603a-c95c-41dd-9244-91e6327ab2be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044926 Oct 28 20:13:44.210776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 651/1295] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:44 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:44.544293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c500acd9-2cc1-48f7-9510-56f68df29686 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:44.544918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c500acd9-2cc1-48f7-9510-56f68df29686 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:44.551918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c500acd9-2cc1-48f7-9510-56f68df29686 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:44.552397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c500acd9-2cc1-48f7-9510-56f68df29686 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:44.552835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c500acd9-2cc1-48f7-9510-56f68df29686 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:44.553551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c500acd9-2cc1-48f7-9510-56f68df29686 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:44.554002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c500acd9-2cc1-48f7-9510-56f68df29686 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:44.554434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c500acd9-2cc1-48f7-9510-56f68df29686 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:44.579960 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fff4ab60-b8e6-4bf9-bab8-3976cfa7d0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:44.580716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fff4ab60-b8e6-4bf9-bab8-3976cfa7d0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:44.588678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fff4ab60-b8e6-4bf9-bab8-3976cfa7d0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:44.589182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fff4ab60-b8e6-4bf9-bab8-3976cfa7d0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:44.589658 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fff4ab60-b8e6-4bf9-bab8-3976cfa7d0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:44.590358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fff4ab60-b8e6-4bf9-bab8-3976cfa7d0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:44.590816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fff4ab60-b8e6-4bf9-bab8-3976cfa7d0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:44.591254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fff4ab60-b8e6-4bf9-bab8-3976cfa7d0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:44.618404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c500acd9-2cc1-48f7-9510-56f68df29686 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:44.626505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c500acd9-2cc1-48f7-9510-56f68df29686 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.086065 Oct 28 20:13:44.627081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 645/1296] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:44 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:44.741604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fff4ab60-b8e6-4bf9-bab8-3976cfa7d0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:44.755038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fff4ab60-b8e6-4bf9-bab8-3976cfa7d0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:44.756484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fff4ab60-b8e6-4bf9-bab8-3976cfa7d0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:44.764244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fff4ab60-b8e6-4bf9-bab8-3976cfa7d0ad tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.182248 Oct 28 20:13:44.764244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 652/1297] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:44 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:45.222554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-80c42594-94b1-46a8-b47d-20ca4401ab82 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:45.224743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-80c42594-94b1-46a8-b47d-20ca4401ab82 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:45.230733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80c42594-94b1-46a8-b47d-20ca4401ab82 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:45.231217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80c42594-94b1-46a8-b47d-20ca4401ab82 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:45.231755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80c42594-94b1-46a8-b47d-20ca4401ab82 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:45.232455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80c42594-94b1-46a8-b47d-20ca4401ab82 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:45.232912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80c42594-94b1-46a8-b47d-20ca4401ab82 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:45.233369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80c42594-94b1-46a8-b47d-20ca4401ab82 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:45.262028 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-80c42594-94b1-46a8-b47d-20ca4401ab82 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044081 Oct 28 20:13:45.262573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 646/1298] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:45 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:45.659255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-449845cb-999b-4431-b3ac-5961dc92e4bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:45.660089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-449845cb-999b-4431-b3ac-5961dc92e4bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:45.666468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-449845cb-999b-4431-b3ac-5961dc92e4bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:45.666950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-449845cb-999b-4431-b3ac-5961dc92e4bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:45.667389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-449845cb-999b-4431-b3ac-5961dc92e4bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:45.668079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-449845cb-999b-4431-b3ac-5961dc92e4bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:45.668529 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-449845cb-999b-4431-b3ac-5961dc92e4bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:45.668989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-449845cb-999b-4431-b3ac-5961dc92e4bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:45.733506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-449845cb-999b-4431-b3ac-5961dc92e4bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:45.742530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-449845cb-999b-4431-b3ac-5961dc92e4bb tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.087694 Oct 28 20:13:45.743260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 653/1299] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:45 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:45.784140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-008abb41-2345-482d-95fa-8a1695b2c333 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:45.785010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-008abb41-2345-482d-95fa-8a1695b2c333 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:45.791464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008abb41-2345-482d-95fa-8a1695b2c333 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:45.792011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008abb41-2345-482d-95fa-8a1695b2c333 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:45.792510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008abb41-2345-482d-95fa-8a1695b2c333 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:45.793259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008abb41-2345-482d-95fa-8a1695b2c333 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:45.793831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008abb41-2345-482d-95fa-8a1695b2c333 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:45.794317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008abb41-2345-482d-95fa-8a1695b2c333 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:45.923307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-008abb41-2345-482d-95fa-8a1695b2c333 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:45.932645 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-008abb41-2345-482d-95fa-8a1695b2c333 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:45.934121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-008abb41-2345-482d-95fa-8a1695b2c333 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:45.935272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-008abb41-2345-482d-95fa-8a1695b2c333 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.155726 Oct 28 20:13:45.935824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 647/1300] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:45 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:46.275381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0fac08ea-6d7f-441a-84e2-3fd035e95870 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:46.277627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0fac08ea-6d7f-441a-84e2-3fd035e95870 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:46.284159 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fac08ea-6d7f-441a-84e2-3fd035e95870 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:46.284719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fac08ea-6d7f-441a-84e2-3fd035e95870 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:46.285156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fac08ea-6d7f-441a-84e2-3fd035e95870 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:46.285874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fac08ea-6d7f-441a-84e2-3fd035e95870 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:46.286331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fac08ea-6d7f-441a-84e2-3fd035e95870 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:46.286756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fac08ea-6d7f-441a-84e2-3fd035e95870 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:46.315650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0fac08ea-6d7f-441a-84e2-3fd035e95870 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Oct 28 20:13:46.316192 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 654/1301] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:46 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:13:46.765299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ae61a1c2-ed3d-4ef0-b735-e7a4a3132e21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:46.766043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ae61a1c2-ed3d-4ef0-b735-e7a4a3132e21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:46.773031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae61a1c2-ed3d-4ef0-b735-e7a4a3132e21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:46.773559 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae61a1c2-ed3d-4ef0-b735-e7a4a3132e21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:46.773999 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae61a1c2-ed3d-4ef0-b735-e7a4a3132e21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:46.774695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae61a1c2-ed3d-4ef0-b735-e7a4a3132e21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:46.775152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae61a1c2-ed3d-4ef0-b735-e7a4a3132e21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:46.775577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae61a1c2-ed3d-4ef0-b735-e7a4a3132e21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:46.843235 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ae61a1c2-ed3d-4ef0-b735-e7a4a3132e21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:46.852953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ae61a1c2-ed3d-4ef0-b735-e7a4a3132e21 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.091579 Oct 28 20:13:46.853543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 648/1302] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:46 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:46.960863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-11daf0aa-5c75-43cd-ac4f-0fb8d454d81a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:46.961573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-11daf0aa-5c75-43cd-ac4f-0fb8d454d81a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:46.967500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11daf0aa-5c75-43cd-ac4f-0fb8d454d81a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:46.967981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11daf0aa-5c75-43cd-ac4f-0fb8d454d81a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:46.968418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11daf0aa-5c75-43cd-ac4f-0fb8d454d81a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:46.969106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11daf0aa-5c75-43cd-ac4f-0fb8d454d81a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:46.969583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11daf0aa-5c75-43cd-ac4f-0fb8d454d81a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:46.970010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11daf0aa-5c75-43cd-ac4f-0fb8d454d81a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:47.096666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-11daf0aa-5c75-43cd-ac4f-0fb8d454d81a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:47.105062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-11daf0aa-5c75-43cd-ac4f-0fb8d454d81a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:47.106526 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-11daf0aa-5c75-43cd-ac4f-0fb8d454d81a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:47.107676 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-11daf0aa-5c75-43cd-ac4f-0fb8d454d81a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.150956 Oct 28 20:13:47.108234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 655/1303] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:46 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:47.328084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6292404e-0cb6-4c16-bb52-f50e9400f6b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:47.330170 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6292404e-0cb6-4c16-bb52-f50e9400f6b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:47.337157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6292404e-0cb6-4c16-bb52-f50e9400f6b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:47.337676 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6292404e-0cb6-4c16-bb52-f50e9400f6b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:47.338104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6292404e-0cb6-4c16-bb52-f50e9400f6b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:47.338783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6292404e-0cb6-4c16-bb52-f50e9400f6b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:47.339231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6292404e-0cb6-4c16-bb52-f50e9400f6b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:47.339650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6292404e-0cb6-4c16-bb52-f50e9400f6b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:47.368130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6292404e-0cb6-4c16-bb52-f50e9400f6b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044076 Oct 28 20:13:47.368664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 649/1304] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:47 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:47.875883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cfc415c3-225d-429f-bfbf-633145f515b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:47.876500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cfc415c3-225d-429f-bfbf-633145f515b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:47.882898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfc415c3-225d-429f-bfbf-633145f515b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:47.883375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfc415c3-225d-429f-bfbf-633145f515b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:47.883813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfc415c3-225d-429f-bfbf-633145f515b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:47.884495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfc415c3-225d-429f-bfbf-633145f515b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:47.884945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfc415c3-225d-429f-bfbf-633145f515b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:47.885388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfc415c3-225d-429f-bfbf-633145f515b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:47.947440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cfc415c3-225d-429f-bfbf-633145f515b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:47.955503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cfc415c3-225d-429f-bfbf-633145f515b5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.083392 Oct 28 20:13:47.961046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 656/1305] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:47 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:48.132233 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0bcd8fc6-bd6a-4338-90eb-755d4f2a9431 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:48.132787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0bcd8fc6-bd6a-4338-90eb-755d4f2a9431 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:48.139123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bcd8fc6-bd6a-4338-90eb-755d4f2a9431 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:48.139604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bcd8fc6-bd6a-4338-90eb-755d4f2a9431 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:48.140088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bcd8fc6-bd6a-4338-90eb-755d4f2a9431 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:48.140765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bcd8fc6-bd6a-4338-90eb-755d4f2a9431 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:48.141236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bcd8fc6-bd6a-4338-90eb-755d4f2a9431 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:48.141679 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bcd8fc6-bd6a-4338-90eb-755d4f2a9431 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:48.276261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0bcd8fc6-bd6a-4338-90eb-755d4f2a9431 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:48.285505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0bcd8fc6-bd6a-4338-90eb-755d4f2a9431 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:48.286945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0bcd8fc6-bd6a-4338-90eb-755d4f2a9431 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:48.288102 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0bcd8fc6-bd6a-4338-90eb-755d4f2a9431 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.159925 Oct 28 20:13:48.288653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 650/1306] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:48 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:48.380483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3895db4b-80d4-45eb-b8e3-1b3de5928ce4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:48.383796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3895db4b-80d4-45eb-b8e3-1b3de5928ce4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:48.392034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3895db4b-80d4-45eb-b8e3-1b3de5928ce4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:48.393433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3895db4b-80d4-45eb-b8e3-1b3de5928ce4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:48.394240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3895db4b-80d4-45eb-b8e3-1b3de5928ce4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:48.395491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3895db4b-80d4-45eb-b8e3-1b3de5928ce4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:48.396330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3895db4b-80d4-45eb-b8e3-1b3de5928ce4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:48.397110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3895db4b-80d4-45eb-b8e3-1b3de5928ce4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:48.429696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3895db4b-80d4-45eb-b8e3-1b3de5928ce4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053099 Oct 28 20:13:48.430251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 657/1307] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:48 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:48.988319 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b0503ba9-b161-4a60-8e0a-77247b025b1f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:48.988958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b0503ba9-b161-4a60-8e0a-77247b025b1f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:49.000141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0503ba9-b161-4a60-8e0a-77247b025b1f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:49.000627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0503ba9-b161-4a60-8e0a-77247b025b1f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:49.001057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0503ba9-b161-4a60-8e0a-77247b025b1f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:49.001779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0503ba9-b161-4a60-8e0a-77247b025b1f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:49.002902 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0503ba9-b161-4a60-8e0a-77247b025b1f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:49.003483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0503ba9-b161-4a60-8e0a-77247b025b1f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:49.065214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b0503ba9-b161-4a60-8e0a-77247b025b1f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:49.073139 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b0503ba9-b161-4a60-8e0a-77247b025b1f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.089214 Oct 28 20:13:49.074429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 651/1308] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:48 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:49.313227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-319a614a-f134-4a41-88ef-ede76780cee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:49.313864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-319a614a-f134-4a41-88ef-ede76780cee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:49.316816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=82 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:49.321511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-319a614a-f134-4a41-88ef-ede76780cee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:49.321986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-319a614a-f134-4a41-88ef-ede76780cee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:49.322412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-319a614a-f134-4a41-88ef-ede76780cee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:49.323087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-319a614a-f134-4a41-88ef-ede76780cee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:49.323558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-319a614a-f134-4a41-88ef-ede76780cee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:49.323978 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-319a614a-f134-4a41-88ef-ede76780cee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:49.345276 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:49.442514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-08069198-de4c-4ad9-9dc4-7861754ab56d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:49.444762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-08069198-de4c-4ad9-9dc4-7861754ab56d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:49.451481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08069198-de4c-4ad9-9dc4-7861754ab56d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:49.451966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08069198-de4c-4ad9-9dc4-7861754ab56d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:49.452399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08069198-de4c-4ad9-9dc4-7861754ab56d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:49.453127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08069198-de4c-4ad9-9dc4-7861754ab56d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:49.453622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08069198-de4c-4ad9-9dc4-7861754ab56d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:49.454048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08069198-de4c-4ad9-9dc4-7861754ab56d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:49.458427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-319a614a-f134-4a41-88ef-ede76780cee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:49.467685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-319a614a-f134-4a41-88ef-ede76780cee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:49.469157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-319a614a-f134-4a41-88ef-ede76780cee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:49.470398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-319a614a-f134-4a41-88ef-ede76780cee7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.161112 Oct 28 20:13:49.471607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 658/1309] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:49 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:49.485489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-08069198-de4c-4ad9-9dc4-7861754ab56d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047189 Oct 28 20:13:49.486057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 652/1310] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:49 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:13:50.096838 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9b8f29d0-f44d-45ac-aa67-147efdaed21e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:50.097589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9b8f29d0-f44d-45ac-aa67-147efdaed21e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:50.103421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b8f29d0-f44d-45ac-aa67-147efdaed21e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:50.103910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b8f29d0-f44d-45ac-aa67-147efdaed21e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:50.104350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b8f29d0-f44d-45ac-aa67-147efdaed21e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:50.105050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b8f29d0-f44d-45ac-aa67-147efdaed21e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:50.105538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b8f29d0-f44d-45ac-aa67-147efdaed21e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:50.105972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b8f29d0-f44d-45ac-aa67-147efdaed21e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:50.169439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9b8f29d0-f44d-45ac-aa67-147efdaed21e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:50.177085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9b8f29d0-f44d-45ac-aa67-147efdaed21e tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084728 Oct 28 20:13:50.177683 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 659/1311] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:50 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:50.497360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dedea0ac-e1c5-4482-a0c4-444d3ddbe40f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:50.497974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dedea0ac-e1c5-4482-a0c4-444d3ddbe40f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:50.504699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a0680b5c-11db-497e-ab42-b8d0f0f992e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:50.505492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dedea0ac-e1c5-4482-a0c4-444d3ddbe40f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:50.505974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dedea0ac-e1c5-4482-a0c4-444d3ddbe40f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:50.506403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dedea0ac-e1c5-4482-a0c4-444d3ddbe40f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:50.506935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a0680b5c-11db-497e-ab42-b8d0f0f992e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:50.507082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dedea0ac-e1c5-4482-a0c4-444d3ddbe40f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:50.507533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dedea0ac-e1c5-4482-a0c4-444d3ddbe40f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:50.507953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dedea0ac-e1c5-4482-a0c4-444d3ddbe40f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:50.513188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0680b5c-11db-497e-ab42-b8d0f0f992e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:50.513716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0680b5c-11db-497e-ab42-b8d0f0f992e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:50.514157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0680b5c-11db-497e-ab42-b8d0f0f992e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:50.514848 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0680b5c-11db-497e-ab42-b8d0f0f992e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:50.515301 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0680b5c-11db-497e-ab42-b8d0f0f992e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:50.515724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0680b5c-11db-497e-ab42-b8d0f0f992e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:50.545592 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a0680b5c-11db-497e-ab42-b8d0f0f992e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045991 Oct 28 20:13:50.546516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 660/1312] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:50 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:13:50.638492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-dedea0ac-e1c5-4482-a0c4-444d3ddbe40f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:50.647624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-dedea0ac-e1c5-4482-a0c4-444d3ddbe40f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:50.649068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-dedea0ac-e1c5-4482-a0c4-444d3ddbe40f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:50.650253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dedea0ac-e1c5-4482-a0c4-444d3ddbe40f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.156793 Oct 28 20:13:50.650809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 653/1313] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:50 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:51.199462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-debe609f-6b3c-43a0-9357-1bb83437d7f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:51.200126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-debe609f-6b3c-43a0-9357-1bb83437d7f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:51.206177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-debe609f-6b3c-43a0-9357-1bb83437d7f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:51.206662 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-debe609f-6b3c-43a0-9357-1bb83437d7f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:51.207103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-debe609f-6b3c-43a0-9357-1bb83437d7f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:51.207796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-debe609f-6b3c-43a0-9357-1bb83437d7f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:51.208250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-debe609f-6b3c-43a0-9357-1bb83437d7f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:51.208678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-debe609f-6b3c-43a0-9357-1bb83437d7f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:51.269577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-debe609f-6b3c-43a0-9357-1bb83437d7f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:51.277240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-debe609f-6b3c-43a0-9357-1bb83437d7f0 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081757 Oct 28 20:13:51.277834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 661/1314] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:51 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:51.558089 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef304633-0b99-411f-9712-0018cd31f821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:51.560275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef304633-0b99-411f-9712-0018cd31f821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:51.567664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef304633-0b99-411f-9712-0018cd31f821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:51.568150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef304633-0b99-411f-9712-0018cd31f821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:51.568586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef304633-0b99-411f-9712-0018cd31f821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:51.569273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef304633-0b99-411f-9712-0018cd31f821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:51.569753 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef304633-0b99-411f-9712-0018cd31f821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:51.570180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef304633-0b99-411f-9712-0018cd31f821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:51.600032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ef304633-0b99-411f-9712-0018cd31f821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045877 Oct 28 20:13:51.600586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 654/1315] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:51 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:51.677789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ae4bde3-452f-4676-a8e6-173d1f2a353e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:51.678410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1ae4bde3-452f-4676-a8e6-173d1f2a353e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:51.684704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ae4bde3-452f-4676-a8e6-173d1f2a353e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:51.685188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ae4bde3-452f-4676-a8e6-173d1f2a353e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:51.685670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ae4bde3-452f-4676-a8e6-173d1f2a353e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:51.686359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ae4bde3-452f-4676-a8e6-173d1f2a353e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:51.686813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ae4bde3-452f-4676-a8e6-173d1f2a353e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:51.687239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ae4bde3-452f-4676-a8e6-173d1f2a353e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:51.817699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ae4bde3-452f-4676-a8e6-173d1f2a353e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:51.826084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ae4bde3-452f-4676-a8e6-173d1f2a353e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:51.827549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ae4bde3-452f-4676-a8e6-173d1f2a353e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:51.828683 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1ae4bde3-452f-4676-a8e6-173d1f2a353e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.155648 Oct 28 20:13:51.829233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 662/1316] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:51 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:52.300424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-33cf5b46-d801-4749-995a-28d4844a1097 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:52.301038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-33cf5b46-d801-4749-995a-28d4844a1097 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:52.307066 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33cf5b46-d801-4749-995a-28d4844a1097 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:52.307554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33cf5b46-d801-4749-995a-28d4844a1097 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:52.307994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33cf5b46-d801-4749-995a-28d4844a1097 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:52.308685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33cf5b46-d801-4749-995a-28d4844a1097 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:52.309141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33cf5b46-d801-4749-995a-28d4844a1097 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:52.309600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33cf5b46-d801-4749-995a-28d4844a1097 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:52.371317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-33cf5b46-d801-4749-995a-28d4844a1097 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:52.379205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-33cf5b46-d801-4749-995a-28d4844a1097 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082957 Oct 28 20:13:52.379599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 655/1317] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:52 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:52.612886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94660230-b79f-40ce-b499-dd301f134353 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:52.615056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-94660230-b79f-40ce-b499-dd301f134353 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:52.620892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94660230-b79f-40ce-b499-dd301f134353 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:52.621395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94660230-b79f-40ce-b499-dd301f134353 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:52.621889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94660230-b79f-40ce-b499-dd301f134353 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:52.622568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94660230-b79f-40ce-b499-dd301f134353 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:52.623017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94660230-b79f-40ce-b499-dd301f134353 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:52.623432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94660230-b79f-40ce-b499-dd301f134353 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:52.652907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-94660230-b79f-40ce-b499-dd301f134353 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044589 Oct 28 20:13:52.653468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 663/1318] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:52 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:52.854520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-64ddef54-7176-4246-8f01-fd54fb05a09d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:52.855127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-64ddef54-7176-4246-8f01-fd54fb05a09d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:52.861558 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ddef54-7176-4246-8f01-fd54fb05a09d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:52.862038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ddef54-7176-4246-8f01-fd54fb05a09d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:52.862472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ddef54-7176-4246-8f01-fd54fb05a09d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:52.863209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ddef54-7176-4246-8f01-fd54fb05a09d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:52.863607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ddef54-7176-4246-8f01-fd54fb05a09d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:52.864032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ddef54-7176-4246-8f01-fd54fb05a09d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:52.997679 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-64ddef54-7176-4246-8f01-fd54fb05a09d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:53.006207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-64ddef54-7176-4246-8f01-fd54fb05a09d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:53.007633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-64ddef54-7176-4246-8f01-fd54fb05a09d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:53.008777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-64ddef54-7176-4246-8f01-fd54fb05a09d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.158173 Oct 28 20:13:53.009384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 656/1319] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:52 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:53.402656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4fcadd62-d516-463c-b300-eca68480c820 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:53.403316 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4fcadd62-d516-463c-b300-eca68480c820 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:53.409858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fcadd62-d516-463c-b300-eca68480c820 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:53.410342 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fcadd62-d516-463c-b300-eca68480c820 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:53.410782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fcadd62-d516-463c-b300-eca68480c820 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:53.411474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fcadd62-d516-463c-b300-eca68480c820 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:53.411932 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fcadd62-d516-463c-b300-eca68480c820 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:53.412361 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fcadd62-d516-463c-b300-eca68480c820 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:53.475827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4fcadd62-d516-463c-b300-eca68480c820 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:53.483427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4fcadd62-d516-463c-b300-eca68480c820 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.085080 Oct 28 20:13:53.483988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 664/1320] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:53 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:53.665298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c6f28e00-4a85-47ff-95ad-6ca719afe9d5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:53.667416 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c6f28e00-4a85-47ff-95ad-6ca719afe9d5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:53.669241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=80 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:53.675188 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6f28e00-4a85-47ff-95ad-6ca719afe9d5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:53.675836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6f28e00-4a85-47ff-95ad-6ca719afe9d5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:53.676353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6f28e00-4a85-47ff-95ad-6ca719afe9d5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:53.677031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6f28e00-4a85-47ff-95ad-6ca719afe9d5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:53.677515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6f28e00-4a85-47ff-95ad-6ca719afe9d5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:53.677932 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6f28e00-4a85-47ff-95ad-6ca719afe9d5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:53.707417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c6f28e00-4a85-47ff-95ad-6ca719afe9d5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046162 Oct 28 20:13:53.707959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 657/1321] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:53 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:54.035013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7b1f51e7-48d7-463b-aa03-6bbcd3f19daf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:54.035687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7b1f51e7-48d7-463b-aa03-6bbcd3f19daf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:54.041608 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b1f51e7-48d7-463b-aa03-6bbcd3f19daf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:54.042094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b1f51e7-48d7-463b-aa03-6bbcd3f19daf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:54.042533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b1f51e7-48d7-463b-aa03-6bbcd3f19daf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:54.043227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b1f51e7-48d7-463b-aa03-6bbcd3f19daf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:54.043685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b1f51e7-48d7-463b-aa03-6bbcd3f19daf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:54.044112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b1f51e7-48d7-463b-aa03-6bbcd3f19daf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:54.168784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7b1f51e7-48d7-463b-aa03-6bbcd3f19daf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:54.178285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7b1f51e7-48d7-463b-aa03-6bbcd3f19daf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:54.179727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7b1f51e7-48d7-463b-aa03-6bbcd3f19daf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:54.180893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7b1f51e7-48d7-463b-aa03-6bbcd3f19daf tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.150302 Oct 28 20:13:54.181480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 665/1322] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:54 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:54.506310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ad475b3-345c-4787-bd2a-e7a2160ad515 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:54.506927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6ad475b3-345c-4787-bd2a-e7a2160ad515 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:54.513752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad475b3-345c-4787-bd2a-e7a2160ad515 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:54.514244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad475b3-345c-4787-bd2a-e7a2160ad515 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:54.514966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad475b3-345c-4787-bd2a-e7a2160ad515 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:54.515450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad475b3-345c-4787-bd2a-e7a2160ad515 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:54.515897 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad475b3-345c-4787-bd2a-e7a2160ad515 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:54.516313 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad475b3-345c-4787-bd2a-e7a2160ad515 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:54.521585 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:54.589710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6ad475b3-345c-4787-bd2a-e7a2160ad515 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:54.597782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6ad475b3-345c-4787-bd2a-e7a2160ad515 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.095188 Oct 28 20:13:54.598359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 658/1323] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:54 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:54.720084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4a6df988-a007-45a3-9867-3ed816acc436 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:54.722273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4a6df988-a007-45a3-9867-3ed816acc436 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:54.728640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a6df988-a007-45a3-9867-3ed816acc436 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:54.729106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a6df988-a007-45a3-9867-3ed816acc436 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:54.729566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a6df988-a007-45a3-9867-3ed816acc436 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:54.730246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a6df988-a007-45a3-9867-3ed816acc436 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:54.730694 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a6df988-a007-45a3-9867-3ed816acc436 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:54.731108 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a6df988-a007-45a3-9867-3ed816acc436 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:54.760436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4a6df988-a007-45a3-9867-3ed816acc436 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044297 Oct 28 20:13:54.760974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 666/1324] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:54 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:55.206294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b9a3296-4cf4-486b-9dbb-dce2c8214068 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:55.206880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7b9a3296-4cf4-486b-9dbb-dce2c8214068 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:55.213630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b9a3296-4cf4-486b-9dbb-dce2c8214068 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:55.214116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b9a3296-4cf4-486b-9dbb-dce2c8214068 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:55.214589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b9a3296-4cf4-486b-9dbb-dce2c8214068 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:55.215276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b9a3296-4cf4-486b-9dbb-dce2c8214068 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:55.215730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b9a3296-4cf4-486b-9dbb-dce2c8214068 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:55.216153 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b9a3296-4cf4-486b-9dbb-dce2c8214068 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:55.347203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b9a3296-4cf4-486b-9dbb-dce2c8214068 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:55.355727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b9a3296-4cf4-486b-9dbb-dce2c8214068 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:55.357194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b9a3296-4cf4-486b-9dbb-dce2c8214068 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:55.358393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7b9a3296-4cf4-486b-9dbb-dce2c8214068 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.156087 Oct 28 20:13:55.358948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 659/1325] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:55 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:55.620902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ea329a53-4fde-4508-92c4-bb42ec7a5cc7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:55.621478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ea329a53-4fde-4508-92c4-bb42ec7a5cc7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:55.627357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea329a53-4fde-4508-92c4-bb42ec7a5cc7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:55.627845 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea329a53-4fde-4508-92c4-bb42ec7a5cc7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:55.628371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea329a53-4fde-4508-92c4-bb42ec7a5cc7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:55.629074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea329a53-4fde-4508-92c4-bb42ec7a5cc7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:55.629557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea329a53-4fde-4508-92c4-bb42ec7a5cc7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:55.629985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea329a53-4fde-4508-92c4-bb42ec7a5cc7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:55.690302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ea329a53-4fde-4508-92c4-bb42ec7a5cc7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:55.697982 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ea329a53-4fde-4508-92c4-bb42ec7a5cc7 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.081037 Oct 28 20:13:55.698598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 667/1326] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:55 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:55.772540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fa997466-80a1-4aac-92be-49131436b046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:55.774738 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fa997466-80a1-4aac-92be-49131436b046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:55.781400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa997466-80a1-4aac-92be-49131436b046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:55.781883 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa997466-80a1-4aac-92be-49131436b046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:55.782320 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa997466-80a1-4aac-92be-49131436b046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:55.783040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa997466-80a1-4aac-92be-49131436b046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:55.783500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa997466-80a1-4aac-92be-49131436b046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:55.784628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa997466-80a1-4aac-92be-49131436b046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:55.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fa997466-80a1-4aac-92be-49131436b046 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046959 Oct 28 20:13:55.815726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 660/1327] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:55 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:56.384750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-52542925-d8ab-473a-86bf-0a0b24aae795 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:56.385291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-52542925-d8ab-473a-86bf-0a0b24aae795 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:56.391712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52542925-d8ab-473a-86bf-0a0b24aae795 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:56.392201 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52542925-d8ab-473a-86bf-0a0b24aae795 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:56.392642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52542925-d8ab-473a-86bf-0a0b24aae795 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:56.393966 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52542925-d8ab-473a-86bf-0a0b24aae795 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:56.394430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52542925-d8ab-473a-86bf-0a0b24aae795 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:56.394861 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52542925-d8ab-473a-86bf-0a0b24aae795 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:56.533261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-52542925-d8ab-473a-86bf-0a0b24aae795 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:56.542122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-52542925-d8ab-473a-86bf-0a0b24aae795 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:56.543568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-52542925-d8ab-473a-86bf-0a0b24aae795 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:56.544739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-52542925-d8ab-473a-86bf-0a0b24aae795 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.164000 Oct 28 20:13:56.545301 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 668/1328] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:56 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:56.721037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b1ee62e1-6207-4f85-a63f-12c0981625b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:56.722284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b1ee62e1-6207-4f85-a63f-12c0981625b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:56.728158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1ee62e1-6207-4f85-a63f-12c0981625b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:56.728636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1ee62e1-6207-4f85-a63f-12c0981625b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:56.729069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1ee62e1-6207-4f85-a63f-12c0981625b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:56.729796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1ee62e1-6207-4f85-a63f-12c0981625b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:56.730247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1ee62e1-6207-4f85-a63f-12c0981625b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:56.730669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1ee62e1-6207-4f85-a63f-12c0981625b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:56.793010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b1ee62e1-6207-4f85-a63f-12c0981625b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:56.800796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b1ee62e1-6207-4f85-a63f-12c0981625b8 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.083615 Oct 28 20:13:56.801367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 661/1329] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:56 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:56.826671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3cead0aa-c7d5-48fa-b363-29b7c524a62a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:56.828804 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3cead0aa-c7d5-48fa-b363-29b7c524a62a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:56.835484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cead0aa-c7d5-48fa-b363-29b7c524a62a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:56.835956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cead0aa-c7d5-48fa-b363-29b7c524a62a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:56.836380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cead0aa-c7d5-48fa-b363-29b7c524a62a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:56.837053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cead0aa-c7d5-48fa-b363-29b7c524a62a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:56.837542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cead0aa-c7d5-48fa-b363-29b7c524a62a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:56.837946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cead0aa-c7d5-48fa-b363-29b7c524a62a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:56.866363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3cead0aa-c7d5-48fa-b363-29b7c524a62a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043526 Oct 28 20:13:56.866903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 669/1330] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:56 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:57.570214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1ca800da-0a0f-4a09-ba72-e67cd7a4f611 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:57.570855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1ca800da-0a0f-4a09-ba72-e67cd7a4f611 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:57.576887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ca800da-0a0f-4a09-ba72-e67cd7a4f611 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:57.577403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ca800da-0a0f-4a09-ba72-e67cd7a4f611 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:57.577839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ca800da-0a0f-4a09-ba72-e67cd7a4f611 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:57.578527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ca800da-0a0f-4a09-ba72-e67cd7a4f611 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:57.578979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ca800da-0a0f-4a09-ba72-e67cd7a4f611 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:57.579408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ca800da-0a0f-4a09-ba72-e67cd7a4f611 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:57.713099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1ca800da-0a0f-4a09-ba72-e67cd7a4f611 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:57.722157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1ca800da-0a0f-4a09-ba72-e67cd7a4f611 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:57.723601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1ca800da-0a0f-4a09-ba72-e67cd7a4f611 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:57.724748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1ca800da-0a0f-4a09-ba72-e67cd7a4f611 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.158433 Oct 28 20:13:57.725301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 662/1331] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:57 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:13:57.823616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-059cffb2-2011-474a-802c-4fc90ce6b28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:57.824163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-059cffb2-2011-474a-802c-4fc90ce6b28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:57.830491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-059cffb2-2011-474a-802c-4fc90ce6b28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:57.831171 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-059cffb2-2011-474a-802c-4fc90ce6b28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:57.831738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-059cffb2-2011-474a-802c-4fc90ce6b28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:57.832436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-059cffb2-2011-474a-802c-4fc90ce6b28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:57.832893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-059cffb2-2011-474a-802c-4fc90ce6b28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:57.833349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-059cffb2-2011-474a-802c-4fc90ce6b28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:57.878762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-067df70a-9396-456f-ae21-7a1d1b41fcd0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:57.881141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-067df70a-9396-456f-ae21-7a1d1b41fcd0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:57.887487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-067df70a-9396-456f-ae21-7a1d1b41fcd0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:57.887954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-067df70a-9396-456f-ae21-7a1d1b41fcd0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:57.888393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-067df70a-9396-456f-ae21-7a1d1b41fcd0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:57.889084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-067df70a-9396-456f-ae21-7a1d1b41fcd0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:57.889595 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-067df70a-9396-456f-ae21-7a1d1b41fcd0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:57.890019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-067df70a-9396-456f-ae21-7a1d1b41fcd0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:57.894337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-059cffb2-2011-474a-802c-4fc90ce6b28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:57.901974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-059cffb2-2011-474a-802c-4fc90ce6b28a tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082439 Oct 28 20:13:57.902582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 670/1332] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:57 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:13:57.920030 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-067df70a-9396-456f-ae21-7a1d1b41fcd0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045340 Oct 28 20:13:57.920577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 663/1333] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:57 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:13:58.750363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eb8205b0-d914-4227-9e40-bfb7a88aff46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:58.750981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eb8205b0-d914-4227-9e40-bfb7a88aff46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:58.757498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb8205b0-d914-4227-9e40-bfb7a88aff46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:58.757990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb8205b0-d914-4227-9e40-bfb7a88aff46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:58.758432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb8205b0-d914-4227-9e40-bfb7a88aff46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:58.759122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb8205b0-d914-4227-9e40-bfb7a88aff46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:58.759577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb8205b0-d914-4227-9e40-bfb7a88aff46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:58.760000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb8205b0-d914-4227-9e40-bfb7a88aff46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:58.886628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-eb8205b0-d914-4227-9e40-bfb7a88aff46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:58.895216 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-eb8205b0-d914-4227-9e40-bfb7a88aff46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:58.896649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-eb8205b0-d914-4227-9e40-bfb7a88aff46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:58.897830 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eb8205b0-d914-4227-9e40-bfb7a88aff46 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.151397 Oct 28 20:13:58.898385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 671/1334] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:58 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:13:58.925798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d5eb5f63-99a1-495a-bb5b-ed50dbc82685 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:58.926414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d5eb5f63-99a1-495a-bb5b-ed50dbc82685 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:58.931710 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-146164d6-31c9-4440-9332-c4d0cb3bd697 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:58.933851 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5eb5f63-99a1-495a-bb5b-ed50dbc82685 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:58.934001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-146164d6-31c9-4440-9332-c4d0cb3bd697 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:58.934333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5eb5f63-99a1-495a-bb5b-ed50dbc82685 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:58.934766 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5eb5f63-99a1-495a-bb5b-ed50dbc82685 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:58.935459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5eb5f63-99a1-495a-bb5b-ed50dbc82685 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:58.935907 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5eb5f63-99a1-495a-bb5b-ed50dbc82685 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:58.936338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5eb5f63-99a1-495a-bb5b-ed50dbc82685 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:58.939613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146164d6-31c9-4440-9332-c4d0cb3bd697 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:58.941307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146164d6-31c9-4440-9332-c4d0cb3bd697 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:58.941790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146164d6-31c9-4440-9332-c4d0cb3bd697 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:58.942497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146164d6-31c9-4440-9332-c4d0cb3bd697 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:58.942954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146164d6-31c9-4440-9332-c4d0cb3bd697 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:58.943385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146164d6-31c9-4440-9332-c4d0cb3bd697 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:58.973935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-146164d6-31c9-4440-9332-c4d0cb3bd697 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045966 Oct 28 20:13:58.974503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 672/1335] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:58 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:13:58.997777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d5eb5f63-99a1-495a-bb5b-ed50dbc82685 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:59.006151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d5eb5f63-99a1-495a-bb5b-ed50dbc82685 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084648 Oct 28 20:13:59.006712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 664/1336] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:58 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:59.922799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c8c7cc83-adad-42f7-bd06-1ba185a95e9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:59.923375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c8c7cc83-adad-42f7-bd06-1ba185a95e9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:59.925474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:13:59.925627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:13:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 (ip 10.222.0.66) !!! Oct 28 20:13:59.932230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8c7cc83-adad-42f7-bd06-1ba185a95e9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:59.932715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8c7cc83-adad-42f7-bd06-1ba185a95e9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:59.933157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8c7cc83-adad-42f7-bd06-1ba185a95e9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:59.933881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8c7cc83-adad-42f7-bd06-1ba185a95e9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:59.934341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8c7cc83-adad-42f7-bd06-1ba185a95e9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:59.934770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8c7cc83-adad-42f7-bd06-1ba185a95e9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:59.986720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-030b729d-1f15-4e88-bedf-260b6a70959e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:59.989163 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-030b729d-1f15-4e88-bedf-260b6a70959e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:59.995299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-030b729d-1f15-4e88-bedf-260b6a70959e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:59.995784 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-030b729d-1f15-4e88-bedf-260b6a70959e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:59.996218 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-030b729d-1f15-4e88-bedf-260b6a70959e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:59.996905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-030b729d-1f15-4e88-bedf-260b6a70959e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:59.997382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-030b729d-1f15-4e88-bedf-260b6a70959e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:59.998091 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-030b729d-1f15-4e88-bedf-260b6a70959e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:00.030073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-030b729d-1f15-4e88-bedf-260b6a70959e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047317 Oct 28 20:14:00.033541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 665/1337] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:13:59 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:14:00.035830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-23fa021f-d53c-4621-910f-18fa9a357e5b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:00.036440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-23fa021f-d53c-4621-910f-18fa9a357e5b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:00.042149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23fa021f-d53c-4621-910f-18fa9a357e5b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:00.042632 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23fa021f-d53c-4621-910f-18fa9a357e5b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:00.043069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23fa021f-d53c-4621-910f-18fa9a357e5b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:00.043763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23fa021f-d53c-4621-910f-18fa9a357e5b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:00.044212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23fa021f-d53c-4621-910f-18fa9a357e5b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:00.044642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23fa021f-d53c-4621-910f-18fa9a357e5b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:00.069161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c8c7cc83-adad-42f7-bd06-1ba185a95e9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:00.077787 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c8c7cc83-adad-42f7-bd06-1ba185a95e9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:00.079239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c8c7cc83-adad-42f7-bd06-1ba185a95e9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:00.081269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c8c7cc83-adad-42f7-bd06-1ba185a95e9d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.161601 Oct 28 20:14:00.082201 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 673/1338] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:13:59 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:00.107834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-23fa021f-d53c-4621-910f-18fa9a357e5b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:00.115301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-23fa021f-d53c-4621-910f-18fa9a357e5b tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.083247 Oct 28 20:14:00.115850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 666/1339] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:00 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:01.042840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-696649ae-04df-40e4-99ca-f9c41e307fb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:01.045061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-696649ae-04df-40e4-99ca-f9c41e307fb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:01.051803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-696649ae-04df-40e4-99ca-f9c41e307fb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:01.052283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-696649ae-04df-40e4-99ca-f9c41e307fb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:01.052727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-696649ae-04df-40e4-99ca-f9c41e307fb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:01.053451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-696649ae-04df-40e4-99ca-f9c41e307fb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:01.053915 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-696649ae-04df-40e4-99ca-f9c41e307fb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:01.054338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-696649ae-04df-40e4-99ca-f9c41e307fb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:01.083312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-696649ae-04df-40e4-99ca-f9c41e307fb5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044427 Oct 28 20:14:01.084120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 674/1340] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:01 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:01.108005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b1b7f97b-e2e6-4afa-9262-a0164bfbc568 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:01.108655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b1b7f97b-e2e6-4afa-9262-a0164bfbc568 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:01.115302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1b7f97b-e2e6-4afa-9262-a0164bfbc568 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:01.115784 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1b7f97b-e2e6-4afa-9262-a0164bfbc568 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:01.116226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1b7f97b-e2e6-4afa-9262-a0164bfbc568 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:01.116918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1b7f97b-e2e6-4afa-9262-a0164bfbc568 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:01.117470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1b7f97b-e2e6-4afa-9262-a0164bfbc568 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:01.117903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1b7f97b-e2e6-4afa-9262-a0164bfbc568 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:01.137926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d9c2071-5e86-4927-bcfd-70ccfd3909ce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:01.138545 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4d9c2071-5e86-4927-bcfd-70ccfd3909ce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:01.145647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d9c2071-5e86-4927-bcfd-70ccfd3909ce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:01.146139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d9c2071-5e86-4927-bcfd-70ccfd3909ce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:01.146579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d9c2071-5e86-4927-bcfd-70ccfd3909ce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:01.147277 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d9c2071-5e86-4927-bcfd-70ccfd3909ce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:01.147736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d9c2071-5e86-4927-bcfd-70ccfd3909ce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:01.148161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d9c2071-5e86-4927-bcfd-70ccfd3909ce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:01.152388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:01.230661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d9c2071-5e86-4927-bcfd-70ccfd3909ce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:01.238680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4d9c2071-5e86-4927-bcfd-70ccfd3909ce tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.104441 Oct 28 20:14:01.239254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 675/1341] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:01 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:14:01.270937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b1b7f97b-e2e6-4afa-9262-a0164bfbc568 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:01.276220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b1b7f97b-e2e6-4afa-9262-a0164bfbc568 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:01.277696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b1b7f97b-e2e6-4afa-9262-a0164bfbc568 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:01.278844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b1b7f97b-e2e6-4afa-9262-a0164bfbc568 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.174825 Oct 28 20:14:01.279397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 667/1342] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:01 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:02.095828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3eb03ac7-244f-4ef1-9439-629b1c939fdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:02.098783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3eb03ac7-244f-4ef1-9439-629b1c939fdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:02.105147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3eb03ac7-244f-4ef1-9439-629b1c939fdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:02.105657 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3eb03ac7-244f-4ef1-9439-629b1c939fdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:02.106089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3eb03ac7-244f-4ef1-9439-629b1c939fdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:02.106768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3eb03ac7-244f-4ef1-9439-629b1c939fdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:02.107214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3eb03ac7-244f-4ef1-9439-629b1c939fdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:02.107638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3eb03ac7-244f-4ef1-9439-629b1c939fdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:02.136769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3eb03ac7-244f-4ef1-9439-629b1c939fdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044845 Oct 28 20:14:02.137332 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 676/1343] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:02 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:02.260948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3fe1b6cc-79d2-4a93-94d1-edc65b50691f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:02.261622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3fe1b6cc-79d2-4a93-94d1-edc65b50691f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:02.268197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fe1b6cc-79d2-4a93-94d1-edc65b50691f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:02.268686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fe1b6cc-79d2-4a93-94d1-edc65b50691f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:02.269129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fe1b6cc-79d2-4a93-94d1-edc65b50691f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:02.269856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fe1b6cc-79d2-4a93-94d1-edc65b50691f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:02.270314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fe1b6cc-79d2-4a93-94d1-edc65b50691f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:02.270741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fe1b6cc-79d2-4a93-94d1-edc65b50691f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:02.305051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ffcbd051-0288-4ef5-94d2-67ef3d95bf1f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:02.305792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ffcbd051-0288-4ef5-94d2-67ef3d95bf1f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:02.311764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffcbd051-0288-4ef5-94d2-67ef3d95bf1f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:02.312252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffcbd051-0288-4ef5-94d2-67ef3d95bf1f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:02.312687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffcbd051-0288-4ef5-94d2-67ef3d95bf1f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:02.313405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffcbd051-0288-4ef5-94d2-67ef3d95bf1f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:02.313856 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffcbd051-0288-4ef5-94d2-67ef3d95bf1f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:02.314272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffcbd051-0288-4ef5-94d2-67ef3d95bf1f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:02.331795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3fe1b6cc-79d2-4a93-94d1-edc65b50691f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:02.339917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3fe1b6cc-79d2-4a93-94d1-edc65b50691f tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082952 Oct 28 20:14:02.340809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 668/1344] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:02 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:02.444339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ffcbd051-0288-4ef5-94d2-67ef3d95bf1f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:02.452825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ffcbd051-0288-4ef5-94d2-67ef3d95bf1f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:02.454289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ffcbd051-0288-4ef5-94d2-67ef3d95bf1f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:02.455999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ffcbd051-0288-4ef5-94d2-67ef3d95bf1f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.154271 Oct 28 20:14:02.456541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 677/1345] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:02 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:14:03.149101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a63dd4fd-a37a-43ca-a471-1631c554bd0c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:03.151273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a63dd4fd-a37a-43ca-a471-1631c554bd0c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:03.157171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a63dd4fd-a37a-43ca-a471-1631c554bd0c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:03.157692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a63dd4fd-a37a-43ca-a471-1631c554bd0c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:03.158128 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a63dd4fd-a37a-43ca-a471-1631c554bd0c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:03.158816 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a63dd4fd-a37a-43ca-a471-1631c554bd0c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:03.159267 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a63dd4fd-a37a-43ca-a471-1631c554bd0c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:03.159691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a63dd4fd-a37a-43ca-a471-1631c554bd0c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:03.190437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a63dd4fd-a37a-43ca-a471-1631c554bd0c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045349 Oct 28 20:14:03.190986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 669/1346] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:03 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:14:03.362934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-63f55b54-4199-4600-ba40-c3a5943b47dc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:03.363583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-63f55b54-4199-4600-ba40-c3a5943b47dc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:03.370828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63f55b54-4199-4600-ba40-c3a5943b47dc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:03.371315 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63f55b54-4199-4600-ba40-c3a5943b47dc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:03.371790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63f55b54-4199-4600-ba40-c3a5943b47dc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:03.372500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63f55b54-4199-4600-ba40-c3a5943b47dc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:03.372941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63f55b54-4199-4600-ba40-c3a5943b47dc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:03.373389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63f55b54-4199-4600-ba40-c3a5943b47dc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:03.435441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-63f55b54-4199-4600-ba40-c3a5943b47dc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:03.443819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-63f55b54-4199-4600-ba40-c3a5943b47dc tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084104 Oct 28 20:14:03.444394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 678/1347] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:03 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:03.483066 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a532c071-2aed-4ef7-902a-01184ea8db2e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:03.483681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a532c071-2aed-4ef7-902a-01184ea8db2e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:03.491427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a532c071-2aed-4ef7-902a-01184ea8db2e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:03.491934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a532c071-2aed-4ef7-902a-01184ea8db2e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:03.497413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a532c071-2aed-4ef7-902a-01184ea8db2e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:03.497413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a532c071-2aed-4ef7-902a-01184ea8db2e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:03.497413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a532c071-2aed-4ef7-902a-01184ea8db2e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:03.497413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a532c071-2aed-4ef7-902a-01184ea8db2e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:03.624713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a532c071-2aed-4ef7-902a-01184ea8db2e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:03.633209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a532c071-2aed-4ef7-902a-01184ea8db2e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:03.634677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a532c071-2aed-4ef7-902a-01184ea8db2e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:03.635830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a532c071-2aed-4ef7-902a-01184ea8db2e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.156754 Oct 28 20:14:03.636404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 670/1348] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:03 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:04.046752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a857f84c-2595-452a-94d2-c9d341f47853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:04.047240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a857f84c-2595-452a-94d2-c9d341f47853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:04.053841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a857f84c-2595-452a-94d2-c9d341f47853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:04.054317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a857f84c-2595-452a-94d2-c9d341f47853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:04.054752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a857f84c-2595-452a-94d2-c9d341f47853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:04.055434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a857f84c-2595-452a-94d2-c9d341f47853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:04.055879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a857f84c-2595-452a-94d2-c9d341f47853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:04.056295 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a857f84c-2595-452a-94d2-c9d341f47853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:04.166345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-a857f84c-2595-452a-94d2-c9d341f47853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lazy-loading 'services' on Instance uuid 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:14:04.204046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84299e08-a0e8-40df-b43e-4733ad38d48d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:04.206288 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-84299e08-a0e8-40df-b43e-4733ad38d48d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:04.213468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84299e08-a0e8-40df-b43e-4733ad38d48d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:04.213956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84299e08-a0e8-40df-b43e-4733ad38d48d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:04.214398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84299e08-a0e8-40df-b43e-4733ad38d48d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:04.215091 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84299e08-a0e8-40df-b43e-4733ad38d48d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:04.215551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84299e08-a0e8-40df-b43e-4733ad38d48d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:04.215977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84299e08-a0e8-40df-b43e-4733ad38d48d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:04.246121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-84299e08-a0e8-40df-b43e-4733ad38d48d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046021 Oct 28 20:14:04.246681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 671/1349] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:04 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:14:04.351813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a857f84c-2595-452a-94d2-c9d341f47853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a/os-volume_attachments/7fae26e0-f88b-4257-9f43-19df24a827e4" status: 202 len: 0 microversion: 2.1 time: 0.308741 Oct 28 20:14:04.352414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 679/1350] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Oct 28 20:14:04 2022] DELETE /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a/os-volume_attachments/7fae26e0-f88b-4257-9f43-19df24a827e4 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:14:04.467170 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b98cedf8-0f04-4312-a58a-a022903cdc46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:04.467781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b98cedf8-0f04-4312-a58a-a022903cdc46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:04.473783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98cedf8-0f04-4312-a58a-a022903cdc46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:04.474428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98cedf8-0f04-4312-a58a-a022903cdc46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:04.475055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98cedf8-0f04-4312-a58a-a022903cdc46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:04.475768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98cedf8-0f04-4312-a58a-a022903cdc46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:04.476236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98cedf8-0f04-4312-a58a-a022903cdc46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:04.476647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98cedf8-0f04-4312-a58a-a022903cdc46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:04.539616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b98cedf8-0f04-4312-a58a-a022903cdc46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:04.547207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b98cedf8-0f04-4312-a58a-a022903cdc46 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.084186 Oct 28 20:14:04.547767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 672/1351] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:04 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:04.662174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82ab042f-eaf9-4c45-b5d8-7eda3dd19508 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:04.662872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-82ab042f-eaf9-4c45-b5d8-7eda3dd19508 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:04.669064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82ab042f-eaf9-4c45-b5d8-7eda3dd19508 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:04.675236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82ab042f-eaf9-4c45-b5d8-7eda3dd19508 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:04.675236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82ab042f-eaf9-4c45-b5d8-7eda3dd19508 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:04.675236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82ab042f-eaf9-4c45-b5d8-7eda3dd19508 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:04.675236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82ab042f-eaf9-4c45-b5d8-7eda3dd19508 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:04.675605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82ab042f-eaf9-4c45-b5d8-7eda3dd19508 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:04.799127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-82ab042f-eaf9-4c45-b5d8-7eda3dd19508 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:04.808253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-82ab042f-eaf9-4c45-b5d8-7eda3dd19508 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:04.809716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-82ab042f-eaf9-4c45-b5d8-7eda3dd19508 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:04.810873 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-82ab042f-eaf9-4c45-b5d8-7eda3dd19508 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.153557 Oct 28 20:14:04.811428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 680/1352] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:04 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:05.258037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b430f449-cd68-4f97-8a36-4ea5388530b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:05.260189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b430f449-cd68-4f97-8a36-4ea5388530b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:05.266167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b430f449-cd68-4f97-8a36-4ea5388530b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:05.266690 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b430f449-cd68-4f97-8a36-4ea5388530b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:05.267149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b430f449-cd68-4f97-8a36-4ea5388530b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:05.267812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b430f449-cd68-4f97-8a36-4ea5388530b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:05.268265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b430f449-cd68-4f97-8a36-4ea5388530b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:05.268687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b430f449-cd68-4f97-8a36-4ea5388530b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:05.297556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b430f449-cd68-4f97-8a36-4ea5388530b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043762 Oct 28 20:14:05.298021 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 673/1353] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:05 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:05.570067 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-337dbdbf-c182-4c57-86c4-c6a13736bccf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:05.570650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-337dbdbf-c182-4c57-86c4-c6a13736bccf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:05.576657 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-337dbdbf-c182-4c57-86c4-c6a13736bccf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:05.577131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-337dbdbf-c182-4c57-86c4-c6a13736bccf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:05.577588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-337dbdbf-c182-4c57-86c4-c6a13736bccf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:05.578272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-337dbdbf-c182-4c57-86c4-c6a13736bccf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:05.578720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-337dbdbf-c182-4c57-86c4-c6a13736bccf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:05.579134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-337dbdbf-c182-4c57-86c4-c6a13736bccf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:05.640312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-337dbdbf-c182-4c57-86c4-c6a13736bccf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c784f29d2e4cb4bb8bd6d62fbc2216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac1485ccdeb434ca49caa52ebfdc24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:05.648399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-337dbdbf-c182-4c57-86c4-c6a13736bccf tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 200 len: 1152 microversion: 2.1 time: 0.082760 Oct 28 20:14:05.648962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 681/1354] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:05 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 1152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:05.670490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:05.671001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:05.677537 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:05.677927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:05.678363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:05.679052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:05.679510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:05.679935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:05.704144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:14:05.713980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:05.714461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:05.714898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:05.740460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:05.760012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lazy-loading 'flavor' on Instance uuid e001ad32-8419-44e8-a8dd-a05eb16202b4 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:14:05.771912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lazy-loading 'system_metadata' on Instance uuid e001ad32-8419-44e8-a8dd-a05eb16202b4 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:14:05.823004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lazy-loading 'metadata' on Instance uuid e001ad32-8419-44e8-a8dd-a05eb16202b4 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:14:05.836824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e569bed8-22e2-4e9b-9937-924c9885c55b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:05.837476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e569bed8-22e2-4e9b-9937-924c9885c55b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:05.843828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e569bed8-22e2-4e9b-9937-924c9885c55b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:05.844304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e569bed8-22e2-4e9b-9937-924c9885c55b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:05.844748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e569bed8-22e2-4e9b-9937-924c9885c55b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:05.845460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e569bed8-22e2-4e9b-9937-924c9885c55b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:05.845914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e569bed8-22e2-4e9b-9937-924c9885c55b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:05.846338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e569bed8-22e2-4e9b-9937-924c9885c55b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:05.977082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e569bed8-22e2-4e9b-9937-924c9885c55b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:05.985654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e569bed8-22e2-4e9b-9937-924c9885c55b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:05.987143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e569bed8-22e2-4e9b-9937-924c9885c55b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:05.988308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e569bed8-22e2-4e9b-9937-924c9885c55b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.156216 Oct 28 20:14:05.989008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 682/1355] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:05 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:14:06.314642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e4b2d237-c2e9-41fc-b467-9279d3e4ed8c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:06.317761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e4b2d237-c2e9-41fc-b467-9279d3e4ed8c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:06.323762 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4b2d237-c2e9-41fc-b467-9279d3e4ed8c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:06.324249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4b2d237-c2e9-41fc-b467-9279d3e4ed8c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:06.324690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4b2d237-c2e9-41fc-b467-9279d3e4ed8c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:06.325425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4b2d237-c2e9-41fc-b467-9279d3e4ed8c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:06.325875 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4b2d237-c2e9-41fc-b467-9279d3e4ed8c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:06.327187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4b2d237-c2e9-41fc-b467-9279d3e4ed8c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:06.359625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e4b2d237-c2e9-41fc-b467-9279d3e4ed8c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048843 Oct 28 20:14:06.360201 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 683/1356] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:06 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:14:06.422148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.scheduler.client.report [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Deleted allocations for instance e001ad32-8419-44e8-a8dd-a05eb16202b4 Oct 28 20:14:06.534510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d5ad8a7b-155a-43d5-87e9-f86ae2a039c5 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 204 len: 0 microversion: 2.1 time: 0.867758 Oct 28 20:14:06.535137 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 674/1357] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:14:05 2022] DELETE /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:14:06.543313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48221381-5ddd-4137-8951-6b81f4337eac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:06.543955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48221381-5ddd-4137-8951-6b81f4337eac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [instance: e001ad32-8419-44e8-a8dd-a05eb16202b4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:06.549995 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48221381-5ddd-4137-8951-6b81f4337eac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:06.550476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48221381-5ddd-4137-8951-6b81f4337eac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:06.550918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48221381-5ddd-4137-8951-6b81f4337eac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:06.551604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48221381-5ddd-4137-8951-6b81f4337eac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:06.552114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48221381-5ddd-4137-8951-6b81f4337eac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:06.552540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48221381-5ddd-4137-8951-6b81f4337eac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:06.565651 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-48221381-5ddd-4137-8951-6b81f4337eac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] HTTP exception thrown: Instance e001ad32-8419-44e8-a8dd-a05eb16202b4 could not be found. Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48221381-5ddd-4137-8951-6b81f4337eac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Request method failure captured: Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 HTTP/1.1 Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDZ-sNZ4xI7L7p8kM9ZQtqADBU4AKDufyc06GWuQC2f0lVWM8xPK_yTQtUhkV92JeGdImvej68yyUj2nuBl203BurlLMU7_zYZGL0ojeI6c3G7vZl-3pFuwjRJNmH5V5Eygptac2SjBCnEedrTm7_XTQ2mQyl6mmXshRQf6HlW6-Yns Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: fac1485ccdeb434ca49caa52ebfdc24b Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-TestVolumeBootPattern-1970423806 Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:14:06.567272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:14:06.570101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fac1485ccdeb434ca49caa52ebfdc24b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fac1485ccdeb434ca49caa52ebfdc24b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fac1485ccdeb434ca49caa52ebfdc24b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fac1485ccdeb434ca49caa52ebfdc24b", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:14:06.570101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-TestVolumeBootPattern-1970423806 Oct 28 20:14:06.570101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: fac1485ccdeb434ca49caa52ebfdc24b Oct 28 20:14:06.570101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1970423806 Oct 28 20:14:06.570101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-TestVolumeBootPattern-1970423806-project Oct 28 20:14:06.570101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:14:06.570101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:14:06.570101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: a5c784f29d2e4cb4bb8bd6d62fbc2216 Oct 28 20:14:06.570101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-TestVolumeBootPattern-1970423806-project Oct 28 20:14:06.570101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:14:06.570101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance e001ad32-8419-44e8-a8dd-a05eb16202b4 could not be found. Oct 28 20:14:06.570101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': 'e001ad32-8419-44e8-a8dd-a05eb16202b4'} Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e001ad32-8419-44e8-a8dd-a05eb16202b4 could not be found. Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:14:06.571028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e001ad32-8419-44e8-a8dd-a05eb16202b4 could not be found. Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e001ad32-8419-44e8-a8dd-a05eb16202b4 could not be found. Oct 28 20:14:06.572580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:14:06.573968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48221381-5ddd-4137-8951-6b81f4337eac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Returning 404 to user: Instance e001ad32-8419-44e8-a8dd-a05eb16202b4 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:14:06.573968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48221381-5ddd-4137-8951-6b81f4337eac tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4" status: 404 len: 111 microversion: 2.1 time: 0.029814 Oct 28 20:14:06.573968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 684/1358] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:06 2022] GET /compute/v2.1/servers/e001ad32-8419-44e8-a8dd-a05eb16202b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:14:07.014130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d00077ba-83f1-4ebf-9041-ab5348164424 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:07.014839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d00077ba-83f1-4ebf-9041-ab5348164424 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:07.021504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d00077ba-83f1-4ebf-9041-ab5348164424 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:07.022013 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d00077ba-83f1-4ebf-9041-ab5348164424 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:07.022459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d00077ba-83f1-4ebf-9041-ab5348164424 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:07.023163 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d00077ba-83f1-4ebf-9041-ab5348164424 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:07.023613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d00077ba-83f1-4ebf-9041-ab5348164424 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:07.024042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d00077ba-83f1-4ebf-9041-ab5348164424 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:07.151130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d00077ba-83f1-4ebf-9041-ab5348164424 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:07.159548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d00077ba-83f1-4ebf-9041-ab5348164424 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:07.160998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d00077ba-83f1-4ebf-9041-ab5348164424 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:07.162518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d00077ba-83f1-4ebf-9041-ab5348164424 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.152730 Oct 28 20:14:07.163076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 675/1359] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:07 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:07.377041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2281b273-37ff-407c-ae66-8b00a33b9f59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:07.379305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2281b273-37ff-407c-ae66-8b00a33b9f59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:07.381946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:14:07.382095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:14:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments (ip 10.222.0.66) !!! Oct 28 20:14:07.387678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2281b273-37ff-407c-ae66-8b00a33b9f59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:07.388168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2281b273-37ff-407c-ae66-8b00a33b9f59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:07.388605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2281b273-37ff-407c-ae66-8b00a33b9f59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:07.389309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2281b273-37ff-407c-ae66-8b00a33b9f59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:07.389841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2281b273-37ff-407c-ae66-8b00a33b9f59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:07.390269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2281b273-37ff-407c-ae66-8b00a33b9f59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:07.421310 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2281b273-37ff-407c-ae66-8b00a33b9f59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048199 Oct 28 20:14:07.421879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 685/1360] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:07 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:08.187975 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ff7b05a9-362d-4ebd-b577-77c0fa5df7b8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:08.188588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ff7b05a9-362d-4ebd-b577-77c0fa5df7b8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:08.195660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff7b05a9-362d-4ebd-b577-77c0fa5df7b8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:08.196139 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff7b05a9-362d-4ebd-b577-77c0fa5df7b8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:08.196565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff7b05a9-362d-4ebd-b577-77c0fa5df7b8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:08.197244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff7b05a9-362d-4ebd-b577-77c0fa5df7b8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:08.197714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff7b05a9-362d-4ebd-b577-77c0fa5df7b8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:08.198131 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff7b05a9-362d-4ebd-b577-77c0fa5df7b8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:08.333034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ff7b05a9-362d-4ebd-b577-77c0fa5df7b8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:08.342939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ff7b05a9-362d-4ebd-b577-77c0fa5df7b8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:08.344388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ff7b05a9-362d-4ebd-b577-77c0fa5df7b8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:08.345571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ff7b05a9-362d-4ebd-b577-77c0fa5df7b8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.161529 Oct 28 20:14:08.346118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 676/1361] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:08 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:08.433945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c451bc6e-5ace-49f7-a717-f5a74d920180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:08.436111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c451bc6e-5ace-49f7-a717-f5a74d920180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:08.442505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c451bc6e-5ace-49f7-a717-f5a74d920180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:08.443180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c451bc6e-5ace-49f7-a717-f5a74d920180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:08.443492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c451bc6e-5ace-49f7-a717-f5a74d920180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:08.444190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c451bc6e-5ace-49f7-a717-f5a74d920180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:08.444642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c451bc6e-5ace-49f7-a717-f5a74d920180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:08.445069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c451bc6e-5ace-49f7-a717-f5a74d920180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:08.475392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c451bc6e-5ace-49f7-a717-f5a74d920180 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045295 Oct 28 20:14:08.475947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 686/1362] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:08 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:09.371594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-39dfe586-371b-46d2-8d58-0cbe0e7cc0f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:09.372203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-39dfe586-371b-46d2-8d58-0cbe0e7cc0f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:09.378764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39dfe586-371b-46d2-8d58-0cbe0e7cc0f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:09.379240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39dfe586-371b-46d2-8d58-0cbe0e7cc0f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:09.379672 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39dfe586-371b-46d2-8d58-0cbe0e7cc0f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:09.380478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39dfe586-371b-46d2-8d58-0cbe0e7cc0f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:09.380931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39dfe586-371b-46d2-8d58-0cbe0e7cc0f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:09.381418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39dfe586-371b-46d2-8d58-0cbe0e7cc0f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:09.489391 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2eede0bc-c2c0-46af-9a03-4705465c865f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:09.491843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2eede0bc-c2c0-46af-9a03-4705465c865f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:09.498568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eede0bc-c2c0-46af-9a03-4705465c865f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:09.499049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eede0bc-c2c0-46af-9a03-4705465c865f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:09.499487 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eede0bc-c2c0-46af-9a03-4705465c865f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:09.500212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eede0bc-c2c0-46af-9a03-4705465c865f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:09.500828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eede0bc-c2c0-46af-9a03-4705465c865f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:09.501446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2eede0bc-c2c0-46af-9a03-4705465c865f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:09.512540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-39dfe586-371b-46d2-8d58-0cbe0e7cc0f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:09.523356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-39dfe586-371b-46d2-8d58-0cbe0e7cc0f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:09.524842 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-39dfe586-371b-46d2-8d58-0cbe0e7cc0f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:09.526074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-39dfe586-371b-46d2-8d58-0cbe0e7cc0f3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.158300 Oct 28 20:14:09.537230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 677/1363] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:09 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:09.537569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2eede0bc-c2c0-46af-9a03-4705465c865f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049478 Oct 28 20:14:09.537569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 687/1364] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:09 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:10.547995 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a75cfcb-821c-4f22-9e5b-388249c1b86e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:10.550441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9a75cfcb-821c-4f22-9e5b-388249c1b86e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:10.557657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a75cfcb-821c-4f22-9e5b-388249c1b86e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:10.558130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a75cfcb-821c-4f22-9e5b-388249c1b86e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:10.558561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a75cfcb-821c-4f22-9e5b-388249c1b86e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:10.558678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f444cb28-c4c2-471f-992b-16be4cf9bf65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:10.559523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f444cb28-c4c2-471f-992b-16be4cf9bf65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:10.559727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a75cfcb-821c-4f22-9e5b-388249c1b86e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:10.560172 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a75cfcb-821c-4f22-9e5b-388249c1b86e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:10.560593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a75cfcb-821c-4f22-9e5b-388249c1b86e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:10.566299 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f444cb28-c4c2-471f-992b-16be4cf9bf65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:10.566783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f444cb28-c4c2-471f-992b-16be4cf9bf65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:10.567216 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f444cb28-c4c2-471f-992b-16be4cf9bf65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:10.567939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f444cb28-c4c2-471f-992b-16be4cf9bf65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:10.568567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f444cb28-c4c2-471f-992b-16be4cf9bf65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:10.569016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f444cb28-c4c2-471f-992b-16be4cf9bf65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:10.596960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9a75cfcb-821c-4f22-9e5b-388249c1b86e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052723 Oct 28 20:14:10.602586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 678/1365] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:10 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:10.700109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f444cb28-c4c2-471f-992b-16be4cf9bf65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:10.709671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f444cb28-c4c2-471f-992b-16be4cf9bf65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:10.711120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f444cb28-c4c2-471f-992b-16be4cf9bf65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:10.712272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f444cb28-c4c2-471f-992b-16be4cf9bf65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.161847 Oct 28 20:14:10.712924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 688/1366] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:10 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:14:11.609954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-74a691e2-8cae-4fbb-9ba4-c82275535522 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:11.612070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-74a691e2-8cae-4fbb-9ba4-c82275535522 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:11.619141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74a691e2-8cae-4fbb-9ba4-c82275535522 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:11.619620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74a691e2-8cae-4fbb-9ba4-c82275535522 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:11.620049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74a691e2-8cae-4fbb-9ba4-c82275535522 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:11.620800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74a691e2-8cae-4fbb-9ba4-c82275535522 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:11.621258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74a691e2-8cae-4fbb-9ba4-c82275535522 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:11.621713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74a691e2-8cae-4fbb-9ba4-c82275535522 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:11.651840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-74a691e2-8cae-4fbb-9ba4-c82275535522 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045703 Oct 28 20:14:11.652554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 679/1367] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:11 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:11.738395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32b7d158-6775-42ca-91db-c5c2be313be5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:11.738943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-32b7d158-6775-42ca-91db-c5c2be313be5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:11.745790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32b7d158-6775-42ca-91db-c5c2be313be5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:11.746269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32b7d158-6775-42ca-91db-c5c2be313be5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:11.746706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32b7d158-6775-42ca-91db-c5c2be313be5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:11.747396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32b7d158-6775-42ca-91db-c5c2be313be5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:11.747850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32b7d158-6775-42ca-91db-c5c2be313be5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:11.748276 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32b7d158-6775-42ca-91db-c5c2be313be5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:11.877044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-32b7d158-6775-42ca-91db-c5c2be313be5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:11.886061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-32b7d158-6775-42ca-91db-c5c2be313be5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:11.887508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-32b7d158-6775-42ca-91db-c5c2be313be5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:11.888656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-32b7d158-6775-42ca-91db-c5c2be313be5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.154217 Oct 28 20:14:11.889210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 689/1368] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:11 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:14:12.665355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b209420-61a2-4f1f-b1a0-875906ced9ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:12.667512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9b209420-61a2-4f1f-b1a0-875906ced9ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:12.673942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b209420-61a2-4f1f-b1a0-875906ced9ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:12.674406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b209420-61a2-4f1f-b1a0-875906ced9ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:12.674846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b209420-61a2-4f1f-b1a0-875906ced9ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:12.675536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b209420-61a2-4f1f-b1a0-875906ced9ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:12.675991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b209420-61a2-4f1f-b1a0-875906ced9ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:12.676415 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b209420-61a2-4f1f-b1a0-875906ced9ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:12.707535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b209420-61a2-4f1f-b1a0-875906ced9ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047236 Oct 28 20:14:12.708092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 680/1369] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:12 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:12.914603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e421e5f1-b3b1-4677-abaf-2d8fce0e8f6d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:12.915172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e421e5f1-b3b1-4677-abaf-2d8fce0e8f6d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:12.921535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e421e5f1-b3b1-4677-abaf-2d8fce0e8f6d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:12.922016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e421e5f1-b3b1-4677-abaf-2d8fce0e8f6d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:12.922448 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e421e5f1-b3b1-4677-abaf-2d8fce0e8f6d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:12.923135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e421e5f1-b3b1-4677-abaf-2d8fce0e8f6d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:12.923586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e421e5f1-b3b1-4677-abaf-2d8fce0e8f6d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:12.924011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e421e5f1-b3b1-4677-abaf-2d8fce0e8f6d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:13.052055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e421e5f1-b3b1-4677-abaf-2d8fce0e8f6d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:13.060970 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e421e5f1-b3b1-4677-abaf-2d8fce0e8f6d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:13.062435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e421e5f1-b3b1-4677-abaf-2d8fce0e8f6d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:13.063585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e421e5f1-b3b1-4677-abaf-2d8fce0e8f6d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.153189 Oct 28 20:14:13.064140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 690/1370] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:12 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:13.720245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0e2304fa-5a58-4d9f-a8c8-95de15c8cf08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:13.722403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0e2304fa-5a58-4d9f-a8c8-95de15c8cf08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:13.729547 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e2304fa-5a58-4d9f-a8c8-95de15c8cf08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:13.730037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e2304fa-5a58-4d9f-a8c8-95de15c8cf08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:13.730452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e2304fa-5a58-4d9f-a8c8-95de15c8cf08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:13.731135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e2304fa-5a58-4d9f-a8c8-95de15c8cf08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:13.731577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e2304fa-5a58-4d9f-a8c8-95de15c8cf08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:13.731992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e2304fa-5a58-4d9f-a8c8-95de15c8cf08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:13.761157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0e2304fa-5a58-4d9f-a8c8-95de15c8cf08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044928 Oct 28 20:14:13.761744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 681/1371] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:13 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:14.090286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f8cde115-5c92-4224-af79-2e5637ec9f3a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:14.090902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f8cde115-5c92-4224-af79-2e5637ec9f3a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:14.097524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8cde115-5c92-4224-af79-2e5637ec9f3a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:14.098007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8cde115-5c92-4224-af79-2e5637ec9f3a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:14.098447 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8cde115-5c92-4224-af79-2e5637ec9f3a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:14.099165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8cde115-5c92-4224-af79-2e5637ec9f3a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:14.099621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8cde115-5c92-4224-af79-2e5637ec9f3a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:14.100155 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8cde115-5c92-4224-af79-2e5637ec9f3a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:14.230974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f8cde115-5c92-4224-af79-2e5637ec9f3a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:14.234404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:14.239792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f8cde115-5c92-4224-af79-2e5637ec9f3a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:14.242510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f8cde115-5c92-4224-af79-2e5637ec9f3a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:14.250531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f8cde115-5c92-4224-af79-2e5637ec9f3a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.157346 Oct 28 20:14:14.250531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 691/1372] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:14 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:14.774182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d562dd60-df08-49ed-b669-78ff4f247394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:14.776339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d562dd60-df08-49ed-b669-78ff4f247394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:14.783038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d562dd60-df08-49ed-b669-78ff4f247394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:14.783527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d562dd60-df08-49ed-b669-78ff4f247394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:14.783966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d562dd60-df08-49ed-b669-78ff4f247394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:14.784666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d562dd60-df08-49ed-b669-78ff4f247394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:14.785121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d562dd60-df08-49ed-b669-78ff4f247394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:14.785698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d562dd60-df08-49ed-b669-78ff4f247394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:14.815367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d562dd60-df08-49ed-b669-78ff4f247394 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045900 Oct 28 20:14:14.816056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 682/1373] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:14 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:15.274889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cd09c874-79b4-4fde-94f4-9cceba852f95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:15.275538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cd09c874-79b4-4fde-94f4-9cceba852f95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:15.282737 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd09c874-79b4-4fde-94f4-9cceba852f95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:15.283160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd09c874-79b4-4fde-94f4-9cceba852f95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:15.283598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd09c874-79b4-4fde-94f4-9cceba852f95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:15.284290 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd09c874-79b4-4fde-94f4-9cceba852f95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:15.284856 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd09c874-79b4-4fde-94f4-9cceba852f95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:15.285279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd09c874-79b4-4fde-94f4-9cceba852f95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:15.415420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cd09c874-79b4-4fde-94f4-9cceba852f95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:15.425717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cd09c874-79b4-4fde-94f4-9cceba852f95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:15.427183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cd09c874-79b4-4fde-94f4-9cceba852f95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:15.428772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cd09c874-79b4-4fde-94f4-9cceba852f95 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.157851 Oct 28 20:14:15.429615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 692/1374] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:15 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:15.828437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f6ca7b66-6bf6-47f0-975e-ef0887be111e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:15.830592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f6ca7b66-6bf6-47f0-975e-ef0887be111e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:15.837994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6ca7b66-6bf6-47f0-975e-ef0887be111e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:15.838429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6ca7b66-6bf6-47f0-975e-ef0887be111e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:15.838860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6ca7b66-6bf6-47f0-975e-ef0887be111e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:15.839564 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6ca7b66-6bf6-47f0-975e-ef0887be111e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:15.840014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6ca7b66-6bf6-47f0-975e-ef0887be111e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:15.840440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6ca7b66-6bf6-47f0-975e-ef0887be111e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:15.869965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f6ca7b66-6bf6-47f0-975e-ef0887be111e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045506 Oct 28 20:14:15.870601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 683/1375] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:15 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:16.455679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dd777bb9-d3a7-4d2c-a5ca-a47820697781 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:16.457002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dd777bb9-d3a7-4d2c-a5ca-a47820697781 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:16.463944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd777bb9-d3a7-4d2c-a5ca-a47820697781 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:16.464771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd777bb9-d3a7-4d2c-a5ca-a47820697781 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:16.465443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd777bb9-d3a7-4d2c-a5ca-a47820697781 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:16.466179 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd777bb9-d3a7-4d2c-a5ca-a47820697781 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:16.466639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd777bb9-d3a7-4d2c-a5ca-a47820697781 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:16.467069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd777bb9-d3a7-4d2c-a5ca-a47820697781 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:16.618368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd777bb9-d3a7-4d2c-a5ca-a47820697781 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:16.626992 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd777bb9-d3a7-4d2c-a5ca-a47820697781 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:16.628427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd777bb9-d3a7-4d2c-a5ca-a47820697781 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:16.629612 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dd777bb9-d3a7-4d2c-a5ca-a47820697781 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.178186 Oct 28 20:14:16.630166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 693/1376] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:16 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:16.881940 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-57d015fb-6db3-4f1b-acbc-99bfd1ef38a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:16.884110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-57d015fb-6db3-4f1b-acbc-99bfd1ef38a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:16.890639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57d015fb-6db3-4f1b-acbc-99bfd1ef38a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:16.891104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57d015fb-6db3-4f1b-acbc-99bfd1ef38a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:16.891546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57d015fb-6db3-4f1b-acbc-99bfd1ef38a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:16.892345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57d015fb-6db3-4f1b-acbc-99bfd1ef38a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:16.892680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57d015fb-6db3-4f1b-acbc-99bfd1ef38a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:16.893102 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57d015fb-6db3-4f1b-acbc-99bfd1ef38a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:16.924191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-57d015fb-6db3-4f1b-acbc-99bfd1ef38a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046172 Oct 28 20:14:16.924747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 684/1377] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:16 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:17.655191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2de7f84f-12f0-4772-b1e4-5ea97b9cb0f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:17.655740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2de7f84f-12f0-4772-b1e4-5ea97b9cb0f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:17.662190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de7f84f-12f0-4772-b1e4-5ea97b9cb0f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:17.663538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de7f84f-12f0-4772-b1e4-5ea97b9cb0f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:17.664089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de7f84f-12f0-4772-b1e4-5ea97b9cb0f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:17.664782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de7f84f-12f0-4772-b1e4-5ea97b9cb0f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:17.665236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de7f84f-12f0-4772-b1e4-5ea97b9cb0f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:17.665690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de7f84f-12f0-4772-b1e4-5ea97b9cb0f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:17.791920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2de7f84f-12f0-4772-b1e4-5ea97b9cb0f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:17.800481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2de7f84f-12f0-4772-b1e4-5ea97b9cb0f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:17.801939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2de7f84f-12f0-4772-b1e4-5ea97b9cb0f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:17.803179 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2de7f84f-12f0-4772-b1e4-5ea97b9cb0f9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.151841 Oct 28 20:14:17.804080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 694/1378] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:17 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:17.937546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bc070ef9-b8a4-453e-9a44-dd9c49f1a9b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:17.940254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bc070ef9-b8a4-453e-9a44-dd9c49f1a9b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:17.947249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc070ef9-b8a4-453e-9a44-dd9c49f1a9b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:17.948060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc070ef9-b8a4-453e-9a44-dd9c49f1a9b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:17.948981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc070ef9-b8a4-453e-9a44-dd9c49f1a9b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:17.949922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc070ef9-b8a4-453e-9a44-dd9c49f1a9b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:17.950681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc070ef9-b8a4-453e-9a44-dd9c49f1a9b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:17.951327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc070ef9-b8a4-453e-9a44-dd9c49f1a9b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:17.986161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bc070ef9-b8a4-453e-9a44-dd9c49f1a9b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052589 Oct 28 20:14:17.986961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 685/1379] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:17 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:18.829338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48ee10cd-8287-4148-8bd6-77d0c6201026 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:18.829957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48ee10cd-8287-4148-8bd6-77d0c6201026 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:18.837051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48ee10cd-8287-4148-8bd6-77d0c6201026 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:18.837549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48ee10cd-8287-4148-8bd6-77d0c6201026 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:18.837980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48ee10cd-8287-4148-8bd6-77d0c6201026 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:18.838659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48ee10cd-8287-4148-8bd6-77d0c6201026 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:18.839104 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48ee10cd-8287-4148-8bd6-77d0c6201026 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:18.839518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48ee10cd-8287-4148-8bd6-77d0c6201026 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:18.966914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-48ee10cd-8287-4148-8bd6-77d0c6201026 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:18.976094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-48ee10cd-8287-4148-8bd6-77d0c6201026 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:18.977576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-48ee10cd-8287-4148-8bd6-77d0c6201026 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:18.978726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48ee10cd-8287-4148-8bd6-77d0c6201026 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.153351 Oct 28 20:14:18.979281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 695/1380] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:18 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:18.998338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-94bd3d5e-6682-40dc-be37-ea2172ecfb3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:19.000461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-94bd3d5e-6682-40dc-be37-ea2172ecfb3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:19.007042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94bd3d5e-6682-40dc-be37-ea2172ecfb3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:19.007529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94bd3d5e-6682-40dc-be37-ea2172ecfb3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:19.007971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94bd3d5e-6682-40dc-be37-ea2172ecfb3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:19.008664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94bd3d5e-6682-40dc-be37-ea2172ecfb3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:19.009121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94bd3d5e-6682-40dc-be37-ea2172ecfb3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:19.010662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94bd3d5e-6682-40dc-be37-ea2172ecfb3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:19.042078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-94bd3d5e-6682-40dc-be37-ea2172ecfb3c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047705 Oct 28 20:14:19.042655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 686/1381] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:18 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:20.003947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee0a39b1-bd1e-45d9-b76d-5f6d7ce5515e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:20.004504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee0a39b1-bd1e-45d9-b76d-5f6d7ce5515e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:20.007040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=76 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:20.011684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee0a39b1-bd1e-45d9-b76d-5f6d7ce5515e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:20.012171 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee0a39b1-bd1e-45d9-b76d-5f6d7ce5515e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:20.012611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee0a39b1-bd1e-45d9-b76d-5f6d7ce5515e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:20.013309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee0a39b1-bd1e-45d9-b76d-5f6d7ce5515e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:20.013792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee0a39b1-bd1e-45d9-b76d-5f6d7ce5515e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:20.019295 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee0a39b1-bd1e-45d9-b76d-5f6d7ce5515e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:20.054232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a3e66226-ffe0-4201-a391-08734afc4f12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:20.056360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a3e66226-ffe0-4201-a391-08734afc4f12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:20.062711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3e66226-ffe0-4201-a391-08734afc4f12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:20.063194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3e66226-ffe0-4201-a391-08734afc4f12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:20.063623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3e66226-ffe0-4201-a391-08734afc4f12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:20.064316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3e66226-ffe0-4201-a391-08734afc4f12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:20.064768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3e66226-ffe0-4201-a391-08734afc4f12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:20.065191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3e66226-ffe0-4201-a391-08734afc4f12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:20.069192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:20.099274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a3e66226-ffe0-4201-a391-08734afc4f12 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048838 Oct 28 20:14:20.099601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 687/1382] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:20 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:14:20.149654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee0a39b1-bd1e-45d9-b76d-5f6d7ce5515e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:20.158079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee0a39b1-bd1e-45d9-b76d-5f6d7ce5515e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:20.159514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee0a39b1-bd1e-45d9-b76d-5f6d7ce5515e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:20.160668 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee0a39b1-bd1e-45d9-b76d-5f6d7ce5515e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.160700 Oct 28 20:14:20.161223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 696/1383] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:19 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:21.113874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e5c434de-9d9d-49c4-9e2e-0c023eade4db tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:21.116750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e5c434de-9d9d-49c4-9e2e-0c023eade4db tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:21.123686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5c434de-9d9d-49c4-9e2e-0c023eade4db tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:21.124161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5c434de-9d9d-49c4-9e2e-0c023eade4db tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:21.124589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5c434de-9d9d-49c4-9e2e-0c023eade4db tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:21.125269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5c434de-9d9d-49c4-9e2e-0c023eade4db tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:21.125739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5c434de-9d9d-49c4-9e2e-0c023eade4db tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:21.126158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5c434de-9d9d-49c4-9e2e-0c023eade4db tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:21.156015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e5c434de-9d9d-49c4-9e2e-0c023eade4db tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046375 Oct 28 20:14:21.156673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 688/1384] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:21 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:21.186820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-22abfb06-2847-4b02-a3c8-dcf5ac435ea1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:21.187438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22abfb06-2847-4b02-a3c8-dcf5ac435ea1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:21.194556 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22abfb06-2847-4b02-a3c8-dcf5ac435ea1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:21.195176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22abfb06-2847-4b02-a3c8-dcf5ac435ea1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:21.195615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22abfb06-2847-4b02-a3c8-dcf5ac435ea1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:21.196308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22abfb06-2847-4b02-a3c8-dcf5ac435ea1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:21.196760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22abfb06-2847-4b02-a3c8-dcf5ac435ea1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:21.197185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22abfb06-2847-4b02-a3c8-dcf5ac435ea1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:21.322540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-22abfb06-2847-4b02-a3c8-dcf5ac435ea1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:21.331191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-22abfb06-2847-4b02-a3c8-dcf5ac435ea1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:21.332636 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-22abfb06-2847-4b02-a3c8-dcf5ac435ea1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:21.334120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-22abfb06-2847-4b02-a3c8-dcf5ac435ea1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.150886 Oct 28 20:14:21.335041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 697/1385] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:21 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:22.168276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-83a089f0-daae-4167-8201-3a06ba58f182 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:22.170554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-83a089f0-daae-4167-8201-3a06ba58f182 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:22.177476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83a089f0-daae-4167-8201-3a06ba58f182 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:22.178496 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83a089f0-daae-4167-8201-3a06ba58f182 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:22.178933 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83a089f0-daae-4167-8201-3a06ba58f182 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:22.179621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83a089f0-daae-4167-8201-3a06ba58f182 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:22.180070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83a089f0-daae-4167-8201-3a06ba58f182 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:22.180519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83a089f0-daae-4167-8201-3a06ba58f182 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:22.211294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-83a089f0-daae-4167-8201-3a06ba58f182 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046902 Oct 28 20:14:22.211859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 689/1386] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:22 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:22.359876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1f3330d1-c470-4e7f-bbc9-01853bf60656 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:22.360428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1f3330d1-c470-4e7f-bbc9-01853bf60656 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:22.367557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f3330d1-c470-4e7f-bbc9-01853bf60656 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:22.368043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f3330d1-c470-4e7f-bbc9-01853bf60656 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:22.368845 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f3330d1-c470-4e7f-bbc9-01853bf60656 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:22.369614 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f3330d1-c470-4e7f-bbc9-01853bf60656 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:22.370069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f3330d1-c470-4e7f-bbc9-01853bf60656 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:22.370493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f3330d1-c470-4e7f-bbc9-01853bf60656 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:22.724081 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1f3330d1-c470-4e7f-bbc9-01853bf60656 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:22.733693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1f3330d1-c470-4e7f-bbc9-01853bf60656 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:22.735125 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1f3330d1-c470-4e7f-bbc9-01853bf60656 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:22.736278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1f3330d1-c470-4e7f-bbc9-01853bf60656 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.380387 Oct 28 20:14:22.736845 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 698/1387] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:22 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:23.224044 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9f75642a-124d-45a6-a22a-100ae6ed09ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:23.226745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9f75642a-124d-45a6-a22a-100ae6ed09ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:23.233440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f75642a-124d-45a6-a22a-100ae6ed09ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:23.233930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f75642a-124d-45a6-a22a-100ae6ed09ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:23.234520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f75642a-124d-45a6-a22a-100ae6ed09ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:23.235061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f75642a-124d-45a6-a22a-100ae6ed09ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:23.235514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f75642a-124d-45a6-a22a-100ae6ed09ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:23.235939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f75642a-124d-45a6-a22a-100ae6ed09ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:23.267252 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9f75642a-124d-45a6-a22a-100ae6ed09ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047364 Oct 28 20:14:23.267818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 690/1388] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:23 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:23.762411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7bfb6385-ac86-46ad-95bf-9b8277088a68 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:23.763031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7bfb6385-ac86-46ad-95bf-9b8277088a68 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:23.769372 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bfb6385-ac86-46ad-95bf-9b8277088a68 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:23.769857 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bfb6385-ac86-46ad-95bf-9b8277088a68 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:23.770293 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bfb6385-ac86-46ad-95bf-9b8277088a68 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:23.771013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bfb6385-ac86-46ad-95bf-9b8277088a68 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:23.771466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bfb6385-ac86-46ad-95bf-9b8277088a68 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:23.771902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bfb6385-ac86-46ad-95bf-9b8277088a68 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:23.896821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7bfb6385-ac86-46ad-95bf-9b8277088a68 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:23.906195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7bfb6385-ac86-46ad-95bf-9b8277088a68 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:23.907642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7bfb6385-ac86-46ad-95bf-9b8277088a68 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:23.908803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7bfb6385-ac86-46ad-95bf-9b8277088a68 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.150280 Oct 28 20:14:23.909376 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 699/1389] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:23 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:24.279782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3c45b525-6703-4d60-9981-f7ba4b92f1b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:24.281902 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3c45b525-6703-4d60-9981-f7ba4b92f1b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:24.284291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:24.289085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c45b525-6703-4d60-9981-f7ba4b92f1b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:24.289607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c45b525-6703-4d60-9981-f7ba4b92f1b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:24.290096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c45b525-6703-4d60-9981-f7ba4b92f1b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:24.290786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c45b525-6703-4d60-9981-f7ba4b92f1b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:24.291239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c45b525-6703-4d60-9981-f7ba4b92f1b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:24.291667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c45b525-6703-4d60-9981-f7ba4b92f1b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:24.322986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3c45b525-6703-4d60-9981-f7ba4b92f1b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047209 Oct 28 20:14:24.323563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 691/1390] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:24 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:24.933882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ae462f1e-25c3-4932-bc08-b9b34bfce0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:24.934486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ae462f1e-25c3-4932-bc08-b9b34bfce0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:24.940766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae462f1e-25c3-4932-bc08-b9b34bfce0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:24.941243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae462f1e-25c3-4932-bc08-b9b34bfce0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:24.941707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae462f1e-25c3-4932-bc08-b9b34bfce0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:24.942392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae462f1e-25c3-4932-bc08-b9b34bfce0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:24.942843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae462f1e-25c3-4932-bc08-b9b34bfce0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:24.943265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae462f1e-25c3-4932-bc08-b9b34bfce0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:25.075025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ae462f1e-25c3-4932-bc08-b9b34bfce0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:25.083553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ae462f1e-25c3-4932-bc08-b9b34bfce0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:25.085794 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ae462f1e-25c3-4932-bc08-b9b34bfce0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:25.086950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ae462f1e-25c3-4932-bc08-b9b34bfce0ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.156900 Oct 28 20:14:25.087510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 700/1391] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:24 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:14:25.337366 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-19b9ad09-190c-4c5e-89a1-a6d79b3ac0c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:25.339443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-19b9ad09-190c-4c5e-89a1-a6d79b3ac0c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:25.345285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19b9ad09-190c-4c5e-89a1-a6d79b3ac0c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:25.345799 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19b9ad09-190c-4c5e-89a1-a6d79b3ac0c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:25.346236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19b9ad09-190c-4c5e-89a1-a6d79b3ac0c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:25.346956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19b9ad09-190c-4c5e-89a1-a6d79b3ac0c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:25.347413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19b9ad09-190c-4c5e-89a1-a6d79b3ac0c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:25.347846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19b9ad09-190c-4c5e-89a1-a6d79b3ac0c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:25.377363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-19b9ad09-190c-4c5e-89a1-a6d79b3ac0c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045876 Oct 28 20:14:25.379048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 692/1392] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:25 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:26.112477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc2f3677-2233-4044-90ed-3670ce855aa7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:26.113149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fc2f3677-2233-4044-90ed-3670ce855aa7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:26.119612 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2f3677-2233-4044-90ed-3670ce855aa7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:26.120103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2f3677-2233-4044-90ed-3670ce855aa7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:26.120543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2f3677-2233-4044-90ed-3670ce855aa7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:26.121239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2f3677-2233-4044-90ed-3670ce855aa7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:26.121725 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2f3677-2233-4044-90ed-3670ce855aa7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:26.122148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2f3677-2233-4044-90ed-3670ce855aa7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:26.252054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fc2f3677-2233-4044-90ed-3670ce855aa7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:26.261175 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fc2f3677-2233-4044-90ed-3670ce855aa7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:26.262655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fc2f3677-2233-4044-90ed-3670ce855aa7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:26.263824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fc2f3677-2233-4044-90ed-3670ce855aa7 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.155236 Oct 28 20:14:26.264379 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 701/1393] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:26 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:26.390074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8d73543c-13b3-43cf-8a06-ea0ca152b53a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:26.392117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8d73543c-13b3-43cf-8a06-ea0ca152b53a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:26.398478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d73543c-13b3-43cf-8a06-ea0ca152b53a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:26.398952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d73543c-13b3-43cf-8a06-ea0ca152b53a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:26.399382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d73543c-13b3-43cf-8a06-ea0ca152b53a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:26.400088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d73543c-13b3-43cf-8a06-ea0ca152b53a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:26.400535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d73543c-13b3-43cf-8a06-ea0ca152b53a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:26.400949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d73543c-13b3-43cf-8a06-ea0ca152b53a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:26.430248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8d73543c-13b3-43cf-8a06-ea0ca152b53a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044019 Oct 28 20:14:26.430819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 693/1394] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:26 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:27.290680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8b27da62-a691-44ff-8537-44f37bae57c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:27.291380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8b27da62-a691-44ff-8537-44f37bae57c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:27.297898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b27da62-a691-44ff-8537-44f37bae57c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:27.298375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b27da62-a691-44ff-8537-44f37bae57c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:27.298811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b27da62-a691-44ff-8537-44f37bae57c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:27.299497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b27da62-a691-44ff-8537-44f37bae57c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:27.299978 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b27da62-a691-44ff-8537-44f37bae57c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:27.300399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b27da62-a691-44ff-8537-44f37bae57c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:27.433878 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8b27da62-a691-44ff-8537-44f37bae57c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:27.442456 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0d779aa4-2a60-4564-8aad-f03afb215612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:27.442963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8b27da62-a691-44ff-8537-44f37bae57c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:27.444117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8b27da62-a691-44ff-8537-44f37bae57c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:27.445270 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0d779aa4-2a60-4564-8aad-f03afb215612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:27.445985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8b27da62-a691-44ff-8537-44f37bae57c5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.160084 Oct 28 20:14:27.446540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 702/1395] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:27 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:27.451748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d779aa4-2a60-4564-8aad-f03afb215612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:27.452232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d779aa4-2a60-4564-8aad-f03afb215612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:27.452660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d779aa4-2a60-4564-8aad-f03afb215612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:27.453367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d779aa4-2a60-4564-8aad-f03afb215612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:27.453819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d779aa4-2a60-4564-8aad-f03afb215612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:27.454238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d779aa4-2a60-4564-8aad-f03afb215612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:27.483769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0d779aa4-2a60-4564-8aad-f03afb215612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045204 Oct 28 20:14:27.484326 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 694/1396] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:27 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:28.471850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8728c531-5e2b-43de-8a1c-e50e78ea51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:28.472464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8728c531-5e2b-43de-8a1c-e50e78ea51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:28.478764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8728c531-5e2b-43de-8a1c-e50e78ea51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:28.479245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8728c531-5e2b-43de-8a1c-e50e78ea51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:28.479681 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8728c531-5e2b-43de-8a1c-e50e78ea51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:28.480363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8728c531-5e2b-43de-8a1c-e50e78ea51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:28.480819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8728c531-5e2b-43de-8a1c-e50e78ea51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:28.481236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8728c531-5e2b-43de-8a1c-e50e78ea51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:28.496105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f8bcf4f4-f91a-488f-9a00-e05c45d4ce77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:28.498337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f8bcf4f4-f91a-488f-9a00-e05c45d4ce77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:28.504601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bcf4f4-f91a-488f-9a00-e05c45d4ce77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:28.505079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bcf4f4-f91a-488f-9a00-e05c45d4ce77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:28.505553 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bcf4f4-f91a-488f-9a00-e05c45d4ce77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:28.506239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bcf4f4-f91a-488f-9a00-e05c45d4ce77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:28.507234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bcf4f4-f91a-488f-9a00-e05c45d4ce77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:28.507837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bcf4f4-f91a-488f-9a00-e05c45d4ce77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:28.537290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f8bcf4f4-f91a-488f-9a00-e05c45d4ce77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 Oct 28 20:14:28.537982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 695/1397] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:28 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:14:28.616516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8728c531-5e2b-43de-8a1c-e50e78ea51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:28.625148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8728c531-5e2b-43de-8a1c-e50e78ea51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:28.626638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8728c531-5e2b-43de-8a1c-e50e78ea51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:28.627801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8728c531-5e2b-43de-8a1c-e50e78ea51ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.159842 Oct 28 20:14:28.628355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 703/1398] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:28 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:29.549462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eea6a768-566e-427c-b1e9-1e891076c0a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:29.551709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eea6a768-566e-427c-b1e9-1e891076c0a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:29.558553 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eea6a768-566e-427c-b1e9-1e891076c0a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:29.559036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eea6a768-566e-427c-b1e9-1e891076c0a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:29.559469 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eea6a768-566e-427c-b1e9-1e891076c0a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:29.560150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eea6a768-566e-427c-b1e9-1e891076c0a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:29.560607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eea6a768-566e-427c-b1e9-1e891076c0a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:29.561036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eea6a768-566e-427c-b1e9-1e891076c0a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:29.591212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eea6a768-566e-427c-b1e9-1e891076c0a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045644 Oct 28 20:14:29.591696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 696/1399] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:29 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:29.654683 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e5891eb6-07c2-4653-85f1-57c5ad5bcdca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:29.655294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e5891eb6-07c2-4653-85f1-57c5ad5bcdca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:29.661777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5891eb6-07c2-4653-85f1-57c5ad5bcdca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:29.662246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5891eb6-07c2-4653-85f1-57c5ad5bcdca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:29.662692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5891eb6-07c2-4653-85f1-57c5ad5bcdca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:29.663992 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5891eb6-07c2-4653-85f1-57c5ad5bcdca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:29.664517 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5891eb6-07c2-4653-85f1-57c5ad5bcdca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:29.664942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5891eb6-07c2-4653-85f1-57c5ad5bcdca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:29.794259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e5891eb6-07c2-4653-85f1-57c5ad5bcdca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:29.802735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e5891eb6-07c2-4653-85f1-57c5ad5bcdca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:29.804195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e5891eb6-07c2-4653-85f1-57c5ad5bcdca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:29.805361 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e5891eb6-07c2-4653-85f1-57c5ad5bcdca tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.154658 Oct 28 20:14:29.805908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 704/1400] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:29 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:30.603768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-685ba70e-a30a-432b-8f0c-523e21434ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:30.605938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-685ba70e-a30a-432b-8f0c-523e21434ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:30.612336 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-685ba70e-a30a-432b-8f0c-523e21434ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:30.612809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-685ba70e-a30a-432b-8f0c-523e21434ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:30.613237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-685ba70e-a30a-432b-8f0c-523e21434ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:30.613945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-685ba70e-a30a-432b-8f0c-523e21434ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:30.614393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-685ba70e-a30a-432b-8f0c-523e21434ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:30.614813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-685ba70e-a30a-432b-8f0c-523e21434ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:30.644118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-685ba70e-a30a-432b-8f0c-523e21434ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044741 Oct 28 20:14:30.644668 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 697/1401] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:30 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:30.832026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d0d9c999-5770-4052-ab23-bca88f9969d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:30.832565 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d0d9c999-5770-4052-ab23-bca88f9969d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:30.839780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0d9c999-5770-4052-ab23-bca88f9969d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:30.840256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0d9c999-5770-4052-ab23-bca88f9969d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:30.840688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0d9c999-5770-4052-ab23-bca88f9969d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:30.841398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0d9c999-5770-4052-ab23-bca88f9969d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:30.841854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0d9c999-5770-4052-ab23-bca88f9969d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:30.842276 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0d9c999-5770-4052-ab23-bca88f9969d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:30.971279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0d9c999-5770-4052-ab23-bca88f9969d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:30.980855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0d9c999-5770-4052-ab23-bca88f9969d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:30.982335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0d9c999-5770-4052-ab23-bca88f9969d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:30.983494 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d0d9c999-5770-4052-ab23-bca88f9969d4 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.155474 Oct 28 20:14:30.984057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 705/1402] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:30 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:31.656119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f32846b5-6f6c-4c7d-acc1-4192ff1b5bd3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:31.658333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f32846b5-6f6c-4c7d-acc1-4192ff1b5bd3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:31.665216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f32846b5-6f6c-4c7d-acc1-4192ff1b5bd3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:31.666954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f32846b5-6f6c-4c7d-acc1-4192ff1b5bd3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:31.666954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f32846b5-6f6c-4c7d-acc1-4192ff1b5bd3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:31.666954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f32846b5-6f6c-4c7d-acc1-4192ff1b5bd3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:31.667272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f32846b5-6f6c-4c7d-acc1-4192ff1b5bd3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:31.667700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f32846b5-6f6c-4c7d-acc1-4192ff1b5bd3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:31.697059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f32846b5-6f6c-4c7d-acc1-4192ff1b5bd3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044935 Oct 28 20:14:31.697652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 698/1403] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:31 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:32.010937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-96ff3a4a-35fc-4e6c-9262-3a859154f99d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:32.011469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-96ff3a4a-35fc-4e6c-9262-3a859154f99d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:32.017919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96ff3a4a-35fc-4e6c-9262-3a859154f99d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:32.018405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96ff3a4a-35fc-4e6c-9262-3a859154f99d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:32.018847 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96ff3a4a-35fc-4e6c-9262-3a859154f99d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:32.019569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96ff3a4a-35fc-4e6c-9262-3a859154f99d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:32.020023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96ff3a4a-35fc-4e6c-9262-3a859154f99d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:32.020450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96ff3a4a-35fc-4e6c-9262-3a859154f99d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:32.146884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-96ff3a4a-35fc-4e6c-9262-3a859154f99d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:32.156015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-96ff3a4a-35fc-4e6c-9262-3a859154f99d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:32.157483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-96ff3a4a-35fc-4e6c-9262-3a859154f99d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:32.158638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-96ff3a4a-35fc-4e6c-9262-3a859154f99d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.152527 Oct 28 20:14:32.159195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 706/1404] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:32 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:32.709474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-939c9aa8-1c0e-4c4d-90d6-5192209cf6a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:32.711677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-939c9aa8-1c0e-4c4d-90d6-5192209cf6a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:32.717904 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-939c9aa8-1c0e-4c4d-90d6-5192209cf6a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:32.718376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-939c9aa8-1c0e-4c4d-90d6-5192209cf6a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:32.718801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-939c9aa8-1c0e-4c4d-90d6-5192209cf6a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:32.719475 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-939c9aa8-1c0e-4c4d-90d6-5192209cf6a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:32.719919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-939c9aa8-1c0e-4c4d-90d6-5192209cf6a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:32.720336 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-939c9aa8-1c0e-4c4d-90d6-5192209cf6a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:32.750811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-939c9aa8-1c0e-4c4d-90d6-5192209cf6a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045532 Oct 28 20:14:32.751355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 699/1405] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:32 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:33.185780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-37504a88-69ab-44d2-ad18-f94c069ef103 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:33.186394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-37504a88-69ab-44d2-ad18-f94c069ef103 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:33.192900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37504a88-69ab-44d2-ad18-f94c069ef103 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:33.193414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37504a88-69ab-44d2-ad18-f94c069ef103 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:33.193862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37504a88-69ab-44d2-ad18-f94c069ef103 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:33.194985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37504a88-69ab-44d2-ad18-f94c069ef103 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:33.195450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37504a88-69ab-44d2-ad18-f94c069ef103 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:33.195882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37504a88-69ab-44d2-ad18-f94c069ef103 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:33.333197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-37504a88-69ab-44d2-ad18-f94c069ef103 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:33.342634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-37504a88-69ab-44d2-ad18-f94c069ef103 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:33.345506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-37504a88-69ab-44d2-ad18-f94c069ef103 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:33.346660 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-37504a88-69ab-44d2-ad18-f94c069ef103 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.164865 Oct 28 20:14:33.347211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 707/1406] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:33 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:33.763734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b95170b-4219-4691-a547-b7ed046c6103 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:33.765918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b95170b-4219-4691-a547-b7ed046c6103 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:33.772928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b95170b-4219-4691-a547-b7ed046c6103 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:33.773432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b95170b-4219-4691-a547-b7ed046c6103 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:33.773870 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b95170b-4219-4691-a547-b7ed046c6103 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:33.774552 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b95170b-4219-4691-a547-b7ed046c6103 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:33.775003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b95170b-4219-4691-a547-b7ed046c6103 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:33.775424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b95170b-4219-4691-a547-b7ed046c6103 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:33.804542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b95170b-4219-4691-a547-b7ed046c6103 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044642 Oct 28 20:14:33.805132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 700/1407] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:33 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:34.372792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e96a8715-dc3c-4093-b789-b404c136c2f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:34.373430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e96a8715-dc3c-4093-b789-b404c136c2f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:34.379923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e96a8715-dc3c-4093-b789-b404c136c2f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:34.380531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e96a8715-dc3c-4093-b789-b404c136c2f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:34.380848 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e96a8715-dc3c-4093-b789-b404c136c2f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:34.382634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e96a8715-dc3c-4093-b789-b404c136c2f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:34.383107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e96a8715-dc3c-4093-b789-b404c136c2f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:34.383542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e96a8715-dc3c-4093-b789-b404c136c2f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:34.406113 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:34.515547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e96a8715-dc3c-4093-b789-b404c136c2f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:34.524450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e96a8715-dc3c-4093-b789-b404c136c2f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:34.525905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e96a8715-dc3c-4093-b789-b404c136c2f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:34.527062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e96a8715-dc3c-4093-b789-b404c136c2f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.158187 Oct 28 20:14:34.527621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 708/1408] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:34 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:34.815847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-50a197f7-7eee-46b3-bd5a-409e1e6a25bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:34.818000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-50a197f7-7eee-46b3-bd5a-409e1e6a25bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:34.824289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50a197f7-7eee-46b3-bd5a-409e1e6a25bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:34.824758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50a197f7-7eee-46b3-bd5a-409e1e6a25bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:34.825182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50a197f7-7eee-46b3-bd5a-409e1e6a25bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:34.825917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50a197f7-7eee-46b3-bd5a-409e1e6a25bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:34.826359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50a197f7-7eee-46b3-bd5a-409e1e6a25bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:34.826775 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50a197f7-7eee-46b3-bd5a-409e1e6a25bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:34.856877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-50a197f7-7eee-46b3-bd5a-409e1e6a25bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044871 Oct 28 20:14:34.857453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 701/1409] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:34 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:35.551250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7070f3e9-612c-4ad5-a384-e919222d0c76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:35.551858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7070f3e9-612c-4ad5-a384-e919222d0c76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:35.558739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7070f3e9-612c-4ad5-a384-e919222d0c76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:35.559214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7070f3e9-612c-4ad5-a384-e919222d0c76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:35.559648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7070f3e9-612c-4ad5-a384-e919222d0c76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:35.560331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7070f3e9-612c-4ad5-a384-e919222d0c76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:35.560789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7070f3e9-612c-4ad5-a384-e919222d0c76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:35.561212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7070f3e9-612c-4ad5-a384-e919222d0c76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:35.687010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7070f3e9-612c-4ad5-a384-e919222d0c76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:35.696178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7070f3e9-612c-4ad5-a384-e919222d0c76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:35.697644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7070f3e9-612c-4ad5-a384-e919222d0c76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:35.698796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7070f3e9-612c-4ad5-a384-e919222d0c76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.151516 Oct 28 20:14:35.699345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 709/1410] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:35 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:35.869785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-891b53fa-5309-4445-9066-9c95b493f484 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:35.872198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-891b53fa-5309-4445-9066-9c95b493f484 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:35.878726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-891b53fa-5309-4445-9066-9c95b493f484 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:35.879208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-891b53fa-5309-4445-9066-9c95b493f484 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:35.879648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-891b53fa-5309-4445-9066-9c95b493f484 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:35.880419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-891b53fa-5309-4445-9066-9c95b493f484 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:35.880871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-891b53fa-5309-4445-9066-9c95b493f484 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:35.881344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-891b53fa-5309-4445-9066-9c95b493f484 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:35.910913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-891b53fa-5309-4445-9066-9c95b493f484 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045740 Oct 28 20:14:35.911753 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 702/1411] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:35 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:36.724588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d8be3564-1ad1-437e-803f-ebcb501e57c3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:36.724588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d8be3564-1ad1-437e-803f-ebcb501e57c3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:36.731177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8be3564-1ad1-437e-803f-ebcb501e57c3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:36.731681 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8be3564-1ad1-437e-803f-ebcb501e57c3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:36.732109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8be3564-1ad1-437e-803f-ebcb501e57c3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:36.732797 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8be3564-1ad1-437e-803f-ebcb501e57c3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:36.733254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8be3564-1ad1-437e-803f-ebcb501e57c3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:36.733709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8be3564-1ad1-437e-803f-ebcb501e57c3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:36.863782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d8be3564-1ad1-437e-803f-ebcb501e57c3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:36.873146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d8be3564-1ad1-437e-803f-ebcb501e57c3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:36.874617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d8be3564-1ad1-437e-803f-ebcb501e57c3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:36.875771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d8be3564-1ad1-437e-803f-ebcb501e57c3 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.155729 Oct 28 20:14:36.876332 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 710/1412] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:36 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:36.923773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-77bd6b71-635c-4860-a1e7-0d5fbcb21c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:36.927053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-77bd6b71-635c-4860-a1e7-0d5fbcb21c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:36.934148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77bd6b71-635c-4860-a1e7-0d5fbcb21c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:36.934634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77bd6b71-635c-4860-a1e7-0d5fbcb21c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:36.935069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77bd6b71-635c-4860-a1e7-0d5fbcb21c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:36.935767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77bd6b71-635c-4860-a1e7-0d5fbcb21c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:36.936217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77bd6b71-635c-4860-a1e7-0d5fbcb21c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:36.936680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77bd6b71-635c-4860-a1e7-0d5fbcb21c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:36.963489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:36.969673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-77bd6b71-635c-4860-a1e7-0d5fbcb21c1b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049239 Oct 28 20:14:36.970899 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 703/1413] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:36 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:37.902026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-809adafa-0768-4a59-8747-53264373b154 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:37.902643 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-809adafa-0768-4a59-8747-53264373b154 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:37.909064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-809adafa-0768-4a59-8747-53264373b154 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:37.909583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-809adafa-0768-4a59-8747-53264373b154 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:37.910024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-809adafa-0768-4a59-8747-53264373b154 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:37.910719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-809adafa-0768-4a59-8747-53264373b154 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:37.911173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-809adafa-0768-4a59-8747-53264373b154 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:37.911613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-809adafa-0768-4a59-8747-53264373b154 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:37.987705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-360e4f73-720c-49f6-9af6-d1b925468632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:37.990178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-360e4f73-720c-49f6-9af6-d1b925468632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:37.997742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-360e4f73-720c-49f6-9af6-d1b925468632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:37.998224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-360e4f73-720c-49f6-9af6-d1b925468632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:37.998654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-360e4f73-720c-49f6-9af6-d1b925468632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:37.999350 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-360e4f73-720c-49f6-9af6-d1b925468632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:37.999915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-360e4f73-720c-49f6-9af6-d1b925468632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:38.000714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-360e4f73-720c-49f6-9af6-d1b925468632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:38.036397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-360e4f73-720c-49f6-9af6-d1b925468632 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053201 Oct 28 20:14:38.039018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 704/1414] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:37 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:14:38.075883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-809adafa-0768-4a59-8747-53264373b154 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:38.086728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-809adafa-0768-4a59-8747-53264373b154 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:38.088287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-809adafa-0768-4a59-8747-53264373b154 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:38.089534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-809adafa-0768-4a59-8747-53264373b154 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.191297 Oct 28 20:14:38.090028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 711/1415] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:37 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:39.049479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b860ea93-1896-41f9-aac0-13a970228212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:39.051677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b860ea93-1896-41f9-aac0-13a970228212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:39.058877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b860ea93-1896-41f9-aac0-13a970228212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:39.059357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b860ea93-1896-41f9-aac0-13a970228212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:39.059790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b860ea93-1896-41f9-aac0-13a970228212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:39.060510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b860ea93-1896-41f9-aac0-13a970228212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:39.060990 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b860ea93-1896-41f9-aac0-13a970228212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:39.061507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b860ea93-1896-41f9-aac0-13a970228212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:39.091673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b860ea93-1896-41f9-aac0-13a970228212 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046083 Oct 28 20:14:39.092240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 705/1416] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:39 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:39.120713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e0c9f6f0-6eac-4b71-b1a3-24ce2cfc4328 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:39.121395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e0c9f6f0-6eac-4b71-b1a3-24ce2cfc4328 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:39.127990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0c9f6f0-6eac-4b71-b1a3-24ce2cfc4328 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:39.128491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0c9f6f0-6eac-4b71-b1a3-24ce2cfc4328 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:39.128916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0c9f6f0-6eac-4b71-b1a3-24ce2cfc4328 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:39.129649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0c9f6f0-6eac-4b71-b1a3-24ce2cfc4328 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:39.130105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0c9f6f0-6eac-4b71-b1a3-24ce2cfc4328 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:39.130531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0c9f6f0-6eac-4b71-b1a3-24ce2cfc4328 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:39.265663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e0c9f6f0-6eac-4b71-b1a3-24ce2cfc4328 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:39.273995 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e0c9f6f0-6eac-4b71-b1a3-24ce2cfc4328 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:39.275418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e0c9f6f0-6eac-4b71-b1a3-24ce2cfc4328 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:39.276556 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e0c9f6f0-6eac-4b71-b1a3-24ce2cfc4328 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.159963 Oct 28 20:14:39.277111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 712/1417] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:39 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:40.103802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-82a5912e-1eb0-46af-b7b9-4db195bbf0fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:40.105967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-82a5912e-1eb0-46af-b7b9-4db195bbf0fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:40.112264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82a5912e-1eb0-46af-b7b9-4db195bbf0fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:40.112741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82a5912e-1eb0-46af-b7b9-4db195bbf0fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:40.113272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82a5912e-1eb0-46af-b7b9-4db195bbf0fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:40.114054 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82a5912e-1eb0-46af-b7b9-4db195bbf0fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:40.114506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82a5912e-1eb0-46af-b7b9-4db195bbf0fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:40.114931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82a5912e-1eb0-46af-b7b9-4db195bbf0fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:40.152189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-82a5912e-1eb0-46af-b7b9-4db195bbf0fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046318 Oct 28 20:14:40.152189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 706/1418] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:40 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:40.301590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-06f169bb-7ae2-4d91-b946-6ed7b076374a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:40.302110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-06f169bb-7ae2-4d91-b946-6ed7b076374a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:40.309289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06f169bb-7ae2-4d91-b946-6ed7b076374a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:40.309909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06f169bb-7ae2-4d91-b946-6ed7b076374a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:40.310350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06f169bb-7ae2-4d91-b946-6ed7b076374a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:40.311040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06f169bb-7ae2-4d91-b946-6ed7b076374a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:40.311492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06f169bb-7ae2-4d91-b946-6ed7b076374a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:40.311912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06f169bb-7ae2-4d91-b946-6ed7b076374a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:40.437787 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-06f169bb-7ae2-4d91-b946-6ed7b076374a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:40.446439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-06f169bb-7ae2-4d91-b946-6ed7b076374a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:40.447874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-06f169bb-7ae2-4d91-b946-6ed7b076374a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:40.449024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-06f169bb-7ae2-4d91-b946-6ed7b076374a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.151436 Oct 28 20:14:40.449625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 713/1419] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:40 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:41.162790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3e99ed9a-eb2d-4da5-9647-07ca0bd5573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:41.164864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3e99ed9a-eb2d-4da5-9647-07ca0bd5573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:41.171178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e99ed9a-eb2d-4da5-9647-07ca0bd5573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:41.171659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e99ed9a-eb2d-4da5-9647-07ca0bd5573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:41.172090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e99ed9a-eb2d-4da5-9647-07ca0bd5573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:41.172782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e99ed9a-eb2d-4da5-9647-07ca0bd5573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:41.173231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e99ed9a-eb2d-4da5-9647-07ca0bd5573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:41.173683 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e99ed9a-eb2d-4da5-9647-07ca0bd5573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:41.203384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3e99ed9a-eb2d-4da5-9647-07ca0bd5573b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044959 Oct 28 20:14:41.203955 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 707/1420] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:41 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:41.474722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2dd8584e-8851-48c5-b736-2776d64d7cf0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:41.475724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2dd8584e-8851-48c5-b736-2776d64d7cf0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:41.481742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dd8584e-8851-48c5-b736-2776d64d7cf0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:41.482224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dd8584e-8851-48c5-b736-2776d64d7cf0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:41.482659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dd8584e-8851-48c5-b736-2776d64d7cf0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:41.483343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dd8584e-8851-48c5-b736-2776d64d7cf0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:41.483796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dd8584e-8851-48c5-b736-2776d64d7cf0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:41.484217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dd8584e-8851-48c5-b736-2776d64d7cf0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:41.618675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2dd8584e-8851-48c5-b736-2776d64d7cf0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:41.627119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2dd8584e-8851-48c5-b736-2776d64d7cf0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:41.628571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2dd8584e-8851-48c5-b736-2776d64d7cf0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:41.629806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2dd8584e-8851-48c5-b736-2776d64d7cf0 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.158993 Oct 28 20:14:41.630356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 714/1421] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:41 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:42.216012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4c46f0c1-4974-452f-be44-d867cd35acbb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:42.218201 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4c46f0c1-4974-452f-be44-d867cd35acbb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:42.224497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c46f0c1-4974-452f-be44-d867cd35acbb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:42.226175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c46f0c1-4974-452f-be44-d867cd35acbb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:42.226626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c46f0c1-4974-452f-be44-d867cd35acbb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:42.227324 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c46f0c1-4974-452f-be44-d867cd35acbb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:42.227787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c46f0c1-4974-452f-be44-d867cd35acbb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:42.228213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c46f0c1-4974-452f-be44-d867cd35acbb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:42.258693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4c46f0c1-4974-452f-be44-d867cd35acbb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046476 Oct 28 20:14:42.259140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 708/1422] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:42 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:42.655178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7fdedfba-226f-4a4b-80cb-afe4b7288535 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:42.655712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7fdedfba-226f-4a4b-80cb-afe4b7288535 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:42.661985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fdedfba-226f-4a4b-80cb-afe4b7288535 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:42.662457 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fdedfba-226f-4a4b-80cb-afe4b7288535 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:42.662885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fdedfba-226f-4a4b-80cb-afe4b7288535 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:42.663555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fdedfba-226f-4a4b-80cb-afe4b7288535 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:42.663996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fdedfba-226f-4a4b-80cb-afe4b7288535 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:42.664408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fdedfba-226f-4a4b-80cb-afe4b7288535 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:42.791319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7fdedfba-226f-4a4b-80cb-afe4b7288535 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:42.799816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7fdedfba-226f-4a4b-80cb-afe4b7288535 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:42.801296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7fdedfba-226f-4a4b-80cb-afe4b7288535 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:42.802474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7fdedfba-226f-4a4b-80cb-afe4b7288535 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.151394 Oct 28 20:14:42.803534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 715/1423] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:42 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:43.270592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-17342768-2354-46c5-aa6b-662eec48cadb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:43.273234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-17342768-2354-46c5-aa6b-662eec48cadb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:43.281604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17342768-2354-46c5-aa6b-662eec48cadb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:43.282019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17342768-2354-46c5-aa6b-662eec48cadb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:43.282670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17342768-2354-46c5-aa6b-662eec48cadb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:43.283238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17342768-2354-46c5-aa6b-662eec48cadb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:43.283609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17342768-2354-46c5-aa6b-662eec48cadb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:43.284031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17342768-2354-46c5-aa6b-662eec48cadb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:43.317767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-17342768-2354-46c5-aa6b-662eec48cadb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051060 Oct 28 20:14:43.322738 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 709/1424] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:43 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:43.828720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b94dc452-0656-4224-8a9f-2280cdeb202e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:43.829268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b94dc452-0656-4224-8a9f-2280cdeb202e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:43.836991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b94dc452-0656-4224-8a9f-2280cdeb202e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:43.837502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b94dc452-0656-4224-8a9f-2280cdeb202e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:43.838265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b94dc452-0656-4224-8a9f-2280cdeb202e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:43.839004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b94dc452-0656-4224-8a9f-2280cdeb202e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:43.839455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b94dc452-0656-4224-8a9f-2280cdeb202e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:43.840019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b94dc452-0656-4224-8a9f-2280cdeb202e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:43.989443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b94dc452-0656-4224-8a9f-2280cdeb202e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:43.998321 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b94dc452-0656-4224-8a9f-2280cdeb202e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:43.999768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b94dc452-0656-4224-8a9f-2280cdeb202e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:44.000922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b94dc452-0656-4224-8a9f-2280cdeb202e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.176415 Oct 28 20:14:44.001547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 716/1425] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:43 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:44.330871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3850298-3653-4f2b-9c7b-2c88a926a34f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:44.333103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b3850298-3653-4f2b-9c7b-2c88a926a34f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:44.339885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3850298-3653-4f2b-9c7b-2c88a926a34f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:44.340370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3850298-3653-4f2b-9c7b-2c88a926a34f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:44.340805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3850298-3653-4f2b-9c7b-2c88a926a34f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:44.341529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3850298-3653-4f2b-9c7b-2c88a926a34f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:44.341983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3850298-3653-4f2b-9c7b-2c88a926a34f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:44.342411 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3850298-3653-4f2b-9c7b-2c88a926a34f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:44.371475 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b3850298-3653-4f2b-9c7b-2c88a926a34f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044641 Oct 28 20:14:44.372031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 710/1426] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:44 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:45.027979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1abfd832-1040-44a0-9b68-9ec56fec0207 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:45.028714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1abfd832-1040-44a0-9b68-9ec56fec0207 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:45.035137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1abfd832-1040-44a0-9b68-9ec56fec0207 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:45.035619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1abfd832-1040-44a0-9b68-9ec56fec0207 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:45.036057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1abfd832-1040-44a0-9b68-9ec56fec0207 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:45.036745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1abfd832-1040-44a0-9b68-9ec56fec0207 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:45.037756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1abfd832-1040-44a0-9b68-9ec56fec0207 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:45.038207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1abfd832-1040-44a0-9b68-9ec56fec0207 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:45.171945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1abfd832-1040-44a0-9b68-9ec56fec0207 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:45.180342 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1abfd832-1040-44a0-9b68-9ec56fec0207 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:45.181758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1abfd832-1040-44a0-9b68-9ec56fec0207 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:45.182901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1abfd832-1040-44a0-9b68-9ec56fec0207 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.158908 Oct 28 20:14:45.183447 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 717/1427] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:45 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:45.383741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d4015649-7577-4c36-b7a7-640ed1bf8215 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:45.386023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d4015649-7577-4c36-b7a7-640ed1bf8215 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:45.392332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4015649-7577-4c36-b7a7-640ed1bf8215 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:45.392818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4015649-7577-4c36-b7a7-640ed1bf8215 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:45.393253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4015649-7577-4c36-b7a7-640ed1bf8215 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:45.394025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4015649-7577-4c36-b7a7-640ed1bf8215 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:45.394476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4015649-7577-4c36-b7a7-640ed1bf8215 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:45.394897 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4015649-7577-4c36-b7a7-640ed1bf8215 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:45.424853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d4015649-7577-4c36-b7a7-640ed1bf8215 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045310 Oct 28 20:14:45.425428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 711/1428] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:45 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:46.208244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-55231563-eb99-47a5-9903-5c23b54d1d65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:46.209289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-55231563-eb99-47a5-9903-5c23b54d1d65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:46.215936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55231563-eb99-47a5-9903-5c23b54d1d65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:46.216419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55231563-eb99-47a5-9903-5c23b54d1d65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:46.216859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55231563-eb99-47a5-9903-5c23b54d1d65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:46.217583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55231563-eb99-47a5-9903-5c23b54d1d65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:46.218036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55231563-eb99-47a5-9903-5c23b54d1d65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:46.218461 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55231563-eb99-47a5-9903-5c23b54d1d65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:46.347297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-55231563-eb99-47a5-9903-5c23b54d1d65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:46.356303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-55231563-eb99-47a5-9903-5c23b54d1d65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:46.357750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-55231563-eb99-47a5-9903-5c23b54d1d65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:46.358887 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-55231563-eb99-47a5-9903-5c23b54d1d65 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.154589 Oct 28 20:14:46.359454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 718/1429] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:46 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:46.436841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-040b56e7-8c92-451c-9d0f-6428a037c328 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:46.439131 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-040b56e7-8c92-451c-9d0f-6428a037c328 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:46.445595 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-040b56e7-8c92-451c-9d0f-6428a037c328 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:46.446069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-040b56e7-8c92-451c-9d0f-6428a037c328 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:46.446501 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-040b56e7-8c92-451c-9d0f-6428a037c328 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:46.447186 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-040b56e7-8c92-451c-9d0f-6428a037c328 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:46.447635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-040b56e7-8c92-451c-9d0f-6428a037c328 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:46.448058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-040b56e7-8c92-451c-9d0f-6428a037c328 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:46.477425 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-040b56e7-8c92-451c-9d0f-6428a037c328 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044507 Oct 28 20:14:46.477972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 712/1430] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:46 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:47.383976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ff7ba8b8-7073-4f22-afa5-b6e84fc3b358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:47.384508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ff7ba8b8-7073-4f22-afa5-b6e84fc3b358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:47.390819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff7ba8b8-7073-4f22-afa5-b6e84fc3b358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:47.391292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff7ba8b8-7073-4f22-afa5-b6e84fc3b358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:47.391726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff7ba8b8-7073-4f22-afa5-b6e84fc3b358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:47.392402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff7ba8b8-7073-4f22-afa5-b6e84fc3b358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:47.392846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff7ba8b8-7073-4f22-afa5-b6e84fc3b358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:47.393264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff7ba8b8-7073-4f22-afa5-b6e84fc3b358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:47.489713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-267cf1fc-3b01-4755-9bf9-d32db16eac6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:47.492255 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-267cf1fc-3b01-4755-9bf9-d32db16eac6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:47.498714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-267cf1fc-3b01-4755-9bf9-d32db16eac6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:47.499194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-267cf1fc-3b01-4755-9bf9-d32db16eac6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:47.499626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-267cf1fc-3b01-4755-9bf9-d32db16eac6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:47.500312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-267cf1fc-3b01-4755-9bf9-d32db16eac6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:47.500848 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-267cf1fc-3b01-4755-9bf9-d32db16eac6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:47.501273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-267cf1fc-3b01-4755-9bf9-d32db16eac6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:47.525309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ff7ba8b8-7073-4f22-afa5-b6e84fc3b358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:47.530957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-267cf1fc-3b01-4755-9bf9-d32db16eac6f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045156 Oct 28 20:14:47.531523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 713/1431] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:47 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:14:47.540753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ff7ba8b8-7073-4f22-afa5-b6e84fc3b358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:47.540753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ff7ba8b8-7073-4f22-afa5-b6e84fc3b358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:47.540753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ff7ba8b8-7073-4f22-afa5-b6e84fc3b358 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.156484 Oct 28 20:14:47.541103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 719/1432] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:47 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:48.543821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-999388fc-1b87-4cfb-9ab3-40ee168759e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:48.546097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-999388fc-1b87-4cfb-9ab3-40ee168759e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:48.552393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-999388fc-1b87-4cfb-9ab3-40ee168759e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:48.553523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-999388fc-1b87-4cfb-9ab3-40ee168759e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:48.554075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-999388fc-1b87-4cfb-9ab3-40ee168759e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:48.554760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-999388fc-1b87-4cfb-9ab3-40ee168759e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:48.555212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-999388fc-1b87-4cfb-9ab3-40ee168759e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:48.555635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-999388fc-1b87-4cfb-9ab3-40ee168759e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:48.562587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7577e5d7-9293-40de-9750-397e7d6a5648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:48.563200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7577e5d7-9293-40de-9750-397e7d6a5648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:48.570239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7577e5d7-9293-40de-9750-397e7d6a5648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:48.570720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7577e5d7-9293-40de-9750-397e7d6a5648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:48.571163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7577e5d7-9293-40de-9750-397e7d6a5648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:48.571870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7577e5d7-9293-40de-9750-397e7d6a5648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:48.572327 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7577e5d7-9293-40de-9750-397e7d6a5648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:48.572751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7577e5d7-9293-40de-9750-397e7d6a5648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:48.584874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-999388fc-1b87-4cfb-9ab3-40ee168759e6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044885 Oct 28 20:14:48.585457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 714/1433] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:48 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:48.703667 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7577e5d7-9293-40de-9750-397e7d6a5648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:48.713278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7577e5d7-9293-40de-9750-397e7d6a5648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:48.714572 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7577e5d7-9293-40de-9750-397e7d6a5648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:48.715870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7577e5d7-9293-40de-9750-397e7d6a5648 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.157011 Oct 28 20:14:48.716558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 720/1434] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:48 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:49.597355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a982c5ea-6982-4377-9385-297aa9da2050 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:49.599798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a982c5ea-6982-4377-9385-297aa9da2050 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:49.606354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a982c5ea-6982-4377-9385-297aa9da2050 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:49.606837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a982c5ea-6982-4377-9385-297aa9da2050 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:49.607275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a982c5ea-6982-4377-9385-297aa9da2050 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:49.607967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a982c5ea-6982-4377-9385-297aa9da2050 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:49.608423 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a982c5ea-6982-4377-9385-297aa9da2050 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:49.608851 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a982c5ea-6982-4377-9385-297aa9da2050 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:49.639124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a982c5ea-6982-4377-9385-297aa9da2050 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045778 Oct 28 20:14:49.639671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 715/1435] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:49 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:49.742407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-13d6cbc7-176d-49a8-8430-e95e0dd7ec76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:49.743040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-13d6cbc7-176d-49a8-8430-e95e0dd7ec76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:49.749393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d6cbc7-176d-49a8-8430-e95e0dd7ec76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:49.749867 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d6cbc7-176d-49a8-8430-e95e0dd7ec76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:49.750305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d6cbc7-176d-49a8-8430-e95e0dd7ec76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:49.750979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d6cbc7-176d-49a8-8430-e95e0dd7ec76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:49.751424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d6cbc7-176d-49a8-8430-e95e0dd7ec76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:49.751839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d6cbc7-176d-49a8-8430-e95e0dd7ec76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:49.886419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-13d6cbc7-176d-49a8-8430-e95e0dd7ec76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:49.894949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-13d6cbc7-176d-49a8-8430-e95e0dd7ec76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:49.896429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-13d6cbc7-176d-49a8-8430-e95e0dd7ec76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:49.897804 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-13d6cbc7-176d-49a8-8430-e95e0dd7ec76 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.159860 Oct 28 20:14:49.898559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 721/1436] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:49 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:50.652036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bb827101-8e33-4956-a17a-c4a7d458cd92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:50.654334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bb827101-8e33-4956-a17a-c4a7d458cd92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:50.660703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb827101-8e33-4956-a17a-c4a7d458cd92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:50.661196 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb827101-8e33-4956-a17a-c4a7d458cd92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:50.661671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb827101-8e33-4956-a17a-c4a7d458cd92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:50.662984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb827101-8e33-4956-a17a-c4a7d458cd92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:50.663439 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb827101-8e33-4956-a17a-c4a7d458cd92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:50.663868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb827101-8e33-4956-a17a-c4a7d458cd92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:50.692433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bb827101-8e33-4956-a17a-c4a7d458cd92 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 Oct 28 20:14:50.692976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 716/1437] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:50 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:14:50.923755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5b239ada-fa42-4a41-9ddf-d786bdd1fe39 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:50.924198 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5b239ada-fa42-4a41-9ddf-d786bdd1fe39 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:50.926372 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=52 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:50.931036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b239ada-fa42-4a41-9ddf-d786bdd1fe39 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:50.931517 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b239ada-fa42-4a41-9ddf-d786bdd1fe39 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:50.931947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b239ada-fa42-4a41-9ddf-d786bdd1fe39 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:50.932631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b239ada-fa42-4a41-9ddf-d786bdd1fe39 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:50.933074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b239ada-fa42-4a41-9ddf-d786bdd1fe39 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:50.933523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b239ada-fa42-4a41-9ddf-d786bdd1fe39 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:51.071190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5b239ada-fa42-4a41-9ddf-d786bdd1fe39 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:51.079619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5b239ada-fa42-4a41-9ddf-d786bdd1fe39 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:51.081072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5b239ada-fa42-4a41-9ddf-d786bdd1fe39 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:51.082261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5b239ada-fa42-4a41-9ddf-d786bdd1fe39 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.162575 Oct 28 20:14:51.082819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 722/1438] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:50 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:51.705504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9468c18-4a90-4bed-8ce3-8f96ccadc9c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:51.707896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f9468c18-4a90-4bed-8ce3-8f96ccadc9c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:51.715518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9468c18-4a90-4bed-8ce3-8f96ccadc9c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:51.716007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9468c18-4a90-4bed-8ce3-8f96ccadc9c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:51.716446 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9468c18-4a90-4bed-8ce3-8f96ccadc9c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:51.717197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9468c18-4a90-4bed-8ce3-8f96ccadc9c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:51.717682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9468c18-4a90-4bed-8ce3-8f96ccadc9c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:51.718111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9468c18-4a90-4bed-8ce3-8f96ccadc9c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:51.747364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f9468c18-4a90-4bed-8ce3-8f96ccadc9c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045887 Oct 28 20:14:51.747911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 717/1439] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:51 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:52.107831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f4025f73-588e-4e5d-9039-670a0f587da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:52.108449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f4025f73-588e-4e5d-9039-670a0f587da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:52.114745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4025f73-588e-4e5d-9039-670a0f587da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:52.115228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4025f73-588e-4e5d-9039-670a0f587da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:52.116180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4025f73-588e-4e5d-9039-670a0f587da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:52.117239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4025f73-588e-4e5d-9039-670a0f587da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:52.117726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4025f73-588e-4e5d-9039-670a0f587da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:52.118158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4025f73-588e-4e5d-9039-670a0f587da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:52.245163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f4025f73-588e-4e5d-9039-670a0f587da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:52.253664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f4025f73-588e-4e5d-9039-670a0f587da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:52.255083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f4025f73-588e-4e5d-9039-670a0f587da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:52.256229 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f4025f73-588e-4e5d-9039-670a0f587da1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.152272 Oct 28 20:14:52.256784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 723/1440] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:52 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:52.760011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b6420a24-2568-47e2-9c90-b4b9bdf39f18 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:52.762376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b6420a24-2568-47e2-9c90-b4b9bdf39f18 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:52.768624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6420a24-2568-47e2-9c90-b4b9bdf39f18 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:52.769118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6420a24-2568-47e2-9c90-b4b9bdf39f18 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:52.769586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6420a24-2568-47e2-9c90-b4b9bdf39f18 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:52.770261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6420a24-2568-47e2-9c90-b4b9bdf39f18 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:52.770708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6420a24-2568-47e2-9c90-b4b9bdf39f18 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:52.771126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6420a24-2568-47e2-9c90-b4b9bdf39f18 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:52.801716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b6420a24-2568-47e2-9c90-b4b9bdf39f18 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045800 Oct 28 20:14:52.802276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 718/1441] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:52 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:53.280670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e104cc1-6200-4393-9cc8-ed0785966a34 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:53.281230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4e104cc1-6200-4393-9cc8-ed0785966a34 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:53.287931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e104cc1-6200-4393-9cc8-ed0785966a34 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:53.288420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e104cc1-6200-4393-9cc8-ed0785966a34 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:53.288862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e104cc1-6200-4393-9cc8-ed0785966a34 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:53.289587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e104cc1-6200-4393-9cc8-ed0785966a34 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:53.290046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e104cc1-6200-4393-9cc8-ed0785966a34 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:53.290472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e104cc1-6200-4393-9cc8-ed0785966a34 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:53.424301 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e104cc1-6200-4393-9cc8-ed0785966a34 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:53.433853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e104cc1-6200-4393-9cc8-ed0785966a34 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:53.435325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e104cc1-6200-4393-9cc8-ed0785966a34 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:53.436561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4e104cc1-6200-4393-9cc8-ed0785966a34 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.159863 Oct 28 20:14:53.437101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 724/1442] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:53 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:53.814035 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b7f8f33-62cb-4e81-90d5-ecfc3cb96bf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:53.816529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6b7f8f33-62cb-4e81-90d5-ecfc3cb96bf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:53.823037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b7f8f33-62cb-4e81-90d5-ecfc3cb96bf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:53.823512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b7f8f33-62cb-4e81-90d5-ecfc3cb96bf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:53.823941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b7f8f33-62cb-4e81-90d5-ecfc3cb96bf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:53.824618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b7f8f33-62cb-4e81-90d5-ecfc3cb96bf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:53.825064 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b7f8f33-62cb-4e81-90d5-ecfc3cb96bf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:53.825533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b7f8f33-62cb-4e81-90d5-ecfc3cb96bf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:53.854700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6b7f8f33-62cb-4e81-90d5-ecfc3cb96bf2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044598 Oct 28 20:14:53.855236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 719/1443] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:53 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:54.463620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7ae06e18-26de-43d6-9fea-f549e7eaa3df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:54.464240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7ae06e18-26de-43d6-9fea-f549e7eaa3df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:54.470819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae06e18-26de-43d6-9fea-f549e7eaa3df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:54.471309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae06e18-26de-43d6-9fea-f549e7eaa3df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:54.471754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae06e18-26de-43d6-9fea-f549e7eaa3df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:54.472444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae06e18-26de-43d6-9fea-f549e7eaa3df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:54.472903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae06e18-26de-43d6-9fea-f549e7eaa3df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:54.473347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae06e18-26de-43d6-9fea-f549e7eaa3df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:54.478118 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:54.602267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7ae06e18-26de-43d6-9fea-f549e7eaa3df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:54.610984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7ae06e18-26de-43d6-9fea-f549e7eaa3df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:54.617153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7ae06e18-26de-43d6-9fea-f549e7eaa3df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:54.617153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7ae06e18-26de-43d6-9fea-f549e7eaa3df tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.154908 Oct 28 20:14:54.617153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 725/1444] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:54 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:54.867474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b7a4a85-84a7-4a48-aecc-6a46cd9aeac5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:54.869609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b7a4a85-84a7-4a48-aecc-6a46cd9aeac5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:54.875720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b7a4a85-84a7-4a48-aecc-6a46cd9aeac5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:54.876201 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b7a4a85-84a7-4a48-aecc-6a46cd9aeac5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:54.876637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b7a4a85-84a7-4a48-aecc-6a46cd9aeac5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:54.877348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b7a4a85-84a7-4a48-aecc-6a46cd9aeac5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:54.877794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b7a4a85-84a7-4a48-aecc-6a46cd9aeac5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:54.878219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b7a4a85-84a7-4a48-aecc-6a46cd9aeac5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:54.894887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:54.907485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b7a4a85-84a7-4a48-aecc-6a46cd9aeac5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044625 Oct 28 20:14:54.908032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 720/1445] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:54 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:55.640561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9a4cd05-ece3-4e83-a493-384059964e23 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:55.641171 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f9a4cd05-ece3-4e83-a493-384059964e23 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:55.647585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9a4cd05-ece3-4e83-a493-384059964e23 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:55.648069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9a4cd05-ece3-4e83-a493-384059964e23 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:55.648507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9a4cd05-ece3-4e83-a493-384059964e23 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:55.649190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9a4cd05-ece3-4e83-a493-384059964e23 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:55.649674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9a4cd05-ece3-4e83-a493-384059964e23 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:55.650096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9a4cd05-ece3-4e83-a493-384059964e23 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:55.787587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f9a4cd05-ece3-4e83-a493-384059964e23 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:55.791817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f9a4cd05-ece3-4e83-a493-384059964e23 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:55.793240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f9a4cd05-ece3-4e83-a493-384059964e23 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:55.794440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f9a4cd05-ece3-4e83-a493-384059964e23 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.157898 Oct 28 20:14:55.795001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 726/1446] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:55 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:55.921673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cdd08c5d-991d-48ce-9add-b278ce7d4a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:55.923906 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cdd08c5d-991d-48ce-9add-b278ce7d4a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:55.926433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=60 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:55.932028 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdd08c5d-991d-48ce-9add-b278ce7d4a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:55.932500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdd08c5d-991d-48ce-9add-b278ce7d4a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:55.932929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdd08c5d-991d-48ce-9add-b278ce7d4a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:55.933641 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdd08c5d-991d-48ce-9add-b278ce7d4a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:55.934097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdd08c5d-991d-48ce-9add-b278ce7d4a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:55.934505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdd08c5d-991d-48ce-9add-b278ce7d4a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:55.965236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cdd08c5d-991d-48ce-9add-b278ce7d4a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049018 Oct 28 20:14:55.969621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 721/1447] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:55 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:56.820073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-69db5964-e7a9-451e-af35-f7e8e55becd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:56.820688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-69db5964-e7a9-451e-af35-f7e8e55becd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:56.827426 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69db5964-e7a9-451e-af35-f7e8e55becd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:56.827907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69db5964-e7a9-451e-af35-f7e8e55becd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:56.828403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69db5964-e7a9-451e-af35-f7e8e55becd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:56.829169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69db5964-e7a9-451e-af35-f7e8e55becd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:56.829595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69db5964-e7a9-451e-af35-f7e8e55becd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:56.830022 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69db5964-e7a9-451e-af35-f7e8e55becd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:56.957942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-69db5964-e7a9-451e-af35-f7e8e55becd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:56.964767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-69db5964-e7a9-451e-af35-f7e8e55becd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:56.966228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-69db5964-e7a9-451e-af35-f7e8e55becd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:56.967375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-69db5964-e7a9-451e-af35-f7e8e55becd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.151544 Oct 28 20:14:56.967928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 727/1448] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:56 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:56.980753 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-78a55b4f-6abf-4add-9ce6-0994816d7f9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:56.982943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-78a55b4f-6abf-4add-9ce6-0994816d7f9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:56.989594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78a55b4f-6abf-4add-9ce6-0994816d7f9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:56.990090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78a55b4f-6abf-4add-9ce6-0994816d7f9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:56.991123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78a55b4f-6abf-4add-9ce6-0994816d7f9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:56.991855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78a55b4f-6abf-4add-9ce6-0994816d7f9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:56.992316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78a55b4f-6abf-4add-9ce6-0994816d7f9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:56.992746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78a55b4f-6abf-4add-9ce6-0994816d7f9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:57.022275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-78a55b4f-6abf-4add-9ce6-0994816d7f9d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045262 Oct 28 20:14:57.022882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 722/1449] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:56 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:14:57.993978 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-90a54dd7-488e-4a5a-b59a-6e98c043cba8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:57.994592 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-90a54dd7-488e-4a5a-b59a-6e98c043cba8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:58.000983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90a54dd7-488e-4a5a-b59a-6e98c043cba8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:58.001575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90a54dd7-488e-4a5a-b59a-6e98c043cba8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:58.002058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90a54dd7-488e-4a5a-b59a-6e98c043cba8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:58.002766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90a54dd7-488e-4a5a-b59a-6e98c043cba8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:58.003219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90a54dd7-488e-4a5a-b59a-6e98c043cba8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:58.003644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90a54dd7-488e-4a5a-b59a-6e98c043cba8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:58.033973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c5accf8c-2ad6-428b-b6dc-8cc7c8016582 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:58.036211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c5accf8c-2ad6-428b-b6dc-8cc7c8016582 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:58.043894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5accf8c-2ad6-428b-b6dc-8cc7c8016582 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:58.044428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5accf8c-2ad6-428b-b6dc-8cc7c8016582 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:58.044867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5accf8c-2ad6-428b-b6dc-8cc7c8016582 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:58.045595 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5accf8c-2ad6-428b-b6dc-8cc7c8016582 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:58.046053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5accf8c-2ad6-428b-b6dc-8cc7c8016582 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:58.046480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5accf8c-2ad6-428b-b6dc-8cc7c8016582 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:58.077258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c5accf8c-2ad6-428b-b6dc-8cc7c8016582 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047192 Oct 28 20:14:58.078056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 723/1450] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:58 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:14:58.133835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-90a54dd7-488e-4a5a-b59a-6e98c043cba8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:58.142545 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-90a54dd7-488e-4a5a-b59a-6e98c043cba8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:58.143988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-90a54dd7-488e-4a5a-b59a-6e98c043cba8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:58.145143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-90a54dd7-488e-4a5a-b59a-6e98c043cba8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.155119 Oct 28 20:14:58.145749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 728/1451] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:57 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:14:59.096054 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-27542358-11c2-453a-b1bd-36f781dd9649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:59.096054 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-27542358-11c2-453a-b1bd-36f781dd9649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:59.100880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27542358-11c2-453a-b1bd-36f781dd9649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:59.101408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27542358-11c2-453a-b1bd-36f781dd9649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:59.101847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27542358-11c2-453a-b1bd-36f781dd9649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:59.102546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27542358-11c2-453a-b1bd-36f781dd9649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:59.103007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27542358-11c2-453a-b1bd-36f781dd9649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:59.103435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27542358-11c2-453a-b1bd-36f781dd9649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:59.136767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-27542358-11c2-453a-b1bd-36f781dd9649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050604 Oct 28 20:14:59.137362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 724/1452] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:59 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:59.171622 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8f6b33e7-2fd6-43e1-8684-c5887ac3efae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:59.172628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8f6b33e7-2fd6-43e1-8684-c5887ac3efae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:59.179290 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f6b33e7-2fd6-43e1-8684-c5887ac3efae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:59.179845 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f6b33e7-2fd6-43e1-8684-c5887ac3efae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:59.180295 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f6b33e7-2fd6-43e1-8684-c5887ac3efae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:59.180992 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f6b33e7-2fd6-43e1-8684-c5887ac3efae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:59.181479 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f6b33e7-2fd6-43e1-8684-c5887ac3efae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:59.181912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f6b33e7-2fd6-43e1-8684-c5887ac3efae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:59.310274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8f6b33e7-2fd6-43e1-8684-c5887ac3efae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:59.318722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8f6b33e7-2fd6-43e1-8684-c5887ac3efae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:59.320162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8f6b33e7-2fd6-43e1-8684-c5887ac3efae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:59.321312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8f6b33e7-2fd6-43e1-8684-c5887ac3efae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.153632 Oct 28 20:14:59.321887 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 729/1453] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:14:59 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:00.149543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-affd9dcd-7539-442d-b038-98b23a4d4a79 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:00.151695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-affd9dcd-7539-442d-b038-98b23a4d4a79 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:00.157960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-affd9dcd-7539-442d-b038-98b23a4d4a79 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:00.158438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-affd9dcd-7539-442d-b038-98b23a4d4a79 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:00.158867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-affd9dcd-7539-442d-b038-98b23a4d4a79 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:00.159546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-affd9dcd-7539-442d-b038-98b23a4d4a79 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:00.159991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-affd9dcd-7539-442d-b038-98b23a4d4a79 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:00.160407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-affd9dcd-7539-442d-b038-98b23a4d4a79 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:00.189085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-affd9dcd-7539-442d-b038-98b23a4d4a79 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Oct 28 20:15:00.189675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 725/1454] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:00 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:00.347419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-11aa3c77-6938-493d-9567-54c703a34f32 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:00.348037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-11aa3c77-6938-493d-9567-54c703a34f32 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:00.354862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11aa3c77-6938-493d-9567-54c703a34f32 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:00.355349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11aa3c77-6938-493d-9567-54c703a34f32 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:00.355792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11aa3c77-6938-493d-9567-54c703a34f32 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:00.356483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11aa3c77-6938-493d-9567-54c703a34f32 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:00.356939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11aa3c77-6938-493d-9567-54c703a34f32 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:00.357394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11aa3c77-6938-493d-9567-54c703a34f32 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:00.485785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-11aa3c77-6938-493d-9567-54c703a34f32 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:00.494846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-11aa3c77-6938-493d-9567-54c703a34f32 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:00.496269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-11aa3c77-6938-493d-9567-54c703a34f32 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:00.497508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-11aa3c77-6938-493d-9567-54c703a34f32 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.153965 Oct 28 20:15:00.498057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 730/1455] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:00 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:01.202591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3aa4fa70-d8bd-4e11-b19e-1aacce0c5345 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:01.204718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3aa4fa70-d8bd-4e11-b19e-1aacce0c5345 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:01.212051 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa4fa70-d8bd-4e11-b19e-1aacce0c5345 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:01.212530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa4fa70-d8bd-4e11-b19e-1aacce0c5345 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:01.212961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa4fa70-d8bd-4e11-b19e-1aacce0c5345 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:01.213680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa4fa70-d8bd-4e11-b19e-1aacce0c5345 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:01.214133 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa4fa70-d8bd-4e11-b19e-1aacce0c5345 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:01.214554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa4fa70-d8bd-4e11-b19e-1aacce0c5345 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:01.242694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3aa4fa70-d8bd-4e11-b19e-1aacce0c5345 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044153 Oct 28 20:15:01.243279 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 726/1456] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:01 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:01.523706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe256a56-ffb7-4110-abe7-70906c5eea8c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:01.524310 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fe256a56-ffb7-4110-abe7-70906c5eea8c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:01.530641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe256a56-ffb7-4110-abe7-70906c5eea8c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:01.531118 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe256a56-ffb7-4110-abe7-70906c5eea8c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:01.531549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe256a56-ffb7-4110-abe7-70906c5eea8c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:01.532226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe256a56-ffb7-4110-abe7-70906c5eea8c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:01.532674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe256a56-ffb7-4110-abe7-70906c5eea8c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:01.533093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe256a56-ffb7-4110-abe7-70906c5eea8c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:01.664091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fe256a56-ffb7-4110-abe7-70906c5eea8c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:01.672648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fe256a56-ffb7-4110-abe7-70906c5eea8c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:01.674134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fe256a56-ffb7-4110-abe7-70906c5eea8c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:01.675281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fe256a56-ffb7-4110-abe7-70906c5eea8c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.156437 Oct 28 20:15:01.675927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 731/1457] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:01 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:02.255377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e11005c7-dd36-4101-9d7f-86a0f88666dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:02.258078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e11005c7-dd36-4101-9d7f-86a0f88666dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:02.264363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e11005c7-dd36-4101-9d7f-86a0f88666dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:02.264847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e11005c7-dd36-4101-9d7f-86a0f88666dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:02.265289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e11005c7-dd36-4101-9d7f-86a0f88666dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:02.266002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e11005c7-dd36-4101-9d7f-86a0f88666dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:02.266457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e11005c7-dd36-4101-9d7f-86a0f88666dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:02.266881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e11005c7-dd36-4101-9d7f-86a0f88666dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:02.296768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e11005c7-dd36-4101-9d7f-86a0f88666dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045347 Oct 28 20:15:02.297245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 727/1458] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:02 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:02.702084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-01f1fcb4-be31-4c84-b8a7-2be819eae60f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:02.702695 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-01f1fcb4-be31-4c84-b8a7-2be819eae60f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:02.710000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01f1fcb4-be31-4c84-b8a7-2be819eae60f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:02.710484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01f1fcb4-be31-4c84-b8a7-2be819eae60f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:02.710919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01f1fcb4-be31-4c84-b8a7-2be819eae60f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:02.711606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01f1fcb4-be31-4c84-b8a7-2be819eae60f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:02.712062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01f1fcb4-be31-4c84-b8a7-2be819eae60f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:02.712483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01f1fcb4-be31-4c84-b8a7-2be819eae60f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:02.848333 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-01f1fcb4-be31-4c84-b8a7-2be819eae60f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:02.857419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-01f1fcb4-be31-4c84-b8a7-2be819eae60f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:02.858873 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-01f1fcb4-be31-4c84-b8a7-2be819eae60f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:02.860048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-01f1fcb4-be31-4c84-b8a7-2be819eae60f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.161901 Oct 28 20:15:02.860595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 732/1459] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:02 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:03.309924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c6be0aec-7579-4c05-ac54-0edd3f166440 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:03.311964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c6be0aec-7579-4c05-ac54-0edd3f166440 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:03.319094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6be0aec-7579-4c05-ac54-0edd3f166440 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:03.319573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6be0aec-7579-4c05-ac54-0edd3f166440 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:03.320034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6be0aec-7579-4c05-ac54-0edd3f166440 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:03.320715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6be0aec-7579-4c05-ac54-0edd3f166440 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:03.321160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6be0aec-7579-4c05-ac54-0edd3f166440 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:03.321605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6be0aec-7579-4c05-ac54-0edd3f166440 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:03.351293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c6be0aec-7579-4c05-ac54-0edd3f166440 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045464 Oct 28 20:15:03.351855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 728/1460] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:03 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:15:03.885559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-73ab723e-6544-437f-b663-6ba3b0ca970f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:03.886176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-73ab723e-6544-437f-b663-6ba3b0ca970f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:03.892467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73ab723e-6544-437f-b663-6ba3b0ca970f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:03.892943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73ab723e-6544-437f-b663-6ba3b0ca970f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:03.893415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73ab723e-6544-437f-b663-6ba3b0ca970f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:03.894120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73ab723e-6544-437f-b663-6ba3b0ca970f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:03.894567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73ab723e-6544-437f-b663-6ba3b0ca970f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:03.894997 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73ab723e-6544-437f-b663-6ba3b0ca970f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:04.027260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-73ab723e-6544-437f-b663-6ba3b0ca970f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:04.046352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-73ab723e-6544-437f-b663-6ba3b0ca970f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:04.047820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-73ab723e-6544-437f-b663-6ba3b0ca970f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:04.048984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-73ab723e-6544-437f-b663-6ba3b0ca970f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.167796 Oct 28 20:15:04.049566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 733/1461] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:03 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:04.363546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-70972322-56b6-4378-ae82-8d7bd716cd5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:04.366542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-70972322-56b6-4378-ae82-8d7bd716cd5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:04.372859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70972322-56b6-4378-ae82-8d7bd716cd5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:04.373364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70972322-56b6-4378-ae82-8d7bd716cd5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:04.373852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70972322-56b6-4378-ae82-8d7bd716cd5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:04.374491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70972322-56b6-4378-ae82-8d7bd716cd5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:04.374953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70972322-56b6-4378-ae82-8d7bd716cd5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:04.375375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70972322-56b6-4378-ae82-8d7bd716cd5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:04.403545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-70972322-56b6-4378-ae82-8d7bd716cd5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Oct 28 20:15:04.404087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 729/1462] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:04 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:05.075029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-811fdc49-1bfe-4909-bfe4-edb86488038a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:05.075875 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-811fdc49-1bfe-4909-bfe4-edb86488038a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:05.082388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-811fdc49-1bfe-4909-bfe4-edb86488038a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:05.082877 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-811fdc49-1bfe-4909-bfe4-edb86488038a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:05.083320 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-811fdc49-1bfe-4909-bfe4-edb86488038a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:05.085025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-811fdc49-1bfe-4909-bfe4-edb86488038a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:05.085755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-811fdc49-1bfe-4909-bfe4-edb86488038a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:05.086286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-811fdc49-1bfe-4909-bfe4-edb86488038a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:05.220442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-811fdc49-1bfe-4909-bfe4-edb86488038a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:05.229179 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-811fdc49-1bfe-4909-bfe4-edb86488038a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:05.230667 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-811fdc49-1bfe-4909-bfe4-edb86488038a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:05.231810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-811fdc49-1bfe-4909-bfe4-edb86488038a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.160806 Oct 28 20:15:05.232360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 734/1463] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:05 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:05.415711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3771b385-9caf-4e14-8aa7-4dbdb2936fdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:05.417902 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3771b385-9caf-4e14-8aa7-4dbdb2936fdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:05.424194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3771b385-9caf-4e14-8aa7-4dbdb2936fdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:05.424672 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3771b385-9caf-4e14-8aa7-4dbdb2936fdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:05.425104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3771b385-9caf-4e14-8aa7-4dbdb2936fdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:05.425814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3771b385-9caf-4e14-8aa7-4dbdb2936fdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:05.426265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3771b385-9caf-4e14-8aa7-4dbdb2936fdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:05.426685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3771b385-9caf-4e14-8aa7-4dbdb2936fdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:05.456587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3771b385-9caf-4e14-8aa7-4dbdb2936fdd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Oct 28 20:15:05.457178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 730/1464] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:05 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:06.255912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72708f38-b639-496d-9dfe-0e80467fdd11 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:06.256531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-72708f38-b639-496d-9dfe-0e80467fdd11 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:06.262824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72708f38-b639-496d-9dfe-0e80467fdd11 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:06.263302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72708f38-b639-496d-9dfe-0e80467fdd11 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:06.263737 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72708f38-b639-496d-9dfe-0e80467fdd11 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:06.264450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72708f38-b639-496d-9dfe-0e80467fdd11 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:06.264903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72708f38-b639-496d-9dfe-0e80467fdd11 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:06.265348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72708f38-b639-496d-9dfe-0e80467fdd11 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:06.393801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-72708f38-b639-496d-9dfe-0e80467fdd11 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:06.402676 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-72708f38-b639-496d-9dfe-0e80467fdd11 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:06.404123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-72708f38-b639-496d-9dfe-0e80467fdd11 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:06.405275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-72708f38-b639-496d-9dfe-0e80467fdd11 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.153354 Oct 28 20:15:06.405863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 735/1465] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:06 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:06.469721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f1efa273-da9c-4fa4-b679-e1e6e728a597 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:06.471857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f1efa273-da9c-4fa4-b679-e1e6e728a597 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:06.478389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efa273-da9c-4fa4-b679-e1e6e728a597 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:06.478804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efa273-da9c-4fa4-b679-e1e6e728a597 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:06.479228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efa273-da9c-4fa4-b679-e1e6e728a597 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:06.479901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efa273-da9c-4fa4-b679-e1e6e728a597 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:06.480343 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efa273-da9c-4fa4-b679-e1e6e728a597 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:06.480761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efa273-da9c-4fa4-b679-e1e6e728a597 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:06.510051 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f1efa273-da9c-4fa4-b679-e1e6e728a597 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044275 Oct 28 20:15:06.510633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 731/1466] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:06 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:07.430997 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6cde983f-9ba8-41fa-a6c4-3f227cb7bbd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:07.431605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6cde983f-9ba8-41fa-a6c4-3f227cb7bbd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:07.437973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cde983f-9ba8-41fa-a6c4-3f227cb7bbd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:07.438455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cde983f-9ba8-41fa-a6c4-3f227cb7bbd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:07.438884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cde983f-9ba8-41fa-a6c4-3f227cb7bbd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:07.439567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cde983f-9ba8-41fa-a6c4-3f227cb7bbd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:07.440020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cde983f-9ba8-41fa-a6c4-3f227cb7bbd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:07.440442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cde983f-9ba8-41fa-a6c4-3f227cb7bbd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:07.523299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ad4f1c40-bb01-4c3e-8827-64fdc3ed7b5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:07.525531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ad4f1c40-bb01-4c3e-8827-64fdc3ed7b5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:07.532237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad4f1c40-bb01-4c3e-8827-64fdc3ed7b5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:07.532716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad4f1c40-bb01-4c3e-8827-64fdc3ed7b5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:07.533151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad4f1c40-bb01-4c3e-8827-64fdc3ed7b5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:07.533885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad4f1c40-bb01-4c3e-8827-64fdc3ed7b5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:07.534335 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad4f1c40-bb01-4c3e-8827-64fdc3ed7b5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:07.534757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad4f1c40-bb01-4c3e-8827-64fdc3ed7b5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:07.564617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ad4f1c40-bb01-4c3e-8827-64fdc3ed7b5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045951 Oct 28 20:15:07.565092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 732/1467] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:07 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:15:07.571598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6cde983f-9ba8-41fa-a6c4-3f227cb7bbd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:07.580122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6cde983f-9ba8-41fa-a6c4-3f227cb7bbd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:07.581580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6cde983f-9ba8-41fa-a6c4-3f227cb7bbd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:07.582731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6cde983f-9ba8-41fa-a6c4-3f227cb7bbd5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.155642 Oct 28 20:15:07.583275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 736/1468] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:07 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:08.577599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-50b5c2a9-fae4-4a35-9c71-3bbc5415bc59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:08.579684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-50b5c2a9-fae4-4a35-9c71-3bbc5415bc59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:08.586696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50b5c2a9-fae4-4a35-9c71-3bbc5415bc59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:08.587182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50b5c2a9-fae4-4a35-9c71-3bbc5415bc59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:08.587621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50b5c2a9-fae4-4a35-9c71-3bbc5415bc59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:08.588312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50b5c2a9-fae4-4a35-9c71-3bbc5415bc59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:08.588767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50b5c2a9-fae4-4a35-9c71-3bbc5415bc59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:08.589192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50b5c2a9-fae4-4a35-9c71-3bbc5415bc59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:08.607864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ac8f1df1-2962-4077-94c7-6f0c73017e0f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:08.608485 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ac8f1df1-2962-4077-94c7-6f0c73017e0f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:08.614741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac8f1df1-2962-4077-94c7-6f0c73017e0f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:08.615730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac8f1df1-2962-4077-94c7-6f0c73017e0f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:08.616162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac8f1df1-2962-4077-94c7-6f0c73017e0f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:08.616846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac8f1df1-2962-4077-94c7-6f0c73017e0f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:08.617287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac8f1df1-2962-4077-94c7-6f0c73017e0f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:08.617727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac8f1df1-2962-4077-94c7-6f0c73017e0f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:08.618787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-50b5c2a9-fae4-4a35-9c71-3bbc5415bc59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045205 Oct 28 20:15:08.619356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 733/1469] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:08 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:08.746401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac8f1df1-2962-4077-94c7-6f0c73017e0f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:08.755065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac8f1df1-2962-4077-94c7-6f0c73017e0f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:08.756611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac8f1df1-2962-4077-94c7-6f0c73017e0f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:08.757797 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ac8f1df1-2962-4077-94c7-6f0c73017e0f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.153757 Oct 28 20:15:08.758358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 737/1470] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:08 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:09.631082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f114f80-3bf5-4af6-a7fe-d83a4e8f840f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:09.633410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0f114f80-3bf5-4af6-a7fe-d83a4e8f840f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:09.639758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f114f80-3bf5-4af6-a7fe-d83a4e8f840f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:09.640236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f114f80-3bf5-4af6-a7fe-d83a4e8f840f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:09.640665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f114f80-3bf5-4af6-a7fe-d83a4e8f840f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:09.641367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f114f80-3bf5-4af6-a7fe-d83a4e8f840f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:09.641823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f114f80-3bf5-4af6-a7fe-d83a4e8f840f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:09.642272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f114f80-3bf5-4af6-a7fe-d83a4e8f840f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:09.671135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0f114f80-3bf5-4af6-a7fe-d83a4e8f840f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Oct 28 20:15:09.671674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 734/1471] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:09 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:09.783099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ad184ca7-a759-450c-843c-21699ccfe857 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:09.783709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ad184ca7-a759-450c-843c-21699ccfe857 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:09.790170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad184ca7-a759-450c-843c-21699ccfe857 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:09.790650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad184ca7-a759-450c-843c-21699ccfe857 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:09.791084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad184ca7-a759-450c-843c-21699ccfe857 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:09.791759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad184ca7-a759-450c-843c-21699ccfe857 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:09.792203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad184ca7-a759-450c-843c-21699ccfe857 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:09.792620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad184ca7-a759-450c-843c-21699ccfe857 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:09.922813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ad184ca7-a759-450c-843c-21699ccfe857 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:09.931929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ad184ca7-a759-450c-843c-21699ccfe857 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:09.933403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ad184ca7-a759-450c-843c-21699ccfe857 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:09.934557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ad184ca7-a759-450c-843c-21699ccfe857 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.155282 Oct 28 20:15:09.935111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 738/1472] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:09 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:10.683149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4662a667-f4fd-4e94-9f8e-f0937b5a6340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:10.685292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4662a667-f4fd-4e94-9f8e-f0937b5a6340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:10.691599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4662a667-f4fd-4e94-9f8e-f0937b5a6340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:10.692081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4662a667-f4fd-4e94-9f8e-f0937b5a6340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:10.692522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4662a667-f4fd-4e94-9f8e-f0937b5a6340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:10.693208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4662a667-f4fd-4e94-9f8e-f0937b5a6340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:10.693687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4662a667-f4fd-4e94-9f8e-f0937b5a6340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:10.694106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4662a667-f4fd-4e94-9f8e-f0937b5a6340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:10.723901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4662a667-f4fd-4e94-9f8e-f0937b5a6340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Oct 28 20:15:10.725251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 735/1473] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:10 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:10.960828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc636c91-8ae8-4cc9-8552-d469022228a5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:10.961489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fc636c91-8ae8-4cc9-8552-d469022228a5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:10.967840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc636c91-8ae8-4cc9-8552-d469022228a5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:10.968321 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc636c91-8ae8-4cc9-8552-d469022228a5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:10.968763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc636c91-8ae8-4cc9-8552-d469022228a5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:10.969478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc636c91-8ae8-4cc9-8552-d469022228a5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:10.969935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc636c91-8ae8-4cc9-8552-d469022228a5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:10.970365 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc636c91-8ae8-4cc9-8552-d469022228a5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:11.097744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fc636c91-8ae8-4cc9-8552-d469022228a5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:11.106438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fc636c91-8ae8-4cc9-8552-d469022228a5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:11.107888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fc636c91-8ae8-4cc9-8552-d469022228a5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:11.109052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fc636c91-8ae8-4cc9-8552-d469022228a5 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.152801 Oct 28 20:15:11.109655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 739/1474] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:10 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:11.737671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b4c119b7-17ca-430e-a04a-798cd1e33289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:11.740475 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b4c119b7-17ca-430e-a04a-798cd1e33289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:11.746858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4c119b7-17ca-430e-a04a-798cd1e33289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:11.747333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4c119b7-17ca-430e-a04a-798cd1e33289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:11.747767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4c119b7-17ca-430e-a04a-798cd1e33289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:11.748442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4c119b7-17ca-430e-a04a-798cd1e33289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:11.748890 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4c119b7-17ca-430e-a04a-798cd1e33289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:11.749303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4c119b7-17ca-430e-a04a-798cd1e33289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:11.778399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b4c119b7-17ca-430e-a04a-798cd1e33289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044694 Oct 28 20:15:11.778943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 736/1475] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:11 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:12.134602 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1643ef0-65aa-4946-93a9-d0c19a0a9b12 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:12.135208 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f1643ef0-65aa-4946-93a9-d0c19a0a9b12 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:12.141558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1643ef0-65aa-4946-93a9-d0c19a0a9b12 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:12.142041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1643ef0-65aa-4946-93a9-d0c19a0a9b12 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:12.142478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1643ef0-65aa-4946-93a9-d0c19a0a9b12 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:12.143160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1643ef0-65aa-4946-93a9-d0c19a0a9b12 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:12.143618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1643ef0-65aa-4946-93a9-d0c19a0a9b12 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:12.144039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1643ef0-65aa-4946-93a9-d0c19a0a9b12 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:12.268945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1643ef0-65aa-4946-93a9-d0c19a0a9b12 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:12.277950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1643ef0-65aa-4946-93a9-d0c19a0a9b12 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:12.279382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1643ef0-65aa-4946-93a9-d0c19a0a9b12 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:12.280542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1643ef0-65aa-4946-93a9-d0c19a0a9b12 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.149842 Oct 28 20:15:12.281100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 740/1476] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:12 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:12.791086 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3245f6d-d058-477b-84c8-96f5a7ded33a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:12.793248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b3245f6d-d058-477b-84c8-96f5a7ded33a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:12.799532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3245f6d-d058-477b-84c8-96f5a7ded33a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:12.800035 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3245f6d-d058-477b-84c8-96f5a7ded33a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:12.800464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3245f6d-d058-477b-84c8-96f5a7ded33a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:12.801143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3245f6d-d058-477b-84c8-96f5a7ded33a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:12.801618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3245f6d-d058-477b-84c8-96f5a7ded33a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:12.802036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3245f6d-d058-477b-84c8-96f5a7ded33a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:12.806157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:12.831852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b3245f6d-d058-477b-84c8-96f5a7ded33a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045017 Oct 28 20:15:12.832414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 737/1477] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:12 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:13.310755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-04a38b18-64c4-4176-aefd-cc708acb77f6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:13.310755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-04a38b18-64c4-4176-aefd-cc708acb77f6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:13.313829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04a38b18-64c4-4176-aefd-cc708acb77f6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:13.314315 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04a38b18-64c4-4176-aefd-cc708acb77f6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:13.314754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04a38b18-64c4-4176-aefd-cc708acb77f6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:13.315441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04a38b18-64c4-4176-aefd-cc708acb77f6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:13.315898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04a38b18-64c4-4176-aefd-cc708acb77f6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:13.316412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04a38b18-64c4-4176-aefd-cc708acb77f6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:13.448795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-04a38b18-64c4-4176-aefd-cc708acb77f6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:13.452120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:13.457491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-04a38b18-64c4-4176-aefd-cc708acb77f6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:13.459472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-04a38b18-64c4-4176-aefd-cc708acb77f6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:13.460668 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-04a38b18-64c4-4176-aefd-cc708acb77f6 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.158775 Oct 28 20:15:13.461249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 741/1478] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:13 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:13.845847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c96324bf-a5c6-4ce8-adb5-fe8976db565a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:13.847937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c96324bf-a5c6-4ce8-adb5-fe8976db565a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:13.854937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c96324bf-a5c6-4ce8-adb5-fe8976db565a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:13.855412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c96324bf-a5c6-4ce8-adb5-fe8976db565a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:13.855846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c96324bf-a5c6-4ce8-adb5-fe8976db565a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:13.856521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c96324bf-a5c6-4ce8-adb5-fe8976db565a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:13.856971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c96324bf-a5c6-4ce8-adb5-fe8976db565a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:13.857422 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c96324bf-a5c6-4ce8-adb5-fe8976db565a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:13.885242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c96324bf-a5c6-4ce8-adb5-fe8976db565a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043881 Oct 28 20:15:13.885814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 738/1479] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:13 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:14.489099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-28bf2473-1e6b-4aa8-88ce-1bfdb2d44bd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:14.490331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-28bf2473-1e6b-4aa8-88ce-1bfdb2d44bd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:14.496837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28bf2473-1e6b-4aa8-88ce-1bfdb2d44bd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:14.497338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28bf2473-1e6b-4aa8-88ce-1bfdb2d44bd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:14.497783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28bf2473-1e6b-4aa8-88ce-1bfdb2d44bd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:14.498469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28bf2473-1e6b-4aa8-88ce-1bfdb2d44bd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:14.498923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28bf2473-1e6b-4aa8-88ce-1bfdb2d44bd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:14.499352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28bf2473-1e6b-4aa8-88ce-1bfdb2d44bd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:14.629809 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-28bf2473-1e6b-4aa8-88ce-1bfdb2d44bd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:14.639394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-28bf2473-1e6b-4aa8-88ce-1bfdb2d44bd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:14.640892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-28bf2473-1e6b-4aa8-88ce-1bfdb2d44bd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:14.642043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-28bf2473-1e6b-4aa8-88ce-1bfdb2d44bd1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.157225 Oct 28 20:15:14.642638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 742/1480] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:14 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:14.898348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c35e5fd1-c5e5-4cb7-aa4c-3267a19410f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:14.900496 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c35e5fd1-c5e5-4cb7-aa4c-3267a19410f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:14.906837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c35e5fd1-c5e5-4cb7-aa4c-3267a19410f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:14.907319 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c35e5fd1-c5e5-4cb7-aa4c-3267a19410f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:14.907756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c35e5fd1-c5e5-4cb7-aa4c-3267a19410f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:14.908445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c35e5fd1-c5e5-4cb7-aa4c-3267a19410f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:14.908901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c35e5fd1-c5e5-4cb7-aa4c-3267a19410f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:14.909346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c35e5fd1-c5e5-4cb7-aa4c-3267a19410f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:14.937713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c35e5fd1-c5e5-4cb7-aa4c-3267a19410f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Oct 28 20:15:14.938268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 739/1481] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:14 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:15.668794 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9c6bf111-b737-4510-b648-25f7986b2b02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:15.669353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9c6bf111-b737-4510-b648-25f7986b2b02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:15.675685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c6bf111-b737-4510-b648-25f7986b2b02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:15.676164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c6bf111-b737-4510-b648-25f7986b2b02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:15.676599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c6bf111-b737-4510-b648-25f7986b2b02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:15.678328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c6bf111-b737-4510-b648-25f7986b2b02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:15.678551 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c6bf111-b737-4510-b648-25f7986b2b02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:15.678974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c6bf111-b737-4510-b648-25f7986b2b02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:15.820285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9c6bf111-b737-4510-b648-25f7986b2b02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:15.828863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9c6bf111-b737-4510-b648-25f7986b2b02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:15.830427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9c6bf111-b737-4510-b648-25f7986b2b02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:15.831611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9c6bf111-b737-4510-b648-25f7986b2b02 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.166764 Oct 28 20:15:15.832160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 743/1482] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:15 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:15.949947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-57f5e23d-fc70-4f34-8324-c3dce668a0a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:15.952144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-57f5e23d-fc70-4f34-8324-c3dce668a0a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:15.959539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57f5e23d-fc70-4f34-8324-c3dce668a0a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:15.960224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57f5e23d-fc70-4f34-8324-c3dce668a0a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:15.960658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57f5e23d-fc70-4f34-8324-c3dce668a0a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:15.961391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57f5e23d-fc70-4f34-8324-c3dce668a0a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:15.961845 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57f5e23d-fc70-4f34-8324-c3dce668a0a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:15.962266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57f5e23d-fc70-4f34-8324-c3dce668a0a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:15.991234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-57f5e23d-fc70-4f34-8324-c3dce668a0a1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045184 Oct 28 20:15:15.991775 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 740/1483] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:15 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:16.860154 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2764395-fcd6-435e-8e8c-d421bb1296c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:16.860776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2764395-fcd6-435e-8e8c-d421bb1296c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:16.867386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2764395-fcd6-435e-8e8c-d421bb1296c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:16.867876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2764395-fcd6-435e-8e8c-d421bb1296c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:16.868317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2764395-fcd6-435e-8e8c-d421bb1296c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:16.869056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2764395-fcd6-435e-8e8c-d421bb1296c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:16.869541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2764395-fcd6-435e-8e8c-d421bb1296c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:16.869970 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2764395-fcd6-435e-8e8c-d421bb1296c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:17.004837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2764395-fcd6-435e-8e8c-d421bb1296c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:17.014341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2764395-fcd6-435e-8e8c-d421bb1296c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:17.014654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-16bc18f7-a360-4b89-927f-d8dd0ff9ce9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:17.016720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2764395-fcd6-435e-8e8c-d421bb1296c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:17.016868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-16bc18f7-a360-4b89-927f-d8dd0ff9ce9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:17.018279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2764395-fcd6-435e-8e8c-d421bb1296c2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 200 len: 1747 microversion: 2.20 time: 0.162982 Oct 28 20:15:17.018839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 744/1484] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:16 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:17.029170 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16bc18f7-a360-4b89-927f-d8dd0ff9ce9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:17.029964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16bc18f7-a360-4b89-927f-d8dd0ff9ce9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:17.030615 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16bc18f7-a360-4b89-927f-d8dd0ff9ce9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:17.031539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16bc18f7-a360-4b89-927f-d8dd0ff9ce9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:17.032250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16bc18f7-a360-4b89-927f-d8dd0ff9ce9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:17.032889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16bc18f7-a360-4b89-927f-d8dd0ff9ce9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:17.065347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-16bc18f7-a360-4b89-927f-d8dd0ff9ce9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066197 Oct 28 20:15:17.065914 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 741/1485] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:16 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:17.102926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75025d23-7070-42ea-833a-7b47dcc7719a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:17.103457 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-75025d23-7070-42ea-833a-7b47dcc7719a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:17.109278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75025d23-7070-42ea-833a-7b47dcc7719a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:17.109786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75025d23-7070-42ea-833a-7b47dcc7719a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:17.110220 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75025d23-7070-42ea-833a-7b47dcc7719a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:17.110905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75025d23-7070-42ea-833a-7b47dcc7719a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:17.111358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75025d23-7070-42ea-833a-7b47dcc7719a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:17.111784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75025d23-7070-42ea-833a-7b47dcc7719a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:17.711031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-75025d23-7070-42ea-833a-7b47dcc7719a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57/os-volume_attachments/5cbc4e4c-a39f-49e5-bfe0-4d1a49eac1d2" status: 202 len: 0 microversion: 2.20 time: 0.612677 Oct 28 20:15:17.711682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 745/1486] 10.222.0.66 () {60 vars in 1457 bytes} [Fri Oct 28 20:15:17 2022] DELETE /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57/os-volume_attachments/5cbc4e4c-a39f-49e5-bfe0-4d1a49eac1d2 => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:15:17.720086 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3eb417e5-3f98-44b5-bdab-cd5c8fe632ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:17.722272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3eb417e5-3f98-44b5-bdab-cd5c8fe632ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:17.728814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3eb417e5-3f98-44b5-bdab-cd5c8fe632ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:17.729299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3eb417e5-3f98-44b5-bdab-cd5c8fe632ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:17.729884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3eb417e5-3f98-44b5-bdab-cd5c8fe632ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:17.730744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3eb417e5-3f98-44b5-bdab-cd5c8fe632ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:17.731204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3eb417e5-3f98-44b5-bdab-cd5c8fe632ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:17.731630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3eb417e5-3f98-44b5-bdab-cd5c8fe632ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:17.761171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3eb417e5-3f98-44b5-bdab-cd5c8fe632ae tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045177 Oct 28 20:15:17.761749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 742/1487] 10.222.0.66 () {60 vars in 1343 bytes} [Fri Oct 28 20:15:17 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:17.825058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:17.825597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:17.831534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:17.832018 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:17.832461 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:17.833153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:17.834472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:17.834935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:17.861484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:15:17.868025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.compute.api [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Working on deleting snapshot 18b120c3-b4da-40f9-9a27-02dd7f39a50b from shelved instance... Oct 28 20:15:18.077643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0656195c-77c7-4efd-9eb9-864234d566f8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:18.079860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0656195c-77c7-4efd-9eb9-864234d566f8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:18.086792 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0656195c-77c7-4efd-9eb9-864234d566f8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:18.087272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0656195c-77c7-4efd-9eb9-864234d566f8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:18.087700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0656195c-77c7-4efd-9eb9-864234d566f8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:18.088393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0656195c-77c7-4efd-9eb9-864234d566f8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:18.088836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0656195c-77c7-4efd-9eb9-864234d566f8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:18.089257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0656195c-77c7-4efd-9eb9-864234d566f8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:18.118542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0656195c-77c7-4efd-9eb9-864234d566f8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044813 Oct 28 20:15:18.119105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 743/1488] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:18 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:15:19.001546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Doing local delete in cell 1f77e283-8dfe-4ddd-b40e-e3af731a397f(cell1) {{(pid=119407) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 28 20:15:19.002265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:19.002744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:19.003184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:19.003690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.compute.api [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 28 20:15:19.010935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] deallocate_for_instance() {{(pid=119407) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 28 20:15:19.131459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c396a83d-980b-4a20-8abf-d4f95eab3f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:19.134154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c396a83d-980b-4a20-8abf-d4f95eab3f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:19.140074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c396a83d-980b-4a20-8abf-d4f95eab3f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:19.140557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c396a83d-980b-4a20-8abf-d4f95eab3f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:19.140991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c396a83d-980b-4a20-8abf-d4f95eab3f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:19.141702 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c396a83d-980b-4a20-8abf-d4f95eab3f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:19.142154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c396a83d-980b-4a20-8abf-d4f95eab3f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:19.142572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c396a83d-980b-4a20-8abf-d4f95eab3f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:19.175115 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c396a83d-980b-4a20-8abf-d4f95eab3f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048113 Oct 28 20:15:19.175864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 744/1489] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:19 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:15:20.029307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Updating instance_info_cache with network_info: [] {{(pid=119407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 20:15:20.081267 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-f50a1071-bfd9-4019-ba9f-a423260f310a req-a5a60803-067b-45ae-953a-10099e0335ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7582188f-bfab-4218-9104-9fb384141c57", "name": "network-vif-deleted", "tag": "ade7b021-b99e-4c55-93bb-537d28c2a53d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:15:20.091236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f50a1071-bfd9-4019-ba9f-a423260f310a req-a5a60803-067b-45ae-953a-10099e0335ae service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:20.091722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f50a1071-bfd9-4019-ba9f-a423260f310a req-a5a60803-067b-45ae-953a-10099e0335ae service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:20.092160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f50a1071-bfd9-4019-ba9f-a423260f310a req-a5a60803-067b-45ae-953a-10099e0335ae service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:20.104234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.compute.server_external_events [req-f50a1071-bfd9-4019-ba9f-a423260f310a req-a5a60803-067b-45ae-953a-10099e0335ae service nova] Unable to find a host for instance 7582188f-bfab-4218-9104-9fb384141c57. Dropping event network-vif-deleted {{(pid=119406) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 20:15:20.105119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-f50a1071-bfd9-4019-ba9f-a423260f310a req-a5a60803-067b-45ae-953a-10099e0335ae service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.132759 Oct 28 20:15:20.105735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 745/1490] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 134 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 28 20:15:20.189074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fc4723c9-361f-468f-ae95-5b77c272ba04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:20.191865 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fc4723c9-361f-468f-ae95-5b77c272ba04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:20.198362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc4723c9-361f-468f-ae95-5b77c272ba04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:20.199351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc4723c9-361f-468f-ae95-5b77c272ba04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:20.199893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc4723c9-361f-468f-ae95-5b77c272ba04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:20.200602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc4723c9-361f-468f-ae95-5b77c272ba04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:20.201996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc4723c9-361f-468f-ae95-5b77c272ba04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:20.201996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc4723c9-361f-468f-ae95-5b77c272ba04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:20.235020 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fc4723c9-361f-468f-ae95-5b77c272ba04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050270 Oct 28 20:15:20.240762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 746/1491] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:20 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:20.492001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.scheduler.client.report [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Deleted allocations for instance 7582188f-bfab-4218-9104-9fb384141c57 Oct 28 20:15:20.854608 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d6cc2960-1e3a-416b-b072-2d4f1b886db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 204 len: 0 microversion: 2.20 time: 3.033314 Oct 28 20:15:20.855195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 746/1492] 10.222.0.66 () {60 vars in 1280 bytes} [Fri Oct 28 20:15:17 2022] DELETE /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 0 bytes in 3035 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 20:15:20.863602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cdba07dd-0955-4a37-be5a-c97f1ed6d5ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:20.864203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cdba07dd-0955-4a37-be5a-c97f1ed6d5ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:20.870273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdba07dd-0955-4a37-be5a-c97f1ed6d5ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:20.870877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdba07dd-0955-4a37-be5a-c97f1ed6d5ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:20.871310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdba07dd-0955-4a37-be5a-c97f1ed6d5ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:20.871986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdba07dd-0955-4a37-be5a-c97f1ed6d5ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:20.872431 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdba07dd-0955-4a37-be5a-c97f1ed6d5ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:20.872847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdba07dd-0955-4a37-be5a-c97f1ed6d5ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:20.888029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-cdba07dd-0955-4a37-be5a-c97f1ed6d5ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] HTTP exception thrown: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cdba07dd-0955-4a37-be5a-c97f1ed6d5ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Request method failure captured: Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 HTTP/1.1 Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDYUV_YNM0XXwBBLx-WTdB2tjq5FfUSX5VRsT-xAlZ_e2f17iFR5KGzRqSyIT82YsBG3tEufG_S544gzvHRmKEDqErboY4PRO_Jp3hTpg8bXzg1fr4ePkhDzlMYdYf0HRuRZe5iaTEAu5mcOB7RsQRVC4HQxwtLzgZrAvWmiG9LEcj0 Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 34d30fbe6fa645bd9ea3d88ea5f68449 Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:15:20.889770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:15:20.891609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34d30fbe6fa645bd9ea3d88ea5f68449", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:15:20.891609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:15:20.891609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 34d30fbe6fa645bd9ea3d88ea5f68449 Oct 28 20:15:20.891609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:15:20.891609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-AttachVolumeShelveTestJSON-1907610215-project Oct 28 20:15:20.891609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:15:20.891609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:15:20.891609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: e0ba6bf2459d4a98a3a1f5684bdad2b2 Oct 28 20:15:20.891609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1907610215-project Oct 28 20:15:20.891609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:15:20.891609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. Oct 28 20:15:20.891609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': '7582188f-bfab-4218-9104-9fb384141c57'} Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:15:20.892712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. Oct 28 20:15:20.894010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:15:20.895130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cdba07dd-0955-4a37-be5a-c97f1ed6d5ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Returning 404 to user: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:15:20.895130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cdba07dd-0955-4a37-be5a-c97f1ed6d5ce tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 404 len: 111 microversion: 2.20 time: 0.031515 Oct 28 20:15:20.895130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 747/1493] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:20 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 20:15:20.904823 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5dd977c6-d5d5-4521-8906-5bf26d8f79a2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '.version_select at 0x7f1f50787e50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:20.993876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5dd977c6-d5d5-4521-8906-5bf26d8f79a2 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218580343" status: 204 len: 0 microversion: 2.20 time: 0.093906 Oct 28 20:15:20.994464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 747/1494] 10.222.0.66 () {60 vars in 1262 bytes} [Fri Oct 28 20:15:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218580343 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 20:15:21.248117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f776dad1-70ab-49d1-ac1c-f6e7a2b1be72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:21.250422 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f776dad1-70ab-49d1-ac1c-f6e7a2b1be72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:21.257474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f776dad1-70ab-49d1-ac1c-f6e7a2b1be72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:21.257965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f776dad1-70ab-49d1-ac1c-f6e7a2b1be72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:21.258404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f776dad1-70ab-49d1-ac1c-f6e7a2b1be72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:21.259537 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f776dad1-70ab-49d1-ac1c-f6e7a2b1be72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:21.260012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f776dad1-70ab-49d1-ac1c-f6e7a2b1be72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:21.261526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f776dad1-70ab-49d1-ac1c-f6e7a2b1be72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:21.298379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f776dad1-70ab-49d1-ac1c-f6e7a2b1be72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054218 Oct 28 20:15:21.301443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 748/1495] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:21 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:21.853514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4382b541-264c-462e-bd26-1b3691fef0f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Action: 'create', calling method: .version_select at 0x7f1f50793a60>, body: {"keypair": {"name": "tempest-keypair-453711579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIP7N0148z4ZkecE18BvIXft8kfgsBskrbdaU/1NupnA1JCh8FJh3nrfORcjXeJumo9CVUijwny88unOKgyzwzNwEdmjasZuTzwuJRDbemk3YZGWhGFnRCzL4RCtecU2Iw=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:15:21.859921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:21.870745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-4382b541-264c-462e-bd26-1b3691fef0f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Getting quotas for project 34d30fbe6fa645bd9ea3d88ea5f68449. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:15:21.874465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-4382b541-264c-462e-bd26-1b3691fef0f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Getting quotas for user e0ba6bf2459d4a98a3a1f5684bdad2b2 and project 34d30fbe6fa645bd9ea3d88ea5f68449. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:15:21.962800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4382b541-264c-462e-bd26-1b3691fef0f8 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.113911 Oct 28 20:15:21.963449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 748/1496] 10.222.0.66 () {62 vars in 1200 bytes} [Fri Oct 28 20:15:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 20:15:22.310852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-85d1bfdc-c8a8-4330-b10e-3d0f574b3db3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:22.313061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-85d1bfdc-c8a8-4330-b10e-3d0f574b3db3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:22.320280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85d1bfdc-c8a8-4330-b10e-3d0f574b3db3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:22.320764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85d1bfdc-c8a8-4330-b10e-3d0f574b3db3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:22.321198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85d1bfdc-c8a8-4330-b10e-3d0f574b3db3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:22.321919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85d1bfdc-c8a8-4330-b10e-3d0f574b3db3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:22.322372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85d1bfdc-c8a8-4330-b10e-3d0f574b3db3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:22.322798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85d1bfdc-c8a8-4330-b10e-3d0f574b3db3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:22.354464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-85d1bfdc-c8a8-4330-b10e-3d0f574b3db3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047649 Oct 28 20:15:22.355356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 749/1497] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:22 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:23.367415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b6cda91-5585-4e99-b7da-041013d1d014 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:23.369899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0b6cda91-5585-4e99-b7da-041013d1d014 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:23.377051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b6cda91-5585-4e99-b7da-041013d1d014 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:23.377574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b6cda91-5585-4e99-b7da-041013d1d014 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:23.378006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b6cda91-5585-4e99-b7da-041013d1d014 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:23.378874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b6cda91-5585-4e99-b7da-041013d1d014 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:23.379330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b6cda91-5585-4e99-b7da-041013d1d014 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:23.379754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b6cda91-5585-4e99-b7da-041013d1d014 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:23.414047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0b6cda91-5585-4e99-b7da-041013d1d014 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050976 Oct 28 20:15:23.414623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 749/1498] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:23 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:24.118713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1763605365", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "176b1458-53d0-433d-a820-0c0b0e4c8472"}], "security_groups": [{"name": "tempest-securitygroup--977400953"}], "key_name": "tempest-keypair-453711579", "user_data": "}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:15:24.224248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] validate_networks() for [('176b1458-53d0-433d-a820-0c0b0e4c8472', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:15:24.425981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d9db0805-8072-4309-9b97-243007b95544 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:24.428935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d9db0805-8072-4309-9b97-243007b95544 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:24.436319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9db0805-8072-4309-9b97-243007b95544 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:24.436928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9db0805-8072-4309-9b97-243007b95544 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:24.437492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9db0805-8072-4309-9b97-243007b95544 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:24.438298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9db0805-8072-4309-9b97-243007b95544 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:24.438861 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9db0805-8072-4309-9b97-243007b95544 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:24.439391 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9db0805-8072-4309-9b97-243007b95544 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:24.474066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d9db0805-8072-4309-9b97-243007b95544 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049517 Oct 28 20:15:24.476455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 750/1499] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:24 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:24.681111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:15:24.681570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:15:24.682118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:15:24.682714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:15:24.683135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:15:24.691900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:24.692383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:24.692824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:24.693716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:24.694172 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:24.694607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:24.711614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Getting quotas for project 34d30fbe6fa645bd9ea3d88ea5f68449. Resources: {'instances', 'ram', 'cores'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:15:24.715549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Getting quotas for user e0ba6bf2459d4a98a3a1f5684bdad2b2 and project 34d30fbe6fa645bd9ea3d88ea5f68449. Resources: {'instances', 'ram', 'cores'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:15:24.727807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:15:24.730209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:15:24.853187 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd8ba4a0-b247-448a-811b-8d2fea11e72f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.739943 Oct 28 20:15:24.853872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 750/1500] 10.222.0.66 () {62 vars in 1188 bytes} [Fri Oct 28 20:15:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 20:15:24.865533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-670e6263-dfce-43b1-851c-fe74c4fa60ea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:24.866276 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-670e6263-dfce-43b1-851c-fe74c4fa60ea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:24.970293 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-670e6263-dfce-43b1-851c-fe74c4fa60ea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:24.978258 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-670e6263-dfce-43b1-851c-fe74c4fa60ea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:24.979703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-670e6263-dfce-43b1-851c-fe74c4fa60ea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:24.980802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-670e6263-dfce-43b1-851c-fe74c4fa60ea tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 200 len: 1281 microversion: 2.20 time: 0.119482 Oct 28 20:15:24.981376 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 751/1501] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:24 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 1281 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:25.484774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b4b41fc-b03c-4252-857d-1f2c487f839a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:25.487044 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6b4b41fc-b03c-4252-857d-1f2c487f839a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:25.504178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b4b41fc-b03c-4252-857d-1f2c487f839a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:25.504688 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b4b41fc-b03c-4252-857d-1f2c487f839a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:25.506407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b4b41fc-b03c-4252-857d-1f2c487f839a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:25.506407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b4b41fc-b03c-4252-857d-1f2c487f839a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:25.506866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b4b41fc-b03c-4252-857d-1f2c487f839a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:25.507289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b4b41fc-b03c-4252-857d-1f2c487f839a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:25.539174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6b4b41fc-b03c-4252-857d-1f2c487f839a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058946 Oct 28 20:15:25.543853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 751/1502] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:25 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:26.004689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-03975dad-6d10-47a8-a920-f755fd192b3e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:26.005303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-03975dad-6d10-47a8-a920-f755fd192b3e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:26.012816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03975dad-6d10-47a8-a920-f755fd192b3e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:26.013306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03975dad-6d10-47a8-a920-f755fd192b3e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:26.015224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03975dad-6d10-47a8-a920-f755fd192b3e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:26.015224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03975dad-6d10-47a8-a920-f755fd192b3e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:26.015224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03975dad-6d10-47a8-a920-f755fd192b3e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:26.015540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03975dad-6d10-47a8-a920-f755fd192b3e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:26.076385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-03975dad-6d10-47a8-a920-f755fd192b3e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:26.078564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=2,nova_cell1:UPDATE=20,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:26.085653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-03975dad-6d10-47a8-a920-f755fd192b3e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:26.087110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-03975dad-6d10-47a8-a920-f755fd192b3e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:26.088265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-03975dad-6d10-47a8-a920-f755fd192b3e tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 200 len: 1285 microversion: 2.20 time: 0.087548 Oct 28 20:15:26.088819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 752/1503] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:25 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:26.553222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-046559f2-0c75-48d8-9978-c8cdb0d49ea2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:26.556930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-046559f2-0c75-48d8-9978-c8cdb0d49ea2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:26.563762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-046559f2-0c75-48d8-9978-c8cdb0d49ea2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:26.564321 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-046559f2-0c75-48d8-9978-c8cdb0d49ea2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:26.564827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-046559f2-0c75-48d8-9978-c8cdb0d49ea2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:26.565629 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-046559f2-0c75-48d8-9978-c8cdb0d49ea2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:26.566173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-046559f2-0c75-48d8-9978-c8cdb0d49ea2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:26.566664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-046559f2-0c75-48d8-9978-c8cdb0d49ea2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:26.598790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-046559f2-0c75-48d8-9978-c8cdb0d49ea2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051182 Oct 28 20:15:26.599356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 752/1504] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:26 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:27.114455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bdf69964-eba5-4cd2-89de-5e52169bc024 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:27.115588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bdf69964-eba5-4cd2-89de-5e52169bc024 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:27.123269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdf69964-eba5-4cd2-89de-5e52169bc024 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:27.123752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdf69964-eba5-4cd2-89de-5e52169bc024 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:27.124181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdf69964-eba5-4cd2-89de-5e52169bc024 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:27.124870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdf69964-eba5-4cd2-89de-5e52169bc024 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:27.125311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdf69964-eba5-4cd2-89de-5e52169bc024 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:27.125946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdf69964-eba5-4cd2-89de-5e52169bc024 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:27.192035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bdf69964-eba5-4cd2-89de-5e52169bc024 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:27.200905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bdf69964-eba5-4cd2-89de-5e52169bc024 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:27.202377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bdf69964-eba5-4cd2-89de-5e52169bc024 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:27.203487 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bdf69964-eba5-4cd2-89de-5e52169bc024 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 200 len: 1341 microversion: 2.20 time: 0.093330 Oct 28 20:15:27.204045 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 753/1505] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:27 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 1341 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:27.611781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-337f717c-839c-4d36-807f-490a022105b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:27.614413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-337f717c-839c-4d36-807f-490a022105b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:27.618550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:27.623562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-337f717c-839c-4d36-807f-490a022105b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:27.624051 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-337f717c-839c-4d36-807f-490a022105b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:27.624695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-337f717c-839c-4d36-807f-490a022105b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:27.625435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-337f717c-839c-4d36-807f-490a022105b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:27.625909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-337f717c-839c-4d36-807f-490a022105b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:27.626442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-337f717c-839c-4d36-807f-490a022105b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:27.674289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-337f717c-839c-4d36-807f-490a022105b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066413 Oct 28 20:15:27.678364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 753/1506] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:27 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:28.232446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3becb480-565f-4798-a8aa-9504f8cbe224 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:28.233061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3becb480-565f-4798-a8aa-9504f8cbe224 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:28.240148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3becb480-565f-4798-a8aa-9504f8cbe224 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:28.240704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3becb480-565f-4798-a8aa-9504f8cbe224 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:28.241146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3becb480-565f-4798-a8aa-9504f8cbe224 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:28.241917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3becb480-565f-4798-a8aa-9504f8cbe224 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:28.242371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3becb480-565f-4798-a8aa-9504f8cbe224 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:28.242796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3becb480-565f-4798-a8aa-9504f8cbe224 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:28.374653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3becb480-565f-4798-a8aa-9504f8cbe224 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:28.383581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3becb480-565f-4798-a8aa-9504f8cbe224 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:28.391249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3becb480-565f-4798-a8aa-9504f8cbe224 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:28.391249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3becb480-565f-4798-a8aa-9504f8cbe224 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 200 len: 1406 microversion: 2.20 time: 0.158066 Oct 28 20:15:28.391249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 754/1507] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:28 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:28.689341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-65f19162-7fc8-4cf7-9117-5cc47e9a736a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:28.694871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-65f19162-7fc8-4cf7-9117-5cc47e9a736a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:28.699477 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65f19162-7fc8-4cf7-9117-5cc47e9a736a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:28.700953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65f19162-7fc8-4cf7-9117-5cc47e9a736a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:28.701415 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65f19162-7fc8-4cf7-9117-5cc47e9a736a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:28.702145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65f19162-7fc8-4cf7-9117-5cc47e9a736a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:28.702596 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65f19162-7fc8-4cf7-9117-5cc47e9a736a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:28.703018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65f19162-7fc8-4cf7-9117-5cc47e9a736a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:28.732902 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-65f19162-7fc8-4cf7-9117-5cc47e9a736a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047694 Oct 28 20:15:28.733536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 754/1508] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:28 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:28.789662 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b7e66f61-23e0-4c2e-84bb-5141c5839ba1 req-c7c2de6b-b0eb-41bf-bc16-28d214d9cf16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a0384e-d0fc-4074-ae6f-32c22703e39e", "tag": "97663e7d-9314-4317-8bfc-b53edd5ed176"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:15:28.803232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b7e66f61-23e0-4c2e-84bb-5141c5839ba1 req-c7c2de6b-b0eb-41bf-bc16-28d214d9cf16 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:28.803703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b7e66f61-23e0-4c2e-84bb-5141c5839ba1 req-c7c2de6b-b0eb-41bf-bc16-28d214d9cf16 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:28.804127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b7e66f61-23e0-4c2e-84bb-5141c5839ba1 req-c7c2de6b-b0eb-41bf-bc16-28d214d9cf16 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:28.831717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b7e66f61-23e0-4c2e-84bb-5141c5839ba1 req-c7c2de6b-b0eb-41bf-bc16-28d214d9cf16 service nova] Creating event network-changed:97663e7d-9314-4317-8bfc-b53edd5ed176 for instance c6a0384e-d0fc-4074-ae6f-32c22703e39e on hv-cinder-86236 Oct 28 20:15:28.831717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b7e66f61-23e0-4c2e-84bb-5141c5839ba1 req-c7c2de6b-b0eb-41bf-bc16-28d214d9cf16 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035321 Oct 28 20:15:28.831717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 755/1509] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:29.412822 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f342b687-1901-47b6-8e41-6b085633814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:29.413483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f342b687-1901-47b6-8e41-6b085633814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:29.419694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f342b687-1901-47b6-8e41-6b085633814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:29.420177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f342b687-1901-47b6-8e41-6b085633814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:29.420607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f342b687-1901-47b6-8e41-6b085633814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:29.421298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f342b687-1901-47b6-8e41-6b085633814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:29.421776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f342b687-1901-47b6-8e41-6b085633814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:29.422192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f342b687-1901-47b6-8e41-6b085633814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:29.613828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f342b687-1901-47b6-8e41-6b085633814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:29.617983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:29.623151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f342b687-1901-47b6-8e41-6b085633814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:29.629434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f342b687-1901-47b6-8e41-6b085633814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:29.629434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f342b687-1901-47b6-8e41-6b085633814d tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 200 len: 1406 microversion: 2.20 time: 0.217556 Oct 28 20:15:29.629434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 755/1510] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:29 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:29.748479 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5ab2023c-876e-4c18-9062-46cfc5d224d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:29.751163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5ab2023c-876e-4c18-9062-46cfc5d224d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:29.758766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ab2023c-876e-4c18-9062-46cfc5d224d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:29.759377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ab2023c-876e-4c18-9062-46cfc5d224d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:29.759954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ab2023c-876e-4c18-9062-46cfc5d224d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:29.760736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ab2023c-876e-4c18-9062-46cfc5d224d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:29.761457 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ab2023c-876e-4c18-9062-46cfc5d224d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:29.762249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ab2023c-876e-4c18-9062-46cfc5d224d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:29.793739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5ab2023c-876e-4c18-9062-46cfc5d224d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050341 Oct 28 20:15:29.794310 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 756/1511] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:29 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:30.652855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5a6a6fbb-2d95-45c3-90d0-fc7646b47db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:30.653406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5a6a6fbb-2d95-45c3-90d0-fc7646b47db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:30.660176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a6a6fbb-2d95-45c3-90d0-fc7646b47db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:30.660657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a6a6fbb-2d95-45c3-90d0-fc7646b47db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:30.661094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a6a6fbb-2d95-45c3-90d0-fc7646b47db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:30.661813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a6a6fbb-2d95-45c3-90d0-fc7646b47db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:30.662357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a6a6fbb-2d95-45c3-90d0-fc7646b47db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:30.662747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a6a6fbb-2d95-45c3-90d0-fc7646b47db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:30.806620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0f5d5a30-17ff-4dca-b789-3ac4df8cf7a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:30.808799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0f5d5a30-17ff-4dca-b789-3ac4df8cf7a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:30.817656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f5d5a30-17ff-4dca-b789-3ac4df8cf7a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:30.819052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f5d5a30-17ff-4dca-b789-3ac4df8cf7a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:30.819716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f5d5a30-17ff-4dca-b789-3ac4df8cf7a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:30.820446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f5d5a30-17ff-4dca-b789-3ac4df8cf7a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:30.820908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f5d5a30-17ff-4dca-b789-3ac4df8cf7a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:30.821357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f5d5a30-17ff-4dca-b789-3ac4df8cf7a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:30.860797 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0f5d5a30-17ff-4dca-b789-3ac4df8cf7a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058695 Oct 28 20:15:30.861406 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 757/1512] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:30 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:15:31.029033 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5a6a6fbb-2d95-45c3-90d0-fc7646b47db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:31.038585 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5a6a6fbb-2d95-45c3-90d0-fc7646b47db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:31.040034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5a6a6fbb-2d95-45c3-90d0-fc7646b47db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:31.041136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5a6a6fbb-2d95-45c3-90d0-fc7646b47db1 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 200 len: 1406 microversion: 2.20 time: 0.392315 Oct 28 20:15:31.041712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 756/1513] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:30 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 1406 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:31.873488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-98ba9ca6-51f4-4956-a1c1-8d37bed3efb6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:31.876389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-98ba9ca6-51f4-4956-a1c1-8d37bed3efb6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:31.883337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98ba9ca6-51f4-4956-a1c1-8d37bed3efb6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:31.883815 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98ba9ca6-51f4-4956-a1c1-8d37bed3efb6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:31.884248 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98ba9ca6-51f4-4956-a1c1-8d37bed3efb6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:31.884949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98ba9ca6-51f4-4956-a1c1-8d37bed3efb6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:31.885425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98ba9ca6-51f4-4956-a1c1-8d37bed3efb6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:31.885850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98ba9ca6-51f4-4956-a1c1-8d37bed3efb6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:31.918029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-98ba9ca6-51f4-4956-a1c1-8d37bed3efb6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048604 Oct 28 20:15:31.919295 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 758/1514] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:31 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:32.065236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7f520c5a-67b2-4662-9f67-16a681054370 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:32.065887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7f520c5a-67b2-4662-9f67-16a681054370 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:32.072762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f520c5a-67b2-4662-9f67-16a681054370 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:32.073246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f520c5a-67b2-4662-9f67-16a681054370 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:32.073712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f520c5a-67b2-4662-9f67-16a681054370 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:32.074398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f520c5a-67b2-4662-9f67-16a681054370 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:32.074853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f520c5a-67b2-4662-9f67-16a681054370 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:32.075274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f520c5a-67b2-4662-9f67-16a681054370 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:32.206890 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7f520c5a-67b2-4662-9f67-16a681054370 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:32.215816 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7f520c5a-67b2-4662-9f67-16a681054370 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:32.217262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7f520c5a-67b2-4662-9f67-16a681054370 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:32.218394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7f520c5a-67b2-4662-9f67-16a681054370 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 200 len: 1406 microversion: 2.20 time: 0.156958 Oct 28 20:15:32.218949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 757/1515] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:32 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:32.929997 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e78ece33-5359-4db1-801b-9213a00b1beb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:32.932111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e78ece33-5359-4db1-801b-9213a00b1beb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:32.938439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e78ece33-5359-4db1-801b-9213a00b1beb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:32.938918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e78ece33-5359-4db1-801b-9213a00b1beb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:32.939354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e78ece33-5359-4db1-801b-9213a00b1beb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:32.940043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e78ece33-5359-4db1-801b-9213a00b1beb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:32.940492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e78ece33-5359-4db1-801b-9213a00b1beb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:32.940914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e78ece33-5359-4db1-801b-9213a00b1beb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:32.974085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e78ece33-5359-4db1-801b-9213a00b1beb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047698 Oct 28 20:15:32.978413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 759/1516] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:32 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:33.247442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-58567fd9-2077-4483-be6e-1e2bb515e09c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:33.248061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-58567fd9-2077-4483-be6e-1e2bb515e09c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:33.254373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58567fd9-2077-4483-be6e-1e2bb515e09c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:33.254861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58567fd9-2077-4483-be6e-1e2bb515e09c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:33.255297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58567fd9-2077-4483-be6e-1e2bb515e09c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:33.256023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58567fd9-2077-4483-be6e-1e2bb515e09c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:33.256480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58567fd9-2077-4483-be6e-1e2bb515e09c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:33.256908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58567fd9-2077-4483-be6e-1e2bb515e09c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:33.390627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-58567fd9-2077-4483-be6e-1e2bb515e09c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:33.399529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-58567fd9-2077-4483-be6e-1e2bb515e09c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:33.401073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-58567fd9-2077-4483-be6e-1e2bb515e09c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:33.402204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-58567fd9-2077-4483-be6e-1e2bb515e09c tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 200 len: 1406 microversion: 2.20 time: 0.158914 Oct 28 20:15:33.402762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 758/1517] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:33 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:34.051388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5cc75264-cc74-48e4-bc30-39d7dbc28c9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:34.054185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5cc75264-cc74-48e4-bc30-39d7dbc28c9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:34.060177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cc75264-cc74-48e4-bc30-39d7dbc28c9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:34.060730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cc75264-cc74-48e4-bc30-39d7dbc28c9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:34.061252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cc75264-cc74-48e4-bc30-39d7dbc28c9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:34.062070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cc75264-cc74-48e4-bc30-39d7dbc28c9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:34.062524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cc75264-cc74-48e4-bc30-39d7dbc28c9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:34.062945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cc75264-cc74-48e4-bc30-39d7dbc28c9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:34.093604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5cc75264-cc74-48e4-bc30-39d7dbc28c9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112212 Oct 28 20:15:34.094162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 760/1518] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:33 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:34.428228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-445c2b35-a425-48de-b874-b860cc5ddfb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:34.428848 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-445c2b35-a425-48de-b874-b860cc5ddfb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:34.434956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-445c2b35-a425-48de-b874-b860cc5ddfb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:34.442850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-445c2b35-a425-48de-b874-b860cc5ddfb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:34.442850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-445c2b35-a425-48de-b874-b860cc5ddfb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:34.442850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-445c2b35-a425-48de-b874-b860cc5ddfb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:34.442850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-445c2b35-a425-48de-b874-b860cc5ddfb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:34.443651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-445c2b35-a425-48de-b874-b860cc5ddfb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:34.566922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-445c2b35-a425-48de-b874-b860cc5ddfb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:34.575010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-445c2b35-a425-48de-b874-b860cc5ddfb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:34.576448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-445c2b35-a425-48de-b874-b860cc5ddfb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:34.577612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-445c2b35-a425-48de-b874-b860cc5ddfb9 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 200 len: 1406 microversion: 2.20 time: 0.154090 Oct 28 20:15:34.578166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 759/1519] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:34 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:34.684313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5d8f2f50-51fb-42eb-aeef-e8ef938f4968 req-52964c25-e3c8-40be-9b3e-6be6c27a70b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a0384e-d0fc-4074-ae6f-32c22703e39e", "name": "network-vif-plugged", "status": "completed", "tag": "97663e7d-9314-4317-8bfc-b53edd5ed176"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:15:34.693776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5d8f2f50-51fb-42eb-aeef-e8ef938f4968 req-52964c25-e3c8-40be-9b3e-6be6c27a70b2 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:34.694255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5d8f2f50-51fb-42eb-aeef-e8ef938f4968 req-52964c25-e3c8-40be-9b3e-6be6c27a70b2 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:34.694687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5d8f2f50-51fb-42eb-aeef-e8ef938f4968 req-52964c25-e3c8-40be-9b3e-6be6c27a70b2 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:34.705594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5d8f2f50-51fb-42eb-aeef-e8ef938f4968 req-52964c25-e3c8-40be-9b3e-6be6c27a70b2 service nova] Creating event network-vif-plugged:97663e7d-9314-4317-8bfc-b53edd5ed176 for instance c6a0384e-d0fc-4074-ae6f-32c22703e39e on hv-cinder-86236 Oct 28 20:15:34.711434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5d8f2f50-51fb-42eb-aeef-e8ef938f4968 req-52964c25-e3c8-40be-9b3e-6be6c27a70b2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084554 Oct 28 20:15:34.712012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 761/1520] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:35.106063 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2fb919d1-b388-4e96-90c4-4aed6e68343e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:35.108261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2fb919d1-b388-4e96-90c4-4aed6e68343e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:35.110387 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:35.111073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:35.116163 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb919d1-b388-4e96-90c4-4aed6e68343e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:35.116652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb919d1-b388-4e96-90c4-4aed6e68343e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:35.117138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb919d1-b388-4e96-90c4-4aed6e68343e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:35.117828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb919d1-b388-4e96-90c4-4aed6e68343e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:35.118285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb919d1-b388-4e96-90c4-4aed6e68343e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:35.121425 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb919d1-b388-4e96-90c4-4aed6e68343e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:35.150960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2fb919d1-b388-4e96-90c4-4aed6e68343e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049097 Oct 28 20:15:35.151529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 760/1521] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:35 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:35.601465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:35.606089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6eb40884-f744-43f4-8301-89fc788ab87f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:35.606810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6eb40884-f744-43f4-8301-89fc788ab87f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:35.612750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6eb40884-f744-43f4-8301-89fc788ab87f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:35.613237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6eb40884-f744-43f4-8301-89fc788ab87f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:35.613713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6eb40884-f744-43f4-8301-89fc788ab87f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:35.614395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6eb40884-f744-43f4-8301-89fc788ab87f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:35.615550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6eb40884-f744-43f4-8301-89fc788ab87f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:35.615783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6eb40884-f744-43f4-8301-89fc788ab87f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:35.747913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6eb40884-f744-43f4-8301-89fc788ab87f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:35.755958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6eb40884-f744-43f4-8301-89fc788ab87f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:35.757459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6eb40884-f744-43f4-8301-89fc788ab87f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:35.758511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6eb40884-f744-43f4-8301-89fc788ab87f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 200 len: 1406 microversion: 2.20 time: 0.158056 Oct 28 20:15:35.759061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 762/1522] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:35 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:36.164249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5c493426-6c7d-4bbe-8437-99174f4f2767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:36.166455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5c493426-6c7d-4bbe-8437-99174f4f2767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:36.173768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c493426-6c7d-4bbe-8437-99174f4f2767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:36.174255 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c493426-6c7d-4bbe-8437-99174f4f2767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:36.174697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c493426-6c7d-4bbe-8437-99174f4f2767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:36.175397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c493426-6c7d-4bbe-8437-99174f4f2767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:36.175850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c493426-6c7d-4bbe-8437-99174f4f2767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:36.176264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c493426-6c7d-4bbe-8437-99174f4f2767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:36.208192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5c493426-6c7d-4bbe-8437-99174f4f2767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048804 Oct 28 20:15:36.209529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 761/1523] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:36 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:36.783153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b778eac8-21d6-487a-9656-b7d4dc049242 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:36.783766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b778eac8-21d6-487a-9656-b7d4dc049242 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:36.790472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b778eac8-21d6-487a-9656-b7d4dc049242 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:36.791044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b778eac8-21d6-487a-9656-b7d4dc049242 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:36.791489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b778eac8-21d6-487a-9656-b7d4dc049242 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:36.792183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b778eac8-21d6-487a-9656-b7d4dc049242 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:36.792638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b778eac8-21d6-487a-9656-b7d4dc049242 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:36.793133 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b778eac8-21d6-487a-9656-b7d4dc049242 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:36.921833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b778eac8-21d6-487a-9656-b7d4dc049242 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:36.930622 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b778eac8-21d6-487a-9656-b7d4dc049242 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:36.932067 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b778eac8-21d6-487a-9656-b7d4dc049242 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:36.933222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b778eac8-21d6-487a-9656-b7d4dc049242 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 200 len: 1599 microversion: 2.20 time: 0.154090 Oct 28 20:15:36.933807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 763/1524] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:15:36 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:15:36.958337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-18741db9-1e08-4289-ab00-8cd69299d35a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:36.958917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-18741db9-1e08-4289-ab00-8cd69299d35a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:36.964990 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18741db9-1e08-4289-ab00-8cd69299d35a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:36.965507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18741db9-1e08-4289-ab00-8cd69299d35a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:36.965936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18741db9-1e08-4289-ab00-8cd69299d35a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:36.966612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18741db9-1e08-4289-ab00-8cd69299d35a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:36.967058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18741db9-1e08-4289-ab00-8cd69299d35a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:36.967474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18741db9-1e08-4289-ab00-8cd69299d35a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:37.047746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-18741db9-1e08-4289-ab00-8cd69299d35a tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093249 Oct 28 20:15:37.048344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 762/1525] 10.222.0.66 () {60 vars in 1316 bytes} [Fri Oct 28 20:15:36 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:15:37.221595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-347d79e5-610d-4e97-ac5f-63364f641019 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:37.224718 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-347d79e5-610d-4e97-ac5f-63364f641019 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:37.231281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347d79e5-610d-4e97-ac5f-63364f641019 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:37.231772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347d79e5-610d-4e97-ac5f-63364f641019 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:37.232208 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347d79e5-610d-4e97-ac5f-63364f641019 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:37.232898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347d79e5-610d-4e97-ac5f-63364f641019 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:37.233541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347d79e5-610d-4e97-ac5f-63364f641019 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:37.233972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347d79e5-610d-4e97-ac5f-63364f641019 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:37.265791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-347d79e5-610d-4e97-ac5f-63364f641019 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048183 Oct 28 20:15:37.266455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 764/1526] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:37 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:38.122073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-3b50b284-11ea-4b40-b557-70c4ee96d440 req-a5a20e82-2587-40cc-8dbe-7086b66c08f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a0384e-d0fc-4074-ae6f-32c22703e39e", "tag": "97663e7d-9314-4317-8bfc-b53edd5ed176"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:15:38.131929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3b50b284-11ea-4b40-b557-70c4ee96d440 req-a5a20e82-2587-40cc-8dbe-7086b66c08f8 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:38.132401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3b50b284-11ea-4b40-b557-70c4ee96d440 req-a5a20e82-2587-40cc-8dbe-7086b66c08f8 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:38.132826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3b50b284-11ea-4b40-b557-70c4ee96d440 req-a5a20e82-2587-40cc-8dbe-7086b66c08f8 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:38.144108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-3b50b284-11ea-4b40-b557-70c4ee96d440 req-a5a20e82-2587-40cc-8dbe-7086b66c08f8 service nova] Creating event network-changed:97663e7d-9314-4317-8bfc-b53edd5ed176 for instance c6a0384e-d0fc-4074-ae6f-32c22703e39e on hv-cinder-86236 Oct 28 20:15:38.151723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-3b50b284-11ea-4b40-b557-70c4ee96d440 req-a5a20e82-2587-40cc-8dbe-7086b66c08f8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033683 Oct 28 20:15:38.152574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 763/1527] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:38.279396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0e5761ff-60a0-4cad-bad2-d035e595bbd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:38.281785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0e5761ff-60a0-4cad-bad2-d035e595bbd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:38.289265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e5761ff-60a0-4cad-bad2-d035e595bbd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:38.289803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e5761ff-60a0-4cad-bad2-d035e595bbd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:38.290269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e5761ff-60a0-4cad-bad2-d035e595bbd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:38.290977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e5761ff-60a0-4cad-bad2-d035e595bbd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:38.291435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e5761ff-60a0-4cad-bad2-d035e595bbd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:38.291869 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e5761ff-60a0-4cad-bad2-d035e595bbd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:38.329843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0e5761ff-60a0-4cad-bad2-d035e595bbd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055097 Oct 28 20:15:38.330583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 765/1528] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:38 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:39.343407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3df63131-3934-4630-8bc3-b3a2ffbfee72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:39.345774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3df63131-3934-4630-8bc3-b3a2ffbfee72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:39.352993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3df63131-3934-4630-8bc3-b3a2ffbfee72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:39.353513 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3df63131-3934-4630-8bc3-b3a2ffbfee72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:39.353951 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3df63131-3934-4630-8bc3-b3a2ffbfee72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:39.354649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3df63131-3934-4630-8bc3-b3a2ffbfee72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:39.355105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3df63131-3934-4630-8bc3-b3a2ffbfee72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:39.355770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3df63131-3934-4630-8bc3-b3a2ffbfee72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:39.390347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3df63131-3934-4630-8bc3-b3a2ffbfee72 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051751 Oct 28 20:15:39.394730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 764/1529] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:39 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:15:40.403202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f54a8f16-67cc-426b-81d7-2a2a008c68b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:40.405249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f54a8f16-67cc-426b-81d7-2a2a008c68b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:40.411915 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f54a8f16-67cc-426b-81d7-2a2a008c68b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:40.412473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f54a8f16-67cc-426b-81d7-2a2a008c68b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:40.412909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f54a8f16-67cc-426b-81d7-2a2a008c68b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:40.413622 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f54a8f16-67cc-426b-81d7-2a2a008c68b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:40.414077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f54a8f16-67cc-426b-81d7-2a2a008c68b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:40.414502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f54a8f16-67cc-426b-81d7-2a2a008c68b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:40.443811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f54a8f16-67cc-426b-81d7-2a2a008c68b0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044071 Oct 28 20:15:40.444363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 766/1530] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:40 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:41.456143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c80d862-8a44-4220-b277-8731f5003fe6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:41.458378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8c80d862-8a44-4220-b277-8731f5003fe6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:41.465521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c80d862-8a44-4220-b277-8731f5003fe6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:41.466012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c80d862-8a44-4220-b277-8731f5003fe6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:41.466449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c80d862-8a44-4220-b277-8731f5003fe6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:41.467135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c80d862-8a44-4220-b277-8731f5003fe6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:41.467603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c80d862-8a44-4220-b277-8731f5003fe6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:41.468022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c80d862-8a44-4220-b277-8731f5003fe6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:41.500064 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8c80d862-8a44-4220-b277-8731f5003fe6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047837 Oct 28 20:15:41.500667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 765/1531] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:41 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:42.514605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e78ec989-762b-4e4e-9651-ac282b6fc9d4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:42.516753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e78ec989-762b-4e4e-9651-ac282b6fc9d4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:42.523357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e78ec989-762b-4e4e-9651-ac282b6fc9d4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:42.523834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e78ec989-762b-4e4e-9651-ac282b6fc9d4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:42.524258 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e78ec989-762b-4e4e-9651-ac282b6fc9d4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:42.524935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e78ec989-762b-4e4e-9651-ac282b6fc9d4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:42.525401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e78ec989-762b-4e4e-9651-ac282b6fc9d4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:42.525819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e78ec989-762b-4e4e-9651-ac282b6fc9d4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:42.555721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e78ec989-762b-4e4e-9651-ac282b6fc9d4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045094 Oct 28 20:15:42.556262 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 767/1532] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:42 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:43.568943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a3c10fb2-9364-4d6e-8903-e456de94449e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:43.571111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a3c10fb2-9364-4d6e-8903-e456de94449e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:43.577647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3c10fb2-9364-4d6e-8903-e456de94449e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:43.578126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3c10fb2-9364-4d6e-8903-e456de94449e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:43.578563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3c10fb2-9364-4d6e-8903-e456de94449e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:43.579249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3c10fb2-9364-4d6e-8903-e456de94449e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:43.579705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3c10fb2-9364-4d6e-8903-e456de94449e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:43.580126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3c10fb2-9364-4d6e-8903-e456de94449e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:43.609542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a3c10fb2-9364-4d6e-8903-e456de94449e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045342 Oct 28 20:15:43.610109 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 766/1533] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:43 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:44.622596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0ef6496e-d0a7-4d2a-96ee-25f08a1cfea0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:44.624673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0ef6496e-d0a7-4d2a-96ee-25f08a1cfea0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:44.631837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ef6496e-d0a7-4d2a-96ee-25f08a1cfea0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:44.637099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ef6496e-d0a7-4d2a-96ee-25f08a1cfea0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:44.637099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ef6496e-d0a7-4d2a-96ee-25f08a1cfea0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:44.637099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ef6496e-d0a7-4d2a-96ee-25f08a1cfea0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:44.637099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ef6496e-d0a7-4d2a-96ee-25f08a1cfea0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:44.637509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ef6496e-d0a7-4d2a-96ee-25f08a1cfea0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:44.667165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0ef6496e-d0a7-4d2a-96ee-25f08a1cfea0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049130 Oct 28 20:15:44.667726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 768/1534] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:44 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:45.680767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31ea0164-5806-4244-884e-c214dc05411c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:45.682865 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31ea0164-5806-4244-884e-c214dc05411c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:45.692071 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31ea0164-5806-4244-884e-c214dc05411c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:45.692559 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31ea0164-5806-4244-884e-c214dc05411c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:45.693120 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31ea0164-5806-4244-884e-c214dc05411c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:45.694046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31ea0164-5806-4244-884e-c214dc05411c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:45.694507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31ea0164-5806-4244-884e-c214dc05411c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:45.694938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31ea0164-5806-4244-884e-c214dc05411c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:45.729463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-31ea0164-5806-4244-884e-c214dc05411c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053358 Oct 28 20:15:45.730036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 767/1535] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:45 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:46.742246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-15d1d525-5026-4672-92fc-0ecbfbf87cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:46.744356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-15d1d525-5026-4672-92fc-0ecbfbf87cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:46.750202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15d1d525-5026-4672-92fc-0ecbfbf87cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:46.757380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15d1d525-5026-4672-92fc-0ecbfbf87cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:46.757380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15d1d525-5026-4672-92fc-0ecbfbf87cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:46.757380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15d1d525-5026-4672-92fc-0ecbfbf87cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:46.757380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15d1d525-5026-4672-92fc-0ecbfbf87cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:46.757777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15d1d525-5026-4672-92fc-0ecbfbf87cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:46.782180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-15d1d525-5026-4672-92fc-0ecbfbf87cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043318 Oct 28 20:15:46.786043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 769/1536] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:46 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:47.797172 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fa6b8ad4-f349-4e5e-80ac-f0b647dadbe9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:15:47.799366 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fa6b8ad4-f349-4e5e-80ac-f0b647dadbe9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:47.806591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa6b8ad4-f349-4e5e-80ac-f0b647dadbe9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:47.807079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa6b8ad4-f349-4e5e-80ac-f0b647dadbe9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:47.807516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa6b8ad4-f349-4e5e-80ac-f0b647dadbe9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:47.808207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa6b8ad4-f349-4e5e-80ac-f0b647dadbe9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:47.808665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa6b8ad4-f349-4e5e-80ac-f0b647dadbe9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:47.809095 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa6b8ad4-f349-4e5e-80ac-f0b647dadbe9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:47.884039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fa6b8ad4-f349-4e5e-80ac-f0b647dadbe9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "POST /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/action" status: 200 len: 41140 microversion: 2.1 time: 0.091603 Oct 28 20:15:47.884666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 768/1537] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Oct 28 20:15:47 2022] POST /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86/action => generated 41140 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:15:50.383421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36156069-ff63-49b6-84ac-04e1ae2dfe40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:50.385001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36156069-ff63-49b6-84ac-04e1ae2dfe40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:50.392153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36156069-ff63-49b6-84ac-04e1ae2dfe40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:50.392640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36156069-ff63-49b6-84ac-04e1ae2dfe40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:50.393106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36156069-ff63-49b6-84ac-04e1ae2dfe40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:50.393840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36156069-ff63-49b6-84ac-04e1ae2dfe40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:50.394298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36156069-ff63-49b6-84ac-04e1ae2dfe40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:50.394725 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36156069-ff63-49b6-84ac-04e1ae2dfe40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:50.420984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36156069-ff63-49b6-84ac-04e1ae2dfe40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:15:50.423646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:50.698440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36156069-ff63-49b6-84ac-04e1ae2dfe40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "DELETE /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 204 len: 0 microversion: 2.1 time: 0.319042 Oct 28 20:15:50.699123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 770/1538] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:15:50 2022] DELETE /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:15:50.709873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dce27092-760a-458e-9254-3f1ae4caee7a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:50.710572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dce27092-760a-458e-9254-3f1ae4caee7a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:50.718038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dce27092-760a-458e-9254-3f1ae4caee7a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:50.718538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dce27092-760a-458e-9254-3f1ae4caee7a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:50.719003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dce27092-760a-458e-9254-3f1ae4caee7a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:50.719724 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dce27092-760a-458e-9254-3f1ae4caee7a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:50.720173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dce27092-760a-458e-9254-3f1ae4caee7a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:50.720621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dce27092-760a-458e-9254-3f1ae4caee7a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:50.854017 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-dce27092-760a-458e-9254-3f1ae4caee7a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:50.862799 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dce27092-760a-458e-9254-3f1ae4caee7a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.158621 Oct 28 20:15:50.863399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 769/1539] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:50 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:51.886462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-41cfe15a-6f0f-446d-a1dc-8eff5d4faaa9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:51.887161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-41cfe15a-6f0f-446d-a1dc-8eff5d4faaa9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:51.893510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41cfe15a-6f0f-446d-a1dc-8eff5d4faaa9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:51.893998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41cfe15a-6f0f-446d-a1dc-8eff5d4faaa9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:51.894436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41cfe15a-6f0f-446d-a1dc-8eff5d4faaa9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:51.895128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41cfe15a-6f0f-446d-a1dc-8eff5d4faaa9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:51.896088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41cfe15a-6f0f-446d-a1dc-8eff5d4faaa9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:51.896514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41cfe15a-6f0f-446d-a1dc-8eff5d4faaa9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:52.023762 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-41cfe15a-6f0f-446d-a1dc-8eff5d4faaa9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:52.032481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-41cfe15a-6f0f-446d-a1dc-8eff5d4faaa9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149916 Oct 28 20:15:52.032802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 771/1540] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:51 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:53.056232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-20f77977-fada-4ddc-af46-1d4e3338b481 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:53.056793 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-20f77977-fada-4ddc-af46-1d4e3338b481 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:53.063232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20f77977-fada-4ddc-af46-1d4e3338b481 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:53.063716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20f77977-fada-4ddc-af46-1d4e3338b481 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:53.064159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20f77977-fada-4ddc-af46-1d4e3338b481 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:53.064856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20f77977-fada-4ddc-af46-1d4e3338b481 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:53.065337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20f77977-fada-4ddc-af46-1d4e3338b481 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:53.065771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20f77977-fada-4ddc-af46-1d4e3338b481 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:53.197080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-20f77977-fada-4ddc-af46-1d4e3338b481 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:53.205362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-20f77977-fada-4ddc-af46-1d4e3338b481 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153944 Oct 28 20:15:53.205930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 770/1541] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:53 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:54.228422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-508af4bb-a395-447e-b1f9-36f9e51c7308 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:54.229032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-508af4bb-a395-447e-b1f9-36f9e51c7308 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:54.235354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-508af4bb-a395-447e-b1f9-36f9e51c7308 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:54.235833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-508af4bb-a395-447e-b1f9-36f9e51c7308 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:54.236264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-508af4bb-a395-447e-b1f9-36f9e51c7308 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:54.236943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-508af4bb-a395-447e-b1f9-36f9e51c7308 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:54.237418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-508af4bb-a395-447e-b1f9-36f9e51c7308 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:54.237836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-508af4bb-a395-447e-b1f9-36f9e51c7308 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:54.368119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-508af4bb-a395-447e-b1f9-36f9e51c7308 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:54.376081 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-508af4bb-a395-447e-b1f9-36f9e51c7308 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151500 Oct 28 20:15:54.376637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 772/1542] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:54 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:54.714306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-44f4671d-6ffe-42d4-888b-229a5f6acad9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:54.716561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-44f4671d-6ffe-42d4-888b-229a5f6acad9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:54.723111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44f4671d-6ffe-42d4-888b-229a5f6acad9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:54.723607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44f4671d-6ffe-42d4-888b-229a5f6acad9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:54.724576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44f4671d-6ffe-42d4-888b-229a5f6acad9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:54.725281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44f4671d-6ffe-42d4-888b-229a5f6acad9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:54.725773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44f4671d-6ffe-42d4-888b-229a5f6acad9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:54.726205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44f4671d-6ffe-42d4-888b-229a5f6acad9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:54.755994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-44f4671d-6ffe-42d4-888b-229a5f6acad9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044737 Oct 28 20:15:54.756967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 771/1543] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:54 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:55.399664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bde6060e-cfa4-4d3f-bb75-0cfaac6ed331 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:55.400280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bde6060e-cfa4-4d3f-bb75-0cfaac6ed331 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:55.402695 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:55.407333 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bde6060e-cfa4-4d3f-bb75-0cfaac6ed331 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:55.407815 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bde6060e-cfa4-4d3f-bb75-0cfaac6ed331 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:55.408254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bde6060e-cfa4-4d3f-bb75-0cfaac6ed331 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:55.408943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bde6060e-cfa4-4d3f-bb75-0cfaac6ed331 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:55.409550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bde6060e-cfa4-4d3f-bb75-0cfaac6ed331 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:55.409976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bde6060e-cfa4-4d3f-bb75-0cfaac6ed331 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:55.538877 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bde6060e-cfa4-4d3f-bb75-0cfaac6ed331 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:55.547055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bde6060e-cfa4-4d3f-bb75-0cfaac6ed331 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151519 Oct 28 20:15:55.547334 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 773/1544] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:55 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:55.768543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-57fbe41e-60e6-478e-b914-b5490f2b73de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:55.771354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-57fbe41e-60e6-478e-b914-b5490f2b73de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:55.777779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57fbe41e-60e6-478e-b914-b5490f2b73de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:55.778256 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57fbe41e-60e6-478e-b914-b5490f2b73de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:55.778689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57fbe41e-60e6-478e-b914-b5490f2b73de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:55.779373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57fbe41e-60e6-478e-b914-b5490f2b73de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:55.779824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57fbe41e-60e6-478e-b914-b5490f2b73de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:55.780250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57fbe41e-60e6-478e-b914-b5490f2b73de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:55.810615 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-57fbe41e-60e6-478e-b914-b5490f2b73de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045956 Oct 28 20:15:55.811161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 772/1545] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:55 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:56.570394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-23f9e5c4-6750-47ac-aad4-d895aa8ee2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:56.571015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-23f9e5c4-6750-47ac-aad4-d895aa8ee2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:56.577704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23f9e5c4-6750-47ac-aad4-d895aa8ee2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:56.578185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23f9e5c4-6750-47ac-aad4-d895aa8ee2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:56.578617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23f9e5c4-6750-47ac-aad4-d895aa8ee2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:56.579304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23f9e5c4-6750-47ac-aad4-d895aa8ee2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:56.579758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23f9e5c4-6750-47ac-aad4-d895aa8ee2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:56.580180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23f9e5c4-6750-47ac-aad4-d895aa8ee2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:56.715635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-23f9e5c4-6750-47ac-aad4-d895aa8ee2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:56.724522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-23f9e5c4-6750-47ac-aad4-d895aa8ee2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.158483 Oct 28 20:15:56.725248 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 774/1546] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:56 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:56.823268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6caa905d-9722-4d9f-840f-3ae902ca5604 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:56.825540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6caa905d-9722-4d9f-840f-3ae902ca5604 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:56.831893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6caa905d-9722-4d9f-840f-3ae902ca5604 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:56.832380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6caa905d-9722-4d9f-840f-3ae902ca5604 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:56.832820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6caa905d-9722-4d9f-840f-3ae902ca5604 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:56.833544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6caa905d-9722-4d9f-840f-3ae902ca5604 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:56.834011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6caa905d-9722-4d9f-840f-3ae902ca5604 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:56.834700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6caa905d-9722-4d9f-840f-3ae902ca5604 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:56.860440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:56.866005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6caa905d-9722-4d9f-840f-3ae902ca5604 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046697 Oct 28 20:15:56.866558 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 773/1547] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:56 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:57.748866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e3446c15-4384-458f-85a0-28e2d6d13b1d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:57.749508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e3446c15-4384-458f-85a0-28e2d6d13b1d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:57.757011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3446c15-4384-458f-85a0-28e2d6d13b1d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:57.757524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3446c15-4384-458f-85a0-28e2d6d13b1d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:57.757968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3446c15-4384-458f-85a0-28e2d6d13b1d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:57.758665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3446c15-4384-458f-85a0-28e2d6d13b1d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:57.773730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3446c15-4384-458f-85a0-28e2d6d13b1d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:57.773730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3446c15-4384-458f-85a0-28e2d6d13b1d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:57.878745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37c7c6b3-5659-4321-bdcb-a0e7a6f30790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:57.882194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-37c7c6b3-5659-4321-bdcb-a0e7a6f30790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:57.888794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37c7c6b3-5659-4321-bdcb-a0e7a6f30790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:57.889280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37c7c6b3-5659-4321-bdcb-a0e7a6f30790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:57.889754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37c7c6b3-5659-4321-bdcb-a0e7a6f30790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:57.890461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37c7c6b3-5659-4321-bdcb-a0e7a6f30790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:57.890919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37c7c6b3-5659-4321-bdcb-a0e7a6f30790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:57.891346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37c7c6b3-5659-4321-bdcb-a0e7a6f30790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:57.894341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e3446c15-4384-458f-85a0-28e2d6d13b1d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:57.902702 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e3446c15-4384-458f-85a0-28e2d6d13b1d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.158511 Oct 28 20:15:57.903396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 775/1548] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:57 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:57.921927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-37c7c6b3-5659-4321-bdcb-a0e7a6f30790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047482 Oct 28 20:15:57.922478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 774/1549] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:57 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:15:58.925214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b6847b8c-a5d9-4345-8fe2-795c6a888410 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:58.925851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b6847b8c-a5d9-4345-8fe2-795c6a888410 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:58.932664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6847b8c-a5d9-4345-8fe2-795c6a888410 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:58.933152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6847b8c-a5d9-4345-8fe2-795c6a888410 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:58.933619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6847b8c-a5d9-4345-8fe2-795c6a888410 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:58.934342 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6847b8c-a5d9-4345-8fe2-795c6a888410 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:58.934640 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6def6299-96f6-4675-a8d6-f30a99d80bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:58.935056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6847b8c-a5d9-4345-8fe2-795c6a888410 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:58.935235 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6847b8c-a5d9-4345-8fe2-795c6a888410 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:58.936816 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6def6299-96f6-4675-a8d6-f30a99d80bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:58.943472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6def6299-96f6-4675-a8d6-f30a99d80bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:58.943950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6def6299-96f6-4675-a8d6-f30a99d80bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:58.944390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6def6299-96f6-4675-a8d6-f30a99d80bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:58.945087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6def6299-96f6-4675-a8d6-f30a99d80bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:58.945601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6def6299-96f6-4675-a8d6-f30a99d80bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:58.946036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6def6299-96f6-4675-a8d6-f30a99d80bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:58.976318 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6def6299-96f6-4675-a8d6-f30a99d80bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045656 Oct 28 20:15:58.976893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 775/1550] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:58 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:15:59.067815 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b6847b8c-a5d9-4345-8fe2-795c6a888410 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:59.076458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b6847b8c-a5d9-4345-8fe2-795c6a888410 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154968 Oct 28 20:15:59.077019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 776/1551] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:58 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:59.988066 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7a443381-1e06-477e-a0cc-80f3afcc6250 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:59.992074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7a443381-1e06-477e-a0cc-80f3afcc6250 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:59.994482 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=46 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:59.999254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a443381-1e06-477e-a0cc-80f3afcc6250 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:59.999913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a443381-1e06-477e-a0cc-80f3afcc6250 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:00.000351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a443381-1e06-477e-a0cc-80f3afcc6250 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:00.001047 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a443381-1e06-477e-a0cc-80f3afcc6250 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:00.001534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a443381-1e06-477e-a0cc-80f3afcc6250 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:00.001963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a443381-1e06-477e-a0cc-80f3afcc6250 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:00.032825 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7a443381-1e06-477e-a0cc-80f3afcc6250 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048636 Oct 28 20:16:00.033437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 776/1552] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:59 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:00.100843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0d6eb5c9-1a61-4f4d-8fb8-7c94423e46e0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:00.101421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0d6eb5c9-1a61-4f4d-8fb8-7c94423e46e0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:00.107664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d6eb5c9-1a61-4f4d-8fb8-7c94423e46e0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:00.108144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d6eb5c9-1a61-4f4d-8fb8-7c94423e46e0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:00.108579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d6eb5c9-1a61-4f4d-8fb8-7c94423e46e0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:00.109270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d6eb5c9-1a61-4f4d-8fb8-7c94423e46e0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:00.109748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d6eb5c9-1a61-4f4d-8fb8-7c94423e46e0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:00.110174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d6eb5c9-1a61-4f4d-8fb8-7c94423e46e0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:00.237808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0d6eb5c9-1a61-4f4d-8fb8-7c94423e46e0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:00.246150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0d6eb5c9-1a61-4f4d-8fb8-7c94423e46e0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149814 Oct 28 20:16:00.246984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 777/1553] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:00 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:01.046093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3b723936-4a13-4de2-98db-98ae2070442c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:01.048321 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3b723936-4a13-4de2-98db-98ae2070442c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:01.054642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b723936-4a13-4de2-98db-98ae2070442c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:01.055130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b723936-4a13-4de2-98db-98ae2070442c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:01.055572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b723936-4a13-4de2-98db-98ae2070442c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:01.056265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b723936-4a13-4de2-98db-98ae2070442c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:01.056724 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b723936-4a13-4de2-98db-98ae2070442c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:01.057149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b723936-4a13-4de2-98db-98ae2070442c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:01.086899 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3b723936-4a13-4de2-98db-98ae2070442c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Oct 28 20:16:01.087449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 777/1554] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:01 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:01.269364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-905842fd-1fa2-4edc-bf1a-2f9ceef7d79a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:01.270015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-905842fd-1fa2-4edc-bf1a-2f9ceef7d79a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:01.277420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-905842fd-1fa2-4edc-bf1a-2f9ceef7d79a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:01.277902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-905842fd-1fa2-4edc-bf1a-2f9ceef7d79a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:01.278340 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-905842fd-1fa2-4edc-bf1a-2f9ceef7d79a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:01.279025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-905842fd-1fa2-4edc-bf1a-2f9ceef7d79a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:01.279479 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-905842fd-1fa2-4edc-bf1a-2f9ceef7d79a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:01.279902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-905842fd-1fa2-4edc-bf1a-2f9ceef7d79a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:01.405542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-905842fd-1fa2-4edc-bf1a-2f9ceef7d79a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:01.414212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-905842fd-1fa2-4edc-bf1a-2f9ceef7d79a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.148704 Oct 28 20:16:01.414774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 778/1555] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:01 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:02.098980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-56d4981c-5022-4528-a1dd-08361e96f829 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:02.101124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-56d4981c-5022-4528-a1dd-08361e96f829 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:02.107903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d4981c-5022-4528-a1dd-08361e96f829 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:02.108460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d4981c-5022-4528-a1dd-08361e96f829 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:02.108976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d4981c-5022-4528-a1dd-08361e96f829 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:02.109864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d4981c-5022-4528-a1dd-08361e96f829 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:02.110334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d4981c-5022-4528-a1dd-08361e96f829 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:02.110927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d4981c-5022-4528-a1dd-08361e96f829 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:02.142032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-56d4981c-5022-4528-a1dd-08361e96f829 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047025 Oct 28 20:16:02.142594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 778/1556] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:02 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:02.436675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0d120da6-a27d-462f-887b-b78a96528f11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:02.437287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0d120da6-a27d-462f-887b-b78a96528f11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:02.443897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d120da6-a27d-462f-887b-b78a96528f11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:02.444376 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d120da6-a27d-462f-887b-b78a96528f11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:02.444811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d120da6-a27d-462f-887b-b78a96528f11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:02.445522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d120da6-a27d-462f-887b-b78a96528f11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:02.445982 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d120da6-a27d-462f-887b-b78a96528f11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:02.446402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d120da6-a27d-462f-887b-b78a96528f11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:02.575838 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0d120da6-a27d-462f-887b-b78a96528f11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:02.584625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0d120da6-a27d-462f-887b-b78a96528f11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151511 Oct 28 20:16:02.585187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 779/1557] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:02 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:03.154997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-08f37f0b-9a6e-4d05-bd7b-215eabc644b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:03.157275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-08f37f0b-9a6e-4d05-bd7b-215eabc644b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:03.164706 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08f37f0b-9a6e-4d05-bd7b-215eabc644b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:03.165425 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08f37f0b-9a6e-4d05-bd7b-215eabc644b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:03.166037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08f37f0b-9a6e-4d05-bd7b-215eabc644b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:03.166826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08f37f0b-9a6e-4d05-bd7b-215eabc644b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:03.167373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08f37f0b-9a6e-4d05-bd7b-215eabc644b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:03.167899 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08f37f0b-9a6e-4d05-bd7b-215eabc644b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:03.200859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-08f37f0b-9a6e-4d05-bd7b-215eabc644b1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049696 Oct 28 20:16:03.201451 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 779/1558] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:03 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:03.607496 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-800f9bf2-6bb5-4a68-b7aa-067c7a9e0a90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:03.608083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-800f9bf2-6bb5-4a68-b7aa-067c7a9e0a90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:03.615054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-800f9bf2-6bb5-4a68-b7aa-067c7a9e0a90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:03.615522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-800f9bf2-6bb5-4a68-b7aa-067c7a9e0a90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:03.615952 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-800f9bf2-6bb5-4a68-b7aa-067c7a9e0a90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:03.616631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-800f9bf2-6bb5-4a68-b7aa-067c7a9e0a90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:03.617079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-800f9bf2-6bb5-4a68-b7aa-067c7a9e0a90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:03.617529 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-800f9bf2-6bb5-4a68-b7aa-067c7a9e0a90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:03.744761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-800f9bf2-6bb5-4a68-b7aa-067c7a9e0a90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:03.752784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-800f9bf2-6bb5-4a68-b7aa-067c7a9e0a90 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149202 Oct 28 20:16:03.753359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 780/1559] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:03 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:04.213780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-919297d5-df67-4948-add9-d1b2764cd5df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:04.215947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-919297d5-df67-4948-add9-d1b2764cd5df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:04.222312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-919297d5-df67-4948-add9-d1b2764cd5df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:04.222805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-919297d5-df67-4948-add9-d1b2764cd5df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:04.223248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-919297d5-df67-4948-add9-d1b2764cd5df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:04.223940 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-919297d5-df67-4948-add9-d1b2764cd5df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:04.224390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-919297d5-df67-4948-add9-d1b2764cd5df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:04.224993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-919297d5-df67-4948-add9-d1b2764cd5df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:04.257369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-919297d5-df67-4948-add9-d1b2764cd5df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047914 Oct 28 20:16:04.257947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 780/1560] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:04 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:04.775576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe687082-5441-4502-b57a-dc2076e13c7f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:04.776220 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fe687082-5441-4502-b57a-dc2076e13c7f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:04.782508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe687082-5441-4502-b57a-dc2076e13c7f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:04.782982 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe687082-5441-4502-b57a-dc2076e13c7f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:04.783412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe687082-5441-4502-b57a-dc2076e13c7f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:04.784089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe687082-5441-4502-b57a-dc2076e13c7f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:04.784534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe687082-5441-4502-b57a-dc2076e13c7f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:04.784952 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe687082-5441-4502-b57a-dc2076e13c7f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:04.918368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fe687082-5441-4502-b57a-dc2076e13c7f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:04.926527 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fe687082-5441-4502-b57a-dc2076e13c7f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154993 Oct 28 20:16:04.927083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 781/1561] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:04 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:05.269300 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9015c109-6129-467c-b7e3-23dbb897b33b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:05.271490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9015c109-6129-467c-b7e3-23dbb897b33b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:05.277858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9015c109-6129-467c-b7e3-23dbb897b33b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:05.278384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9015c109-6129-467c-b7e3-23dbb897b33b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:05.278771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9015c109-6129-467c-b7e3-23dbb897b33b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:05.279469 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9015c109-6129-467c-b7e3-23dbb897b33b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:05.279919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9015c109-6129-467c-b7e3-23dbb897b33b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:05.280339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9015c109-6129-467c-b7e3-23dbb897b33b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:05.311340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9015c109-6129-467c-b7e3-23dbb897b33b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045839 Oct 28 20:16:05.312041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 781/1562] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:05 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:05.950948 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0956e6ac-5df5-4b9b-b748-f8d88ec0262a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:05.950948 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0956e6ac-5df5-4b9b-b748-f8d88ec0262a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:05.957140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0956e6ac-5df5-4b9b-b748-f8d88ec0262a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:05.957652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0956e6ac-5df5-4b9b-b748-f8d88ec0262a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:05.958111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0956e6ac-5df5-4b9b-b748-f8d88ec0262a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:05.959451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0956e6ac-5df5-4b9b-b748-f8d88ec0262a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:05.960165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0956e6ac-5df5-4b9b-b748-f8d88ec0262a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:05.960585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0956e6ac-5df5-4b9b-b748-f8d88ec0262a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:06.092926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0956e6ac-5df5-4b9b-b748-f8d88ec0262a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:06.101688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0956e6ac-5df5-4b9b-b748-f8d88ec0262a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155652 Oct 28 20:16:06.102249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 782/1563] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:05 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:06.324171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b452f90-aa13-435f-a92c-18b8e3d9b77b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:06.326483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6b452f90-aa13-435f-a92c-18b8e3d9b77b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:06.332787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b452f90-aa13-435f-a92c-18b8e3d9b77b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:06.333302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b452f90-aa13-435f-a92c-18b8e3d9b77b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:06.333824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b452f90-aa13-435f-a92c-18b8e3d9b77b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:06.334873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b452f90-aa13-435f-a92c-18b8e3d9b77b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:06.335333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b452f90-aa13-435f-a92c-18b8e3d9b77b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:06.335762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b452f90-aa13-435f-a92c-18b8e3d9b77b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:06.366258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6b452f90-aa13-435f-a92c-18b8e3d9b77b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045294 Oct 28 20:16:06.366832 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 782/1564] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:06 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:07.126478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78895ce9-42d2-4fff-91ee-8e8ed837827e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:07.127093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-78895ce9-42d2-4fff-91ee-8e8ed837827e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:07.134032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78895ce9-42d2-4fff-91ee-8e8ed837827e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:07.134516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78895ce9-42d2-4fff-91ee-8e8ed837827e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:07.134966 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78895ce9-42d2-4fff-91ee-8e8ed837827e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:07.135895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78895ce9-42d2-4fff-91ee-8e8ed837827e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:07.136081 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78895ce9-42d2-4fff-91ee-8e8ed837827e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:07.136506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78895ce9-42d2-4fff-91ee-8e8ed837827e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:07.378628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0592dcf-1da9-4abc-96f8-d8ff37906244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:07.381394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0592dcf-1da9-4abc-96f8-d8ff37906244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:07.387915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0592dcf-1da9-4abc-96f8-d8ff37906244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:07.388407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0592dcf-1da9-4abc-96f8-d8ff37906244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:07.388849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0592dcf-1da9-4abc-96f8-d8ff37906244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:07.389605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0592dcf-1da9-4abc-96f8-d8ff37906244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:07.390066 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0592dcf-1da9-4abc-96f8-d8ff37906244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:07.390494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0592dcf-1da9-4abc-96f8-d8ff37906244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:07.421409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c0592dcf-1da9-4abc-96f8-d8ff37906244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046648 Oct 28 20:16:07.422310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 783/1565] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:07 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:16:07.422405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-78895ce9-42d2-4fff-91ee-8e8ed837827e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:07.430575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-78895ce9-42d2-4fff-91ee-8e8ed837827e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.307993 Oct 28 20:16:07.431157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 783/1566] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:07 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:08.434633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f74ebfb1-308b-4211-9ae7-99158564e5a5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:08.436731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f74ebfb1-308b-4211-9ae7-99158564e5a5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:08.443948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f74ebfb1-308b-4211-9ae7-99158564e5a5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:08.444583 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f74ebfb1-308b-4211-9ae7-99158564e5a5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:08.445053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f74ebfb1-308b-4211-9ae7-99158564e5a5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:08.445773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f74ebfb1-308b-4211-9ae7-99158564e5a5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:08.446231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f74ebfb1-308b-4211-9ae7-99158564e5a5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:08.446663 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f74ebfb1-308b-4211-9ae7-99158564e5a5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:08.452979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-daaa5c89-2931-4b71-902d-7680662cd2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:08.453623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-daaa5c89-2931-4b71-902d-7680662cd2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:08.460861 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daaa5c89-2931-4b71-902d-7680662cd2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:08.461396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daaa5c89-2931-4b71-902d-7680662cd2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:08.461839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daaa5c89-2931-4b71-902d-7680662cd2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:08.462569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daaa5c89-2931-4b71-902d-7680662cd2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:08.463050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daaa5c89-2931-4b71-902d-7680662cd2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:08.463497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daaa5c89-2931-4b71-902d-7680662cd2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:08.476395 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f74ebfb1-308b-4211-9ae7-99158564e5a5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045762 Oct 28 20:16:08.481134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 784/1567] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:08 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:08.606712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-daaa5c89-2931-4b71-902d-7680662cd2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:08.615678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-daaa5c89-2931-4b71-902d-7680662cd2c0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.165804 Oct 28 20:16:08.616294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 784/1568] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:08 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:16:09.488894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e5aa4f13-04de-486c-bda1-6b83f06aa338 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:09.491384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e5aa4f13-04de-486c-bda1-6b83f06aa338 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:09.497862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5aa4f13-04de-486c-bda1-6b83f06aa338 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:09.498351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5aa4f13-04de-486c-bda1-6b83f06aa338 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:09.498789 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5aa4f13-04de-486c-bda1-6b83f06aa338 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:09.499494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5aa4f13-04de-486c-bda1-6b83f06aa338 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:09.499953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5aa4f13-04de-486c-bda1-6b83f06aa338 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:09.500379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5aa4f13-04de-486c-bda1-6b83f06aa338 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:09.530746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e5aa4f13-04de-486c-bda1-6b83f06aa338 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045781 Oct 28 20:16:09.531317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 785/1569] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:09 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:09.638798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cefdcac3-b2d2-442b-b7e6-041540742b0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:09.639445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cefdcac3-b2d2-442b-b7e6-041540742b0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:09.645634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cefdcac3-b2d2-442b-b7e6-041540742b0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:09.646882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cefdcac3-b2d2-442b-b7e6-041540742b0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:09.647249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cefdcac3-b2d2-442b-b7e6-041540742b0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:09.647952 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cefdcac3-b2d2-442b-b7e6-041540742b0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:09.648407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cefdcac3-b2d2-442b-b7e6-041540742b0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:09.648829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cefdcac3-b2d2-442b-b7e6-041540742b0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:09.777578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cefdcac3-b2d2-442b-b7e6-041540742b0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:09.779734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:16:09.786283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cefdcac3-b2d2-442b-b7e6-041540742b0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151322 Oct 28 20:16:09.786882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 785/1570] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:09 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:10.543908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a60c9acc-77e8-4096-934d-94aaf49d4159 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:10.546188 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a60c9acc-77e8-4096-934d-94aaf49d4159 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:10.552779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a60c9acc-77e8-4096-934d-94aaf49d4159 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:10.553659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a60c9acc-77e8-4096-934d-94aaf49d4159 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:10.554434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a60c9acc-77e8-4096-934d-94aaf49d4159 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:10.555460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a60c9acc-77e8-4096-934d-94aaf49d4159 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:10.555926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a60c9acc-77e8-4096-934d-94aaf49d4159 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:10.556355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a60c9acc-77e8-4096-934d-94aaf49d4159 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:10.586234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a60c9acc-77e8-4096-934d-94aaf49d4159 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046285 Oct 28 20:16:10.586791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 786/1571] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:10 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:10.812456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2bcb5ffb-c907-4d6b-bb35-271bceba2d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:10.813009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2bcb5ffb-c907-4d6b-bb35-271bceba2d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:10.819865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bcb5ffb-c907-4d6b-bb35-271bceba2d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:10.820375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bcb5ffb-c907-4d6b-bb35-271bceba2d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:10.820813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bcb5ffb-c907-4d6b-bb35-271bceba2d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:10.821534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bcb5ffb-c907-4d6b-bb35-271bceba2d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:10.821990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bcb5ffb-c907-4d6b-bb35-271bceba2d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:10.822412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2bcb5ffb-c907-4d6b-bb35-271bceba2d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:10.954924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2bcb5ffb-c907-4d6b-bb35-271bceba2d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:10.963802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2bcb5ffb-c907-4d6b-bb35-271bceba2d11 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155638 Oct 28 20:16:10.964350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 786/1572] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:10 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:11.598655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ce01a97-037a-4fe5-9a58-7681d2c0aca9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:11.601747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ce01a97-037a-4fe5-9a58-7681d2c0aca9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:11.608186 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ce01a97-037a-4fe5-9a58-7681d2c0aca9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:11.608666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ce01a97-037a-4fe5-9a58-7681d2c0aca9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:11.609100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ce01a97-037a-4fe5-9a58-7681d2c0aca9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:11.609819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ce01a97-037a-4fe5-9a58-7681d2c0aca9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:11.610276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ce01a97-037a-4fe5-9a58-7681d2c0aca9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:11.610710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ce01a97-037a-4fe5-9a58-7681d2c0aca9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:11.640410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ce01a97-037a-4fe5-9a58-7681d2c0aca9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045768 Oct 28 20:16:11.640966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 787/1573] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:11 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:11.986851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6943b438-2261-45b3-9f1b-69716467ef82 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:11.987468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6943b438-2261-45b3-9f1b-69716467ef82 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:11.994986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6943b438-2261-45b3-9f1b-69716467ef82 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:11.995468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6943b438-2261-45b3-9f1b-69716467ef82 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:11.995909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6943b438-2261-45b3-9f1b-69716467ef82 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:11.996600 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6943b438-2261-45b3-9f1b-69716467ef82 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:11.997057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6943b438-2261-45b3-9f1b-69716467ef82 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:11.997513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6943b438-2261-45b3-9f1b-69716467ef82 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:12.127087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6943b438-2261-45b3-9f1b-69716467ef82 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:12.135633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6943b438-2261-45b3-9f1b-69716467ef82 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152612 Oct 28 20:16:12.136191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 787/1574] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:11 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:12.653555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ae6039bf-f36e-4e8e-aecf-a08c729fa8fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:12.655610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ae6039bf-f36e-4e8e-aecf-a08c729fa8fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:12.662602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae6039bf-f36e-4e8e-aecf-a08c729fa8fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:12.663091 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae6039bf-f36e-4e8e-aecf-a08c729fa8fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:12.663530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae6039bf-f36e-4e8e-aecf-a08c729fa8fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:12.664222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae6039bf-f36e-4e8e-aecf-a08c729fa8fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:12.664678 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae6039bf-f36e-4e8e-aecf-a08c729fa8fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:12.665128 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae6039bf-f36e-4e8e-aecf-a08c729fa8fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:12.694671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ae6039bf-f36e-4e8e-aecf-a08c729fa8fb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Oct 28 20:16:12.695223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 788/1575] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:12 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:13.159092 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-31713504-c686-480b-8cbe-ff92d38ed764 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:13.159641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-31713504-c686-480b-8cbe-ff92d38ed764 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:13.167533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31713504-c686-480b-8cbe-ff92d38ed764 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:13.168017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31713504-c686-480b-8cbe-ff92d38ed764 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:13.168455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31713504-c686-480b-8cbe-ff92d38ed764 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:13.169150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31713504-c686-480b-8cbe-ff92d38ed764 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:13.169633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31713504-c686-480b-8cbe-ff92d38ed764 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:13.170119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31713504-c686-480b-8cbe-ff92d38ed764 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:13.309047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-31713504-c686-480b-8cbe-ff92d38ed764 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:13.318564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-31713504-c686-480b-8cbe-ff92d38ed764 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.162759 Oct 28 20:16:13.319303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 788/1576] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:13 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:13.706462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0319faac-56c0-4bdc-8078-bbc0f1eb9e63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:13.709146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0319faac-56c0-4bdc-8078-bbc0f1eb9e63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:13.716057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0319faac-56c0-4bdc-8078-bbc0f1eb9e63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:13.716538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0319faac-56c0-4bdc-8078-bbc0f1eb9e63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:13.716973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0319faac-56c0-4bdc-8078-bbc0f1eb9e63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:13.717689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0319faac-56c0-4bdc-8078-bbc0f1eb9e63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:13.718145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0319faac-56c0-4bdc-8078-bbc0f1eb9e63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:13.718573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0319faac-56c0-4bdc-8078-bbc0f1eb9e63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:13.747820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0319faac-56c0-4bdc-8078-bbc0f1eb9e63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 Oct 28 20:16:13.748371 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 789/1577] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:13 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:14.342431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91875904-47a8-4801-9982-3c8c5372d737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:14.342946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-91875904-47a8-4801-9982-3c8c5372d737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:14.349483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91875904-47a8-4801-9982-3c8c5372d737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:14.350120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91875904-47a8-4801-9982-3c8c5372d737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:14.350552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91875904-47a8-4801-9982-3c8c5372d737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:14.351251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91875904-47a8-4801-9982-3c8c5372d737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:14.351706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91875904-47a8-4801-9982-3c8c5372d737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:14.352133 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91875904-47a8-4801-9982-3c8c5372d737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:14.436527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-249d4299-90dd-4a77-899f-732d84a3010f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:14.437026 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-249d4299-90dd-4a77-899f-732d84a3010f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:14.443779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-249d4299-90dd-4a77-899f-732d84a3010f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:14.444503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-249d4299-90dd-4a77-899f-732d84a3010f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:14.444952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-249d4299-90dd-4a77-899f-732d84a3010f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:14.445682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-249d4299-90dd-4a77-899f-732d84a3010f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:14.446145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-249d4299-90dd-4a77-899f-732d84a3010f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:14.446702 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-249d4299-90dd-4a77-899f-732d84a3010f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:14.464124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:16:14.471781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-249d4299-90dd-4a77-899f-732d84a3010f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e/ips" status: 200 len: 153 microversion: 2.20 time: 0.104580 Oct 28 20:16:14.477281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 790/1578] 10.222.0.66 () {60 vars in 1289 bytes} [Fri Oct 28 20:16:14 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e/ips => generated 153 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 20:16:14.489414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-91875904-47a8-4801-9982-3c8c5372d737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:14.499110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-91875904-47a8-4801-9982-3c8c5372d737 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.160661 Oct 28 20:16:14.499777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 789/1579] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:14 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:14.760352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-020a791a-247d-44c5-93a8-c534b6973ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:14.762664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-020a791a-247d-44c5-93a8-c534b6973ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:14.769505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-020a791a-247d-44c5-93a8-c534b6973ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:14.771994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-020a791a-247d-44c5-93a8-c534b6973ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:14.771994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-020a791a-247d-44c5-93a8-c534b6973ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:14.771994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-020a791a-247d-44c5-93a8-c534b6973ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:14.771994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-020a791a-247d-44c5-93a8-c534b6973ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:14.772481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-020a791a-247d-44c5-93a8-c534b6973ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:14.802867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-020a791a-247d-44c5-93a8-c534b6973ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046075 Oct 28 20:16:14.803428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 791/1580] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:14 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:15.528198 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5e300ded-f192-4e59-8d69-cf3f74b41444 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:15.528811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5e300ded-f192-4e59-8d69-cf3f74b41444 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:15.535260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e300ded-f192-4e59-8d69-cf3f74b41444 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:15.535741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e300ded-f192-4e59-8d69-cf3f74b41444 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:15.536182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e300ded-f192-4e59-8d69-cf3f74b41444 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:15.537546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e300ded-f192-4e59-8d69-cf3f74b41444 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:15.538008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e300ded-f192-4e59-8d69-cf3f74b41444 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:15.538432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e300ded-f192-4e59-8d69-cf3f74b41444 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:15.663862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5e300ded-f192-4e59-8d69-cf3f74b41444 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:15.671854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5e300ded-f192-4e59-8d69-cf3f74b41444 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.147595 Oct 28 20:16:15.672416 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 790/1581] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:15 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:15.815125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f95f74b9-1c81-4c0e-b90a-fde854ed3505 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:15.817268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f95f74b9-1c81-4c0e-b90a-fde854ed3505 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:15.823801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f95f74b9-1c81-4c0e-b90a-fde854ed3505 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:15.824282 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f95f74b9-1c81-4c0e-b90a-fde854ed3505 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:15.824711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f95f74b9-1c81-4c0e-b90a-fde854ed3505 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:15.825434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f95f74b9-1c81-4c0e-b90a-fde854ed3505 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:15.825885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f95f74b9-1c81-4c0e-b90a-fde854ed3505 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:15.826306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f95f74b9-1c81-4c0e-b90a-fde854ed3505 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:15.856487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f95f74b9-1c81-4c0e-b90a-fde854ed3505 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045211 Oct 28 20:16:15.857042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 792/1582] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:15 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:16.694430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f621fb15-d530-4b68-b7c0-0d43b7c887ba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:16.695028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f621fb15-d530-4b68-b7c0-0d43b7c887ba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:16.701813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f621fb15-d530-4b68-b7c0-0d43b7c887ba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:16.702300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f621fb15-d530-4b68-b7c0-0d43b7c887ba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:16.702741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f621fb15-d530-4b68-b7c0-0d43b7c887ba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:16.703438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f621fb15-d530-4b68-b7c0-0d43b7c887ba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:16.703900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f621fb15-d530-4b68-b7c0-0d43b7c887ba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:16.704330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f621fb15-d530-4b68-b7c0-0d43b7c887ba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:16.836425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f621fb15-d530-4b68-b7c0-0d43b7c887ba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:16.844591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f621fb15-d530-4b68-b7c0-0d43b7c887ba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153967 Oct 28 20:16:16.849094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 791/1583] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:16 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:16.868667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-56e8d9c9-dd50-4c2b-b791-151d9fe7a11d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:16.870896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-56e8d9c9-dd50-4c2b-b791-151d9fe7a11d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:16.877188 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56e8d9c9-dd50-4c2b-b791-151d9fe7a11d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:16.877695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56e8d9c9-dd50-4c2b-b791-151d9fe7a11d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:16.878129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56e8d9c9-dd50-4c2b-b791-151d9fe7a11d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:16.878806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56e8d9c9-dd50-4c2b-b791-151d9fe7a11d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:16.879253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56e8d9c9-dd50-4c2b-b791-151d9fe7a11d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:16.879671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56e8d9c9-dd50-4c2b-b791-151d9fe7a11d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:16.908000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-56e8d9c9-dd50-4c2b-b791-151d9fe7a11d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043992 Oct 28 20:16:16.908538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 793/1584] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:16 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:17.868484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-662788b7-8f78-40d3-a98d-d76781ace2a1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:17.869019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-662788b7-8f78-40d3-a98d-d76781ace2a1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:17.875430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-662788b7-8f78-40d3-a98d-d76781ace2a1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:17.875912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-662788b7-8f78-40d3-a98d-d76781ace2a1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:17.876352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-662788b7-8f78-40d3-a98d-d76781ace2a1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:17.877040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-662788b7-8f78-40d3-a98d-d76781ace2a1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:17.877524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-662788b7-8f78-40d3-a98d-d76781ace2a1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:17.877952 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-662788b7-8f78-40d3-a98d-d76781ace2a1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:17.920072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0876576-573d-40bd-874f-f64fd026845f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:17.922348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0876576-573d-40bd-874f-f64fd026845f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:17.928652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0876576-573d-40bd-874f-f64fd026845f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:17.929141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0876576-573d-40bd-874f-f64fd026845f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:17.929609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0876576-573d-40bd-874f-f64fd026845f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:17.930306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0876576-573d-40bd-874f-f64fd026845f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:17.930764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0876576-573d-40bd-874f-f64fd026845f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:17.931192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0876576-573d-40bd-874f-f64fd026845f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:17.963118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c0876576-573d-40bd-874f-f64fd026845f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046944 Oct 28 20:16:17.963785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 794/1585] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:17 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:16:18.007654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-662788b7-8f78-40d3-a98d-d76781ace2a1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:18.015798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-662788b7-8f78-40d3-a98d-d76781ace2a1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151538 Oct 28 20:16:18.016362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 792/1586] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:17 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:18.976274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d8d99d7b-7ee3-4c5c-b4d1-b92dcdcece3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:18.978447 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d8d99d7b-7ee3-4c5c-b4d1-b92dcdcece3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:18.984827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8d99d7b-7ee3-4c5c-b4d1-b92dcdcece3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:18.985309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8d99d7b-7ee3-4c5c-b4d1-b92dcdcece3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:18.985781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8d99d7b-7ee3-4c5c-b4d1-b92dcdcece3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:18.986465 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8d99d7b-7ee3-4c5c-b4d1-b92dcdcece3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:18.986920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8d99d7b-7ee3-4c5c-b4d1-b92dcdcece3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:18.987345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8d99d7b-7ee3-4c5c-b4d1-b92dcdcece3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:19.015871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d8d99d7b-7ee3-4c5c-b4d1-b92dcdcece3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044327 Oct 28 20:16:19.016432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 795/1587] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:18 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:19.039643 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b69306b0-c434-42ba-b212-43b7e216825e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:19.040260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b69306b0-c434-42ba-b212-43b7e216825e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:19.046760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b69306b0-c434-42ba-b212-43b7e216825e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:19.047244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b69306b0-c434-42ba-b212-43b7e216825e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:19.047685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b69306b0-c434-42ba-b212-43b7e216825e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:19.048377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b69306b0-c434-42ba-b212-43b7e216825e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:19.048834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b69306b0-c434-42ba-b212-43b7e216825e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:19.049259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b69306b0-c434-42ba-b212-43b7e216825e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:19.177462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b69306b0-c434-42ba-b212-43b7e216825e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:19.185794 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b69306b0-c434-42ba-b212-43b7e216825e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150958 Oct 28 20:16:19.186363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 793/1588] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:19 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:20.028351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-af34125f-a1b8-46eb-aaaf-25f592b1888b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:20.030523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-af34125f-a1b8-46eb-aaaf-25f592b1888b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:20.037018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af34125f-a1b8-46eb-aaaf-25f592b1888b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:20.038079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af34125f-a1b8-46eb-aaaf-25f592b1888b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:20.038532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af34125f-a1b8-46eb-aaaf-25f592b1888b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:20.039231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af34125f-a1b8-46eb-aaaf-25f592b1888b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:20.039685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af34125f-a1b8-46eb-aaaf-25f592b1888b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:20.040113 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af34125f-a1b8-46eb-aaaf-25f592b1888b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:20.070904 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-af34125f-a1b8-46eb-aaaf-25f592b1888b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046491 Oct 28 20:16:20.071453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 796/1589] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:20 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:20.209047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d931abdc-f141-42ce-85d8-7c0d854a826e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:20.210616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d931abdc-f141-42ce-85d8-7c0d854a826e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:20.216974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d931abdc-f141-42ce-85d8-7c0d854a826e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:20.217481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d931abdc-f141-42ce-85d8-7c0d854a826e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:20.217914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d931abdc-f141-42ce-85d8-7c0d854a826e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:20.218596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d931abdc-f141-42ce-85d8-7c0d854a826e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:20.219042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d931abdc-f141-42ce-85d8-7c0d854a826e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:20.219458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d931abdc-f141-42ce-85d8-7c0d854a826e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:20.345281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d931abdc-f141-42ce-85d8-7c0d854a826e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:20.354312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d931abdc-f141-42ce-85d8-7c0d854a826e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149107 Oct 28 20:16:20.354867 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 794/1590] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:20 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:16:21.083459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-334b21c8-c343-4416-aeef-4889f9ef158a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:21.085965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-334b21c8-c343-4416-aeef-4889f9ef158a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:21.092407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-334b21c8-c343-4416-aeef-4889f9ef158a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:21.092894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-334b21c8-c343-4416-aeef-4889f9ef158a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:21.093344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-334b21c8-c343-4416-aeef-4889f9ef158a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:21.094043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-334b21c8-c343-4416-aeef-4889f9ef158a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:21.094502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-334b21c8-c343-4416-aeef-4889f9ef158a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:21.094930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-334b21c8-c343-4416-aeef-4889f9ef158a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:21.123734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-334b21c8-c343-4416-aeef-4889f9ef158a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Oct 28 20:16:21.124281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 797/1591] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:21 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:21.377468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-93673d48-450a-4fab-9bf3-2a3e6eb7a877 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:21.378007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-93673d48-450a-4fab-9bf3-2a3e6eb7a877 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:21.384625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93673d48-450a-4fab-9bf3-2a3e6eb7a877 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:21.385156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93673d48-450a-4fab-9bf3-2a3e6eb7a877 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:21.385640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93673d48-450a-4fab-9bf3-2a3e6eb7a877 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:21.386357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93673d48-450a-4fab-9bf3-2a3e6eb7a877 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:21.386822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93673d48-450a-4fab-9bf3-2a3e6eb7a877 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:21.387255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93673d48-450a-4fab-9bf3-2a3e6eb7a877 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:21.518294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-93673d48-450a-4fab-9bf3-2a3e6eb7a877 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:21.526606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-93673d48-450a-4fab-9bf3-2a3e6eb7a877 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153050 Oct 28 20:16:21.534564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 795/1592] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:21 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:22.137100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01afb75d-3fe0-4d31-8165-5fb7eebda4d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:22.139253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-01afb75d-3fe0-4d31-8165-5fb7eebda4d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:22.145664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01afb75d-3fe0-4d31-8165-5fb7eebda4d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:22.146146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01afb75d-3fe0-4d31-8165-5fb7eebda4d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:22.146580 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01afb75d-3fe0-4d31-8165-5fb7eebda4d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:22.148216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01afb75d-3fe0-4d31-8165-5fb7eebda4d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:22.148676 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01afb75d-3fe0-4d31-8165-5fb7eebda4d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:22.149101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01afb75d-3fe0-4d31-8165-5fb7eebda4d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:22.178730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-01afb75d-3fe0-4d31-8165-5fb7eebda4d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045591 Oct 28 20:16:22.179284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 798/1593] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:22 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:22.550631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e47d3c7f-3a92-441a-8505-957ce8525abf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:22.551246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e47d3c7f-3a92-441a-8505-957ce8525abf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:22.558220 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e47d3c7f-3a92-441a-8505-957ce8525abf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:22.558705 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e47d3c7f-3a92-441a-8505-957ce8525abf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:22.559144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e47d3c7f-3a92-441a-8505-957ce8525abf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:22.559892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e47d3c7f-3a92-441a-8505-957ce8525abf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:22.560349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e47d3c7f-3a92-441a-8505-957ce8525abf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:22.560771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e47d3c7f-3a92-441a-8505-957ce8525abf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:22.697166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e47d3c7f-3a92-441a-8505-957ce8525abf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:22.706582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e47d3c7f-3a92-441a-8505-957ce8525abf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.160092 Oct 28 20:16:22.707138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 796/1594] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:22 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:23.191208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f6b98e15-a3b1-4695-9d8b-bd1303f004a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:23.193290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f6b98e15-a3b1-4695-9d8b-bd1303f004a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:23.199864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b98e15-a3b1-4695-9d8b-bd1303f004a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:23.200351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b98e15-a3b1-4695-9d8b-bd1303f004a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:23.200793 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b98e15-a3b1-4695-9d8b-bd1303f004a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:23.201524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b98e15-a3b1-4695-9d8b-bd1303f004a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:23.201985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b98e15-a3b1-4695-9d8b-bd1303f004a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:23.202414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b98e15-a3b1-4695-9d8b-bd1303f004a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:23.233371 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f6b98e15-a3b1-4695-9d8b-bd1303f004a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045824 Oct 28 20:16:23.234014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 799/1595] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:23 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:23.730438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9b1b1304-03e2-418d-85c0-c7e2b84dbde4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:23.731127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9b1b1304-03e2-418d-85c0-c7e2b84dbde4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:23.737578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b1b1304-03e2-418d-85c0-c7e2b84dbde4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:23.738062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b1b1304-03e2-418d-85c0-c7e2b84dbde4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:23.738508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b1b1304-03e2-418d-85c0-c7e2b84dbde4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:23.739249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b1b1304-03e2-418d-85c0-c7e2b84dbde4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:23.739705 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b1b1304-03e2-418d-85c0-c7e2b84dbde4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:23.740126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b1b1304-03e2-418d-85c0-c7e2b84dbde4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:23.868149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9b1b1304-03e2-418d-85c0-c7e2b84dbde4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:23.876405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9b1b1304-03e2-418d-85c0-c7e2b84dbde4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149776 Oct 28 20:16:23.876905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 797/1596] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:23 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:24.245716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f704b565-9dbc-4fc3-872d-f6dfb453f343 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:24.247872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f704b565-9dbc-4fc3-872d-f6dfb453f343 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:24.254196 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f704b565-9dbc-4fc3-872d-f6dfb453f343 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:24.254675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f704b565-9dbc-4fc3-872d-f6dfb453f343 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:24.255111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f704b565-9dbc-4fc3-872d-f6dfb453f343 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:24.255796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f704b565-9dbc-4fc3-872d-f6dfb453f343 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:24.256892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f704b565-9dbc-4fc3-872d-f6dfb453f343 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:24.257428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f704b565-9dbc-4fc3-872d-f6dfb453f343 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:24.285636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f704b565-9dbc-4fc3-872d-f6dfb453f343 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043945 Oct 28 20:16:24.286182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 800/1597] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:24 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:24.900228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ffcb3f0b-eb5f-4227-a03e-8617ddff7491 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:24.900843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ffcb3f0b-eb5f-4227-a03e-8617ddff7491 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:24.907166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffcb3f0b-eb5f-4227-a03e-8617ddff7491 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:24.907650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffcb3f0b-eb5f-4227-a03e-8617ddff7491 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:24.908092 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffcb3f0b-eb5f-4227-a03e-8617ddff7491 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:24.908783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffcb3f0b-eb5f-4227-a03e-8617ddff7491 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:24.909239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffcb3f0b-eb5f-4227-a03e-8617ddff7491 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:24.909692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffcb3f0b-eb5f-4227-a03e-8617ddff7491 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:25.045758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ffcb3f0b-eb5f-4227-a03e-8617ddff7491 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:25.053731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ffcb3f0b-eb5f-4227-a03e-8617ddff7491 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.157829 Oct 28 20:16:25.054286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 798/1598] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:24 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:25.297904 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ec7f6762-c9d0-4aa9-89b6-2ac47f187a40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:25.300059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ec7f6762-c9d0-4aa9-89b6-2ac47f187a40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:25.306346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7f6762-c9d0-4aa9-89b6-2ac47f187a40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:25.306824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7f6762-c9d0-4aa9-89b6-2ac47f187a40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:25.307256 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7f6762-c9d0-4aa9-89b6-2ac47f187a40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:25.307968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7f6762-c9d0-4aa9-89b6-2ac47f187a40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:25.308424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7f6762-c9d0-4aa9-89b6-2ac47f187a40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:25.308843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7f6762-c9d0-4aa9-89b6-2ac47f187a40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:25.338489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ec7f6762-c9d0-4aa9-89b6-2ac47f187a40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Oct 28 20:16:25.339052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 801/1599] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:25 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:26.077268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-717ecf84-6350-41bf-885f-a4386c459a00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:26.078034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-717ecf84-6350-41bf-885f-a4386c459a00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:26.085266 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-717ecf84-6350-41bf-885f-a4386c459a00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:26.085787 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-717ecf84-6350-41bf-885f-a4386c459a00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:26.086210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-717ecf84-6350-41bf-885f-a4386c459a00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:26.086898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-717ecf84-6350-41bf-885f-a4386c459a00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:26.087350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-717ecf84-6350-41bf-885f-a4386c459a00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:26.087771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-717ecf84-6350-41bf-885f-a4386c459a00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:26.216585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-717ecf84-6350-41bf-885f-a4386c459a00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:26.225402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-717ecf84-6350-41bf-885f-a4386c459a00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151383 Oct 28 20:16:26.226095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 799/1600] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:26 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:26.351735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-00705521-9770-4c37-bc64-99f2becee340 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:26.353944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-00705521-9770-4c37-bc64-99f2becee340 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:26.360183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00705521-9770-4c37-bc64-99f2becee340 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:26.360690 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00705521-9770-4c37-bc64-99f2becee340 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:26.361118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00705521-9770-4c37-bc64-99f2becee340 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:26.361824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00705521-9770-4c37-bc64-99f2becee340 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:26.362275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00705521-9770-4c37-bc64-99f2becee340 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:26.362697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00705521-9770-4c37-bc64-99f2becee340 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:26.391110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-00705521-9770-4c37-bc64-99f2becee340 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044123 Oct 28 20:16:26.391652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 802/1601] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:26 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:27.248469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6216ff1f-8bfb-40ec-87ff-3b68bd804e1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:27.249084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6216ff1f-8bfb-40ec-87ff-3b68bd804e1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:27.251446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=54 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:16:27.256280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6216ff1f-8bfb-40ec-87ff-3b68bd804e1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:27.256834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6216ff1f-8bfb-40ec-87ff-3b68bd804e1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:27.261923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6216ff1f-8bfb-40ec-87ff-3b68bd804e1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:27.261923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6216ff1f-8bfb-40ec-87ff-3b68bd804e1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:27.261923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6216ff1f-8bfb-40ec-87ff-3b68bd804e1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:27.261923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6216ff1f-8bfb-40ec-87ff-3b68bd804e1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:27.402864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6216ff1f-8bfb-40ec-87ff-3b68bd804e1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:27.404525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0c729a34-5ac4-42d9-8ef6-0b9d19465559 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:27.406829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0c729a34-5ac4-42d9-8ef6-0b9d19465559 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:27.411192 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6216ff1f-8bfb-40ec-87ff-3b68bd804e1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.166568 Oct 28 20:16:27.411758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 800/1602] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:27 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:27.413758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c729a34-5ac4-42d9-8ef6-0b9d19465559 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:27.414315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c729a34-5ac4-42d9-8ef6-0b9d19465559 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:27.414820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c729a34-5ac4-42d9-8ef6-0b9d19465559 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:27.415593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c729a34-5ac4-42d9-8ef6-0b9d19465559 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:27.416123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c729a34-5ac4-42d9-8ef6-0b9d19465559 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:27.416612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c729a34-5ac4-42d9-8ef6-0b9d19465559 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:27.445945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0c729a34-5ac4-42d9-8ef6-0b9d19465559 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045493 Oct 28 20:16:27.446491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 803/1603] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:27 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:16:28.435232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-33f9b805-9d8f-4a22-a208-c0edfe4f3f28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:28.435773 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-33f9b805-9d8f-4a22-a208-c0edfe4f3f28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:28.442169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33f9b805-9d8f-4a22-a208-c0edfe4f3f28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:28.442649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33f9b805-9d8f-4a22-a208-c0edfe4f3f28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:28.443090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33f9b805-9d8f-4a22-a208-c0edfe4f3f28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:28.444016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33f9b805-9d8f-4a22-a208-c0edfe4f3f28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:28.444508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33f9b805-9d8f-4a22-a208-c0edfe4f3f28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:28.444935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33f9b805-9d8f-4a22-a208-c0edfe4f3f28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:28.458438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d2e1b834-f175-47d4-a04b-4adbf93d69d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:28.461406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d2e1b834-f175-47d4-a04b-4adbf93d69d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:28.467708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2e1b834-f175-47d4-a04b-4adbf93d69d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:28.468190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2e1b834-f175-47d4-a04b-4adbf93d69d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:28.468621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2e1b834-f175-47d4-a04b-4adbf93d69d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:28.469364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2e1b834-f175-47d4-a04b-4adbf93d69d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:28.469819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2e1b834-f175-47d4-a04b-4adbf93d69d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:28.470237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2e1b834-f175-47d4-a04b-4adbf93d69d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:28.500204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d2e1b834-f175-47d4-a04b-4adbf93d69d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045724 Oct 28 20:16:28.500961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 804/1604] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:28 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:16:28.577608 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-33f9b805-9d8f-4a22-a208-c0edfe4f3f28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:28.586853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-33f9b805-9d8f-4a22-a208-c0edfe4f3f28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155553 Oct 28 20:16:28.587417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 801/1605] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:28 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:29.513282 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5cd38971-ef49-4f19-818b-27cc35d032a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:29.515455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5cd38971-ef49-4f19-818b-27cc35d032a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:29.521908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cd38971-ef49-4f19-818b-27cc35d032a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:29.522380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cd38971-ef49-4f19-818b-27cc35d032a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:29.522816 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cd38971-ef49-4f19-818b-27cc35d032a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:29.523570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cd38971-ef49-4f19-818b-27cc35d032a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:29.523976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cd38971-ef49-4f19-818b-27cc35d032a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:29.524398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cd38971-ef49-4f19-818b-27cc35d032a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:29.554311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5cd38971-ef49-4f19-818b-27cc35d032a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045062 Oct 28 20:16:29.554874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 805/1606] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:29 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:29.611089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a6519872-9d70-4c53-88fe-9c91b02520d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:29.611701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a6519872-9d70-4c53-88fe-9c91b02520d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:29.619102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6519872-9d70-4c53-88fe-9c91b02520d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:29.619585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6519872-9d70-4c53-88fe-9c91b02520d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:29.620022 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6519872-9d70-4c53-88fe-9c91b02520d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:29.620709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6519872-9d70-4c53-88fe-9c91b02520d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:29.621162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6519872-9d70-4c53-88fe-9c91b02520d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:29.621608 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6519872-9d70-4c53-88fe-9c91b02520d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:29.636258 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:16:29.753341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a6519872-9d70-4c53-88fe-9c91b02520d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:29.761426 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a6519872-9d70-4c53-88fe-9c91b02520d0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154429 Oct 28 20:16:29.761978 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 802/1607] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:29 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:30.566889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c7868f2d-39b3-41e1-94e8-40768f3e3a0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:30.569616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c7868f2d-39b3-41e1-94e8-40768f3e3a0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:30.571921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=60 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:16:30.576771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7868f2d-39b3-41e1-94e8-40768f3e3a0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:30.577286 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7868f2d-39b3-41e1-94e8-40768f3e3a0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:30.577762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7868f2d-39b3-41e1-94e8-40768f3e3a0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:30.578456 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7868f2d-39b3-41e1-94e8-40768f3e3a0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:30.578953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7868f2d-39b3-41e1-94e8-40768f3e3a0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:30.579386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7868f2d-39b3-41e1-94e8-40768f3e3a0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:30.609466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c7868f2d-39b3-41e1-94e8-40768f3e3a0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046586 Oct 28 20:16:30.610027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 806/1608] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:30 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:30.784190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8d1b16a0-0440-4d27-bc4b-95b0ec4d8512 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:30.784794 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8d1b16a0-0440-4d27-bc4b-95b0ec4d8512 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:30.791950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d1b16a0-0440-4d27-bc4b-95b0ec4d8512 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:30.792425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d1b16a0-0440-4d27-bc4b-95b0ec4d8512 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:30.792861 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d1b16a0-0440-4d27-bc4b-95b0ec4d8512 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:30.793582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d1b16a0-0440-4d27-bc4b-95b0ec4d8512 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:30.794032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d1b16a0-0440-4d27-bc4b-95b0ec4d8512 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:30.794452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d1b16a0-0440-4d27-bc4b-95b0ec4d8512 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:30.925696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8d1b16a0-0440-4d27-bc4b-95b0ec4d8512 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:30.934441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8d1b16a0-0440-4d27-bc4b-95b0ec4d8512 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154091 Oct 28 20:16:30.935005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 803/1609] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:30 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:31.622232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fa0b8ada-b0cc-4734-9d1d-613b252aa6c1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:31.626337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fa0b8ada-b0cc-4734-9d1d-613b252aa6c1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:31.631623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa0b8ada-b0cc-4734-9d1d-613b252aa6c1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:31.632122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa0b8ada-b0cc-4734-9d1d-613b252aa6c1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:31.632563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa0b8ada-b0cc-4734-9d1d-613b252aa6c1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:31.633259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa0b8ada-b0cc-4734-9d1d-613b252aa6c1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:31.633744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa0b8ada-b0cc-4734-9d1d-613b252aa6c1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:31.634176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa0b8ada-b0cc-4734-9d1d-613b252aa6c1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:31.651477 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:16:31.665248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fa0b8ada-b0cc-4734-9d1d-613b252aa6c1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047039 Oct 28 20:16:31.665953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 807/1610] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:31 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:31.958023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a23e74ec-b618-4243-b95f-32ddd378b9ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:31.958631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a23e74ec-b618-4243-b95f-32ddd378b9ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:31.965201 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a23e74ec-b618-4243-b95f-32ddd378b9ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:31.965740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a23e74ec-b618-4243-b95f-32ddd378b9ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:31.966171 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a23e74ec-b618-4243-b95f-32ddd378b9ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:31.966846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a23e74ec-b618-4243-b95f-32ddd378b9ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:31.967292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a23e74ec-b618-4243-b95f-32ddd378b9ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:31.967708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a23e74ec-b618-4243-b95f-32ddd378b9ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:32.098181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a23e74ec-b618-4243-b95f-32ddd378b9ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:32.106860 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a23e74ec-b618-4243-b95f-32ddd378b9ff tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152673 Oct 28 20:16:32.107420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 804/1611] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:31 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:32.678702 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1223aadb-ca8e-48ee-9ce3-cdb9702eba7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:32.680753 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1223aadb-ca8e-48ee-9ce3-cdb9702eba7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:32.687336 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1223aadb-ca8e-48ee-9ce3-cdb9702eba7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:32.687801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1223aadb-ca8e-48ee-9ce3-cdb9702eba7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:32.688232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1223aadb-ca8e-48ee-9ce3-cdb9702eba7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:32.688909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1223aadb-ca8e-48ee-9ce3-cdb9702eba7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:32.689400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1223aadb-ca8e-48ee-9ce3-cdb9702eba7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:32.689830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1223aadb-ca8e-48ee-9ce3-cdb9702eba7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:32.719494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1223aadb-ca8e-48ee-9ce3-cdb9702eba7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045902 Oct 28 20:16:32.720041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 808/1612] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:32 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:33.129828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-96d5e770-a80d-4db5-a843-bc6158186f20 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:33.130433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-96d5e770-a80d-4db5-a843-bc6158186f20 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:33.137404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96d5e770-a80d-4db5-a843-bc6158186f20 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:33.137878 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96d5e770-a80d-4db5-a843-bc6158186f20 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:33.138309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96d5e770-a80d-4db5-a843-bc6158186f20 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:33.138984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96d5e770-a80d-4db5-a843-bc6158186f20 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:33.139429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96d5e770-a80d-4db5-a843-bc6158186f20 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:33.139847 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96d5e770-a80d-4db5-a843-bc6158186f20 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:33.272025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-96d5e770-a80d-4db5-a843-bc6158186f20 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:33.280362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-96d5e770-a80d-4db5-a843-bc6158186f20 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154373 Oct 28 20:16:33.280924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 805/1613] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:33 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:33.732088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a563c9b2-2bac-4d39-aad6-c6b4c25338e2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:33.734265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a563c9b2-2bac-4d39-aad6-c6b4c25338e2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:33.740782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a563c9b2-2bac-4d39-aad6-c6b4c25338e2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:33.741262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a563c9b2-2bac-4d39-aad6-c6b4c25338e2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:33.741783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a563c9b2-2bac-4d39-aad6-c6b4c25338e2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:33.742476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a563c9b2-2bac-4d39-aad6-c6b4c25338e2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:33.742933 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a563c9b2-2bac-4d39-aad6-c6b4c25338e2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:33.743395 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a563c9b2-2bac-4d39-aad6-c6b4c25338e2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:33.772373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a563c9b2-2bac-4d39-aad6-c6b4c25338e2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043605 Oct 28 20:16:33.772922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 809/1614] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:33 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:34.306457 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc368910-58b0-4229-a3aa-6573610a7e2f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:34.306998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dc368910-58b0-4229-a3aa-6573610a7e2f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:34.313445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc368910-58b0-4229-a3aa-6573610a7e2f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:34.313924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc368910-58b0-4229-a3aa-6573610a7e2f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:34.314355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc368910-58b0-4229-a3aa-6573610a7e2f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:34.315276 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc368910-58b0-4229-a3aa-6573610a7e2f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:34.315888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc368910-58b0-4229-a3aa-6573610a7e2f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:34.316408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc368910-58b0-4229-a3aa-6573610a7e2f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:34.448388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dc368910-58b0-4229-a3aa-6573610a7e2f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:34.456648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc368910-58b0-4229-a3aa-6573610a7e2f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154219 Oct 28 20:16:34.457376 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 806/1615] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:34 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:34.784800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5bbb192a-87a6-4333-bf19-8599505170ba tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:34.787684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5bbb192a-87a6-4333-bf19-8599505170ba tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:34.794096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bbb192a-87a6-4333-bf19-8599505170ba tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:34.794581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bbb192a-87a6-4333-bf19-8599505170ba tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:34.795022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bbb192a-87a6-4333-bf19-8599505170ba tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:34.795726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bbb192a-87a6-4333-bf19-8599505170ba tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:34.796174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bbb192a-87a6-4333-bf19-8599505170ba tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:34.796602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bbb192a-87a6-4333-bf19-8599505170ba tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:34.826616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5bbb192a-87a6-4333-bf19-8599505170ba tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045714 Oct 28 20:16:34.827105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 810/1616] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:34 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:35.481278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8806df46-9659-414b-9f15-e0219a9d17a2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:35.481929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8806df46-9659-414b-9f15-e0219a9d17a2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:35.488156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8806df46-9659-414b-9f15-e0219a9d17a2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:35.488765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8806df46-9659-414b-9f15-e0219a9d17a2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:35.489222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8806df46-9659-414b-9f15-e0219a9d17a2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:35.489950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8806df46-9659-414b-9f15-e0219a9d17a2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:35.490466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8806df46-9659-414b-9f15-e0219a9d17a2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:35.490969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8806df46-9659-414b-9f15-e0219a9d17a2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:35.628011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8806df46-9659-414b-9f15-e0219a9d17a2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:35.636930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8806df46-9659-414b-9f15-e0219a9d17a2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.159398 Oct 28 20:16:35.637521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 807/1617] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:35 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:35.840433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-748d752f-b0a9-45e6-a9f2-5afe0d2592e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:35.842778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-748d752f-b0a9-45e6-a9f2-5afe0d2592e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:35.849234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-748d752f-b0a9-45e6-a9f2-5afe0d2592e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:35.850003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-748d752f-b0a9-45e6-a9f2-5afe0d2592e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:35.850481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-748d752f-b0a9-45e6-a9f2-5afe0d2592e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:35.851187 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-748d752f-b0a9-45e6-a9f2-5afe0d2592e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:35.851675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-748d752f-b0a9-45e6-a9f2-5afe0d2592e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:35.852111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-748d752f-b0a9-45e6-a9f2-5afe0d2592e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:35.882093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-748d752f-b0a9-45e6-a9f2-5afe0d2592e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044897 Oct 28 20:16:35.882663 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 811/1618] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:35 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:36.659839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-08997bad-d784-49c9-8515-fa2ba8c24c54 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:36.660343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-08997bad-d784-49c9-8515-fa2ba8c24c54 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:36.666837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08997bad-d784-49c9-8515-fa2ba8c24c54 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:36.667313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08997bad-d784-49c9-8515-fa2ba8c24c54 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:36.667739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08997bad-d784-49c9-8515-fa2ba8c24c54 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:36.668471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08997bad-d784-49c9-8515-fa2ba8c24c54 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:36.668925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08997bad-d784-49c9-8515-fa2ba8c24c54 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:36.669396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08997bad-d784-49c9-8515-fa2ba8c24c54 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:36.804634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-08997bad-d784-49c9-8515-fa2ba8c24c54 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:36.812707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-08997bad-d784-49c9-8515-fa2ba8c24c54 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.156720 Oct 28 20:16:36.813264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 808/1619] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:36 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:36.895222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-789f71c4-cf6c-4f16-8f55-a2c275391707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:36.898373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-789f71c4-cf6c-4f16-8f55-a2c275391707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:36.905027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-789f71c4-cf6c-4f16-8f55-a2c275391707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:36.905554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-789f71c4-cf6c-4f16-8f55-a2c275391707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:36.906006 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-789f71c4-cf6c-4f16-8f55-a2c275391707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:36.906697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-789f71c4-cf6c-4f16-8f55-a2c275391707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:36.907159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-789f71c4-cf6c-4f16-8f55-a2c275391707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:36.907588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-789f71c4-cf6c-4f16-8f55-a2c275391707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:36.938775 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-789f71c4-cf6c-4f16-8f55-a2c275391707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047753 Oct 28 20:16:36.939317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 812/1620] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:36 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:37.836907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-03561b48-a53a-49af-8c21-ac37eea51850 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:37.837563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-03561b48-a53a-49af-8c21-ac37eea51850 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:37.843910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03561b48-a53a-49af-8c21-ac37eea51850 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:37.844391 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03561b48-a53a-49af-8c21-ac37eea51850 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:37.844832 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03561b48-a53a-49af-8c21-ac37eea51850 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:37.845584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03561b48-a53a-49af-8c21-ac37eea51850 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:37.846047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03561b48-a53a-49af-8c21-ac37eea51850 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:37.846483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03561b48-a53a-49af-8c21-ac37eea51850 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:37.952045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a2b8c8eb-c7e5-4063-b242-05149d0d95fc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:37.954226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a2b8c8eb-c7e5-4063-b242-05149d0d95fc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:37.961507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2b8c8eb-c7e5-4063-b242-05149d0d95fc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:37.961997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2b8c8eb-c7e5-4063-b242-05149d0d95fc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:37.962437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2b8c8eb-c7e5-4063-b242-05149d0d95fc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:37.963139 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2b8c8eb-c7e5-4063-b242-05149d0d95fc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:37.963598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2b8c8eb-c7e5-4063-b242-05149d0d95fc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:37.964025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2b8c8eb-c7e5-4063-b242-05149d0d95fc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:37.973475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-03561b48-a53a-49af-8c21-ac37eea51850 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:37.981939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-03561b48-a53a-49af-8c21-ac37eea51850 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149935 Oct 28 20:16:37.982518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 809/1621] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:37 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:37.993597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a2b8c8eb-c7e5-4063-b242-05149d0d95fc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045377 Oct 28 20:16:37.994146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 813/1622] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:37 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:16:39.004852 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e9c53b5f-568b-4baa-a680-f6df74a3ace7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:39.005493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e9c53b5f-568b-4baa-a680-f6df74a3ace7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:39.006029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-de42d406-1650-4960-9fcc-73671d0d1389 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:39.008202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-de42d406-1650-4960-9fcc-73671d0d1389 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:39.013174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9c53b5f-568b-4baa-a680-f6df74a3ace7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:39.013930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9c53b5f-568b-4baa-a680-f6df74a3ace7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:39.014574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9c53b5f-568b-4baa-a680-f6df74a3ace7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:39.014717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de42d406-1650-4960-9fcc-73671d0d1389 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:39.015137 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de42d406-1650-4960-9fcc-73671d0d1389 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:39.015569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de42d406-1650-4960-9fcc-73671d0d1389 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:39.015946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9c53b5f-568b-4baa-a680-f6df74a3ace7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:39.016261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de42d406-1650-4960-9fcc-73671d0d1389 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:39.016711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de42d406-1650-4960-9fcc-73671d0d1389 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:39.016896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9c53b5f-568b-4baa-a680-f6df74a3ace7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:39.017131 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de42d406-1650-4960-9fcc-73671d0d1389 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:39.017656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9c53b5f-568b-4baa-a680-f6df74a3ace7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:39.048616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-de42d406-1650-4960-9fcc-73671d0d1389 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046396 Oct 28 20:16:39.049506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 814/1623] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:39 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:16:39.153584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e9c53b5f-568b-4baa-a680-f6df74a3ace7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:39.162005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e9c53b5f-568b-4baa-a680-f6df74a3ace7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.161061 Oct 28 20:16:39.162579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 810/1624] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:38 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:40.062168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ae4cc785-3b7d-4ccb-b6c2-9e8d21aca9ac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:40.064434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ae4cc785-3b7d-4ccb-b6c2-9e8d21aca9ac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:40.070821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae4cc785-3b7d-4ccb-b6c2-9e8d21aca9ac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:40.071331 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae4cc785-3b7d-4ccb-b6c2-9e8d21aca9ac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:40.071766 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae4cc785-3b7d-4ccb-b6c2-9e8d21aca9ac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:40.072474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae4cc785-3b7d-4ccb-b6c2-9e8d21aca9ac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:40.072927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae4cc785-3b7d-4ccb-b6c2-9e8d21aca9ac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:40.073372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae4cc785-3b7d-4ccb-b6c2-9e8d21aca9ac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:40.102005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ae4cc785-3b7d-4ccb-b6c2-9e8d21aca9ac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043754 Oct 28 20:16:40.103253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 815/1625] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:40 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:40.186723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-861a46ca-16a4-4b38-969f-fdd510cea3c9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:40.187454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-861a46ca-16a4-4b38-969f-fdd510cea3c9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:40.193977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-861a46ca-16a4-4b38-969f-fdd510cea3c9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:40.194477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-861a46ca-16a4-4b38-969f-fdd510cea3c9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:40.194934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-861a46ca-16a4-4b38-969f-fdd510cea3c9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:40.195628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-861a46ca-16a4-4b38-969f-fdd510cea3c9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:40.196115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-861a46ca-16a4-4b38-969f-fdd510cea3c9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:40.196540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-861a46ca-16a4-4b38-969f-fdd510cea3c9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:40.329002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-861a46ca-16a4-4b38-969f-fdd510cea3c9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:40.338256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-861a46ca-16a4-4b38-969f-fdd510cea3c9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154673 Oct 28 20:16:40.338827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 811/1626] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:40 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:41.115205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cf876541-dd03-4496-bcce-c64237ddd3c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:41.117294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cf876541-dd03-4496-bcce-c64237ddd3c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:41.124227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf876541-dd03-4496-bcce-c64237ddd3c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:41.124707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf876541-dd03-4496-bcce-c64237ddd3c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:41.125141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf876541-dd03-4496-bcce-c64237ddd3c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:41.125860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf876541-dd03-4496-bcce-c64237ddd3c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:41.126322 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf876541-dd03-4496-bcce-c64237ddd3c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:41.126749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf876541-dd03-4496-bcce-c64237ddd3c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:41.157035 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cf876541-dd03-4496-bcce-c64237ddd3c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045891 Oct 28 20:16:41.157619 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 816/1627] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:41 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:41.362613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-955be0c5-695f-4430-9a78-571baed1bd27 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:41.363232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-955be0c5-695f-4430-9a78-571baed1bd27 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:41.370862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-955be0c5-695f-4430-9a78-571baed1bd27 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:41.371371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-955be0c5-695f-4430-9a78-571baed1bd27 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:41.371820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-955be0c5-695f-4430-9a78-571baed1bd27 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:41.372816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-955be0c5-695f-4430-9a78-571baed1bd27 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:41.373283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-955be0c5-695f-4430-9a78-571baed1bd27 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:41.373761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-955be0c5-695f-4430-9a78-571baed1bd27 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:41.505596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-955be0c5-695f-4430-9a78-571baed1bd27 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:41.514354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-955be0c5-695f-4430-9a78-571baed1bd27 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.156508 Oct 28 20:16:41.514915 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 812/1628] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:41 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:42.169953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-02929302-c496-462f-9914-684fcfd1022a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:42.172006 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-02929302-c496-462f-9914-684fcfd1022a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:42.178330 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02929302-c496-462f-9914-684fcfd1022a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:42.178807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02929302-c496-462f-9914-684fcfd1022a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:42.179236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02929302-c496-462f-9914-684fcfd1022a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:42.179910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02929302-c496-462f-9914-684fcfd1022a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:42.180359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02929302-c496-462f-9914-684fcfd1022a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:42.180944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02929302-c496-462f-9914-684fcfd1022a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:42.208949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-02929302-c496-462f-9914-684fcfd1022a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043685 Oct 28 20:16:42.209780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 817/1629] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:42 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:42.537852 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-84bec67a-9515-470c-ab00-62f900dea943 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:42.538483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-84bec67a-9515-470c-ab00-62f900dea943 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:42.544924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84bec67a-9515-470c-ab00-62f900dea943 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:42.545444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84bec67a-9515-470c-ab00-62f900dea943 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:42.545884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84bec67a-9515-470c-ab00-62f900dea943 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:42.546582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84bec67a-9515-470c-ab00-62f900dea943 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:42.547036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84bec67a-9515-470c-ab00-62f900dea943 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:42.547494 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84bec67a-9515-470c-ab00-62f900dea943 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:42.675799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-84bec67a-9515-470c-ab00-62f900dea943 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:42.684538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-84bec67a-9515-470c-ab00-62f900dea943 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150499 Oct 28 20:16:42.685097 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 813/1630] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:42 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:43.222162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5c15fd80-a276-4c9e-813a-c9cda45a0422 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:43.224313 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5c15fd80-a276-4c9e-813a-c9cda45a0422 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:43.231244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c15fd80-a276-4c9e-813a-c9cda45a0422 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:43.231733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c15fd80-a276-4c9e-813a-c9cda45a0422 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:43.232166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c15fd80-a276-4c9e-813a-c9cda45a0422 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:43.232854 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c15fd80-a276-4c9e-813a-c9cda45a0422 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:43.233307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c15fd80-a276-4c9e-813a-c9cda45a0422 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:43.233752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c15fd80-a276-4c9e-813a-c9cda45a0422 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:43.264621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5c15fd80-a276-4c9e-813a-c9cda45a0422 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046369 Oct 28 20:16:43.274831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 818/1631] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:43 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:43.709804 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-00b9b7fd-14fc-492e-badb-aeafac3f1162 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:43.710569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-00b9b7fd-14fc-492e-badb-aeafac3f1162 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:43.718961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00b9b7fd-14fc-492e-badb-aeafac3f1162 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:43.719710 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00b9b7fd-14fc-492e-badb-aeafac3f1162 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:43.720263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00b9b7fd-14fc-492e-badb-aeafac3f1162 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:43.721221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00b9b7fd-14fc-492e-badb-aeafac3f1162 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:43.721727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00b9b7fd-14fc-492e-badb-aeafac3f1162 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:43.722244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00b9b7fd-14fc-492e-badb-aeafac3f1162 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:43.854745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-00b9b7fd-14fc-492e-badb-aeafac3f1162 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:43.863195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-00b9b7fd-14fc-492e-badb-aeafac3f1162 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.158302 Oct 28 20:16:43.863749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 814/1632] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:43 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:16:44.283990 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-65787d85-7c56-47c5-bb8f-8bbea3dc29f5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:44.286143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-65787d85-7c56-47c5-bb8f-8bbea3dc29f5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:44.293099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65787d85-7c56-47c5-bb8f-8bbea3dc29f5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:44.293607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65787d85-7c56-47c5-bb8f-8bbea3dc29f5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:44.294048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65787d85-7c56-47c5-bb8f-8bbea3dc29f5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:44.294742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65787d85-7c56-47c5-bb8f-8bbea3dc29f5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:44.295199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65787d85-7c56-47c5-bb8f-8bbea3dc29f5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:44.295623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65787d85-7c56-47c5-bb8f-8bbea3dc29f5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:44.324878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-65787d85-7c56-47c5-bb8f-8bbea3dc29f5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Oct 28 20:16:44.325463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 819/1633] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:44 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:44.887406 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d57e9d6f-2d4a-416e-93f4-8caee9b0914b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:44.888022 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d57e9d6f-2d4a-416e-93f4-8caee9b0914b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:44.894427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d57e9d6f-2d4a-416e-93f4-8caee9b0914b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:44.894911 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d57e9d6f-2d4a-416e-93f4-8caee9b0914b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:44.895354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d57e9d6f-2d4a-416e-93f4-8caee9b0914b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:44.896049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d57e9d6f-2d4a-416e-93f4-8caee9b0914b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:44.896504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d57e9d6f-2d4a-416e-93f4-8caee9b0914b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:44.896930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d57e9d6f-2d4a-416e-93f4-8caee9b0914b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:45.028174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d57e9d6f-2d4a-416e-93f4-8caee9b0914b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:45.036259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d57e9d6f-2d4a-416e-93f4-8caee9b0914b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153009 Oct 28 20:16:45.036814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 815/1634] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:44 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:45.338256 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cc6e04e3-22db-4ec7-9c44-a08c0da734a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:45.340447 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cc6e04e3-22db-4ec7-9c44-a08c0da734a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:45.351055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc6e04e3-22db-4ec7-9c44-a08c0da734a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:45.351055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc6e04e3-22db-4ec7-9c44-a08c0da734a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:45.351055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc6e04e3-22db-4ec7-9c44-a08c0da734a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:45.351055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc6e04e3-22db-4ec7-9c44-a08c0da734a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:45.351385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc6e04e3-22db-4ec7-9c44-a08c0da734a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:45.351385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc6e04e3-22db-4ec7-9c44-a08c0da734a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:45.388661 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cc6e04e3-22db-4ec7-9c44-a08c0da734a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055006 Oct 28 20:16:45.389354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 820/1635] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:45 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:46.059745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-33e13b3a-8fdd-4eab-b37e-0cdda6f736db tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:46.060359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-33e13b3a-8fdd-4eab-b37e-0cdda6f736db tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:46.066725 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33e13b3a-8fdd-4eab-b37e-0cdda6f736db tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:46.067205 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33e13b3a-8fdd-4eab-b37e-0cdda6f736db tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:46.067644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33e13b3a-8fdd-4eab-b37e-0cdda6f736db tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:46.068331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33e13b3a-8fdd-4eab-b37e-0cdda6f736db tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:46.068787 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33e13b3a-8fdd-4eab-b37e-0cdda6f736db tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:46.069212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33e13b3a-8fdd-4eab-b37e-0cdda6f736db tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:46.198450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-33e13b3a-8fdd-4eab-b37e-0cdda6f736db tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:46.206584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-33e13b3a-8fdd-4eab-b37e-0cdda6f736db tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151321 Oct 28 20:16:46.207145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 816/1636] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:46 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:46.403356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3c4c6743-89d8-4b91-a309-cfa2eaadf3da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:46.405763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3c4c6743-89d8-4b91-a309-cfa2eaadf3da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:46.412039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c4c6743-89d8-4b91-a309-cfa2eaadf3da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:46.412535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c4c6743-89d8-4b91-a309-cfa2eaadf3da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:46.412974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c4c6743-89d8-4b91-a309-cfa2eaadf3da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:46.413688 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c4c6743-89d8-4b91-a309-cfa2eaadf3da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:46.414175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c4c6743-89d8-4b91-a309-cfa2eaadf3da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:46.414597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c4c6743-89d8-4b91-a309-cfa2eaadf3da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:46.444021 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3c4c6743-89d8-4b91-a309-cfa2eaadf3da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045123 Oct 28 20:16:46.444587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 821/1637] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:46 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:16:47.230555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-69b03da0-be05-4282-b39d-a28f78a2c396 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:47.231228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-69b03da0-be05-4282-b39d-a28f78a2c396 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:47.237143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69b03da0-be05-4282-b39d-a28f78a2c396 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:47.237660 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69b03da0-be05-4282-b39d-a28f78a2c396 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:47.238105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69b03da0-be05-4282-b39d-a28f78a2c396 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:47.238796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69b03da0-be05-4282-b39d-a28f78a2c396 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:47.239252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69b03da0-be05-4282-b39d-a28f78a2c396 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:47.239680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69b03da0-be05-4282-b39d-a28f78a2c396 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:47.374405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-69b03da0-be05-4282-b39d-a28f78a2c396 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:47.383437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-69b03da0-be05-4282-b39d-a28f78a2c396 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.157368 Oct 28 20:16:47.384605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 817/1638] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:47 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:47.457468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-29a555ce-3ccc-49c8-b03a-bbabf17ec581 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:47.459902 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-29a555ce-3ccc-49c8-b03a-bbabf17ec581 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:47.466299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29a555ce-3ccc-49c8-b03a-bbabf17ec581 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:47.466781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29a555ce-3ccc-49c8-b03a-bbabf17ec581 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:47.467213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29a555ce-3ccc-49c8-b03a-bbabf17ec581 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:47.468020 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29a555ce-3ccc-49c8-b03a-bbabf17ec581 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:47.468602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29a555ce-3ccc-49c8-b03a-bbabf17ec581 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:47.469237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29a555ce-3ccc-49c8-b03a-bbabf17ec581 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:47.501408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-29a555ce-3ccc-49c8-b03a-bbabf17ec581 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047923 Oct 28 20:16:47.501995 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 822/1639] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:47 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:48.407284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49851628-d415-49ea-a86c-02096bbdca53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:48.407904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-49851628-d415-49ea-a86c-02096bbdca53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:48.414019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49851628-d415-49ea-a86c-02096bbdca53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:48.414509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49851628-d415-49ea-a86c-02096bbdca53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:48.414952 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49851628-d415-49ea-a86c-02096bbdca53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:48.416278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49851628-d415-49ea-a86c-02096bbdca53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:48.417298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49851628-d415-49ea-a86c-02096bbdca53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:48.417759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49851628-d415-49ea-a86c-02096bbdca53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:48.514212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-424d856b-5e8a-4294-92dc-0b6c820a84a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:48.528230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-424d856b-5e8a-4294-92dc-0b6c820a84a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:48.528230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-424d856b-5e8a-4294-92dc-0b6c820a84a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:48.528230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-424d856b-5e8a-4294-92dc-0b6c820a84a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:48.528230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-424d856b-5e8a-4294-92dc-0b6c820a84a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:48.528635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-424d856b-5e8a-4294-92dc-0b6c820a84a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:48.528635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-424d856b-5e8a-4294-92dc-0b6c820a84a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:48.528635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-424d856b-5e8a-4294-92dc-0b6c820a84a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:48.557976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-49851628-d415-49ea-a86c-02096bbdca53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:48.566137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-49851628-d415-49ea-a86c-02096bbdca53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.162611 Oct 28 20:16:48.566690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 818/1640] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:48 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:48.571689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-424d856b-5e8a-4294-92dc-0b6c820a84a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061749 Oct 28 20:16:48.572658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 823/1641] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:48 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:49.585529 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bafb4450-3452-41f8-90aa-fc9c9a124cdc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:49.587989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bafb4450-3452-41f8-90aa-fc9c9a124cdc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:49.596238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-138e338b-57e9-4c54-a173-29dacd9e124c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:49.596853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-138e338b-57e9-4c54-a173-29dacd9e124c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:49.603908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bafb4450-3452-41f8-90aa-fc9c9a124cdc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:49.604378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bafb4450-3452-41f8-90aa-fc9c9a124cdc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:49.604576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-138e338b-57e9-4c54-a173-29dacd9e124c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:49.605013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bafb4450-3452-41f8-90aa-fc9c9a124cdc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:49.605223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-138e338b-57e9-4c54-a173-29dacd9e124c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:49.605721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-138e338b-57e9-4c54-a173-29dacd9e124c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:49.605855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bafb4450-3452-41f8-90aa-fc9c9a124cdc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:49.606190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bafb4450-3452-41f8-90aa-fc9c9a124cdc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:49.606676 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bafb4450-3452-41f8-90aa-fc9c9a124cdc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:49.606796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-138e338b-57e9-4c54-a173-29dacd9e124c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:49.607527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-138e338b-57e9-4c54-a173-29dacd9e124c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:49.607962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-138e338b-57e9-4c54-a173-29dacd9e124c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:49.613453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:16:49.613617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:16:49.653345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bafb4450-3452-41f8-90aa-fc9c9a124cdc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073231 Oct 28 20:16:49.653948 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 819/1642] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:49 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:49.746667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-138e338b-57e9-4c54-a173-29dacd9e124c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:49.754801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-138e338b-57e9-4c54-a173-29dacd9e124c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.164466 Oct 28 20:16:49.755307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 824/1643] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:49 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:50.666555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-743d8238-607a-49fa-b289-912fa7aa330c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:50.668929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-743d8238-607a-49fa-b289-912fa7aa330c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:50.675645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-743d8238-607a-49fa-b289-912fa7aa330c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:50.676135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-743d8238-607a-49fa-b289-912fa7aa330c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:50.676579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-743d8238-607a-49fa-b289-912fa7aa330c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:50.677334 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-743d8238-607a-49fa-b289-912fa7aa330c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:50.677857 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-743d8238-607a-49fa-b289-912fa7aa330c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:50.678348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-743d8238-607a-49fa-b289-912fa7aa330c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:50.708090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-743d8238-607a-49fa-b289-912fa7aa330c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046392 Oct 28 20:16:50.708652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 820/1644] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:50 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:50.778455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34d274fa-f9c3-4d87-a904-2cb94943f54f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:50.779026 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-34d274fa-f9c3-4d87-a904-2cb94943f54f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:50.785379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34d274fa-f9c3-4d87-a904-2cb94943f54f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:50.785854 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34d274fa-f9c3-4d87-a904-2cb94943f54f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:50.786289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34d274fa-f9c3-4d87-a904-2cb94943f54f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:50.786966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34d274fa-f9c3-4d87-a904-2cb94943f54f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:50.787418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34d274fa-f9c3-4d87-a904-2cb94943f54f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:50.787836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34d274fa-f9c3-4d87-a904-2cb94943f54f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:50.917268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-34d274fa-f9c3-4d87-a904-2cb94943f54f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:50.925657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34d274fa-f9c3-4d87-a904-2cb94943f54f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151505 Oct 28 20:16:50.926220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 825/1645] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:50 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:51.721589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e20c2be-aaee-4367-a6bb-c71e478e36fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:51.723860 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4e20c2be-aaee-4367-a6bb-c71e478e36fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:51.730297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e20c2be-aaee-4367-a6bb-c71e478e36fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:51.730776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e20c2be-aaee-4367-a6bb-c71e478e36fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:51.731215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e20c2be-aaee-4367-a6bb-c71e478e36fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:51.731906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e20c2be-aaee-4367-a6bb-c71e478e36fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:51.732362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e20c2be-aaee-4367-a6bb-c71e478e36fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:51.732787 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e20c2be-aaee-4367-a6bb-c71e478e36fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:51.765261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4e20c2be-aaee-4367-a6bb-c71e478e36fa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047812 Oct 28 20:16:51.766033 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 821/1646] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:51 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:51.949509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4317ba58-7f3d-455c-aa9f-b4f77099ccc9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:51.950157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4317ba58-7f3d-455c-aa9f-b4f77099ccc9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:51.956440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4317ba58-7f3d-455c-aa9f-b4f77099ccc9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:51.956924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4317ba58-7f3d-455c-aa9f-b4f77099ccc9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:51.957388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4317ba58-7f3d-455c-aa9f-b4f77099ccc9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:51.958083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4317ba58-7f3d-455c-aa9f-b4f77099ccc9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:51.958538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4317ba58-7f3d-455c-aa9f-b4f77099ccc9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:51.958961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4317ba58-7f3d-455c-aa9f-b4f77099ccc9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:52.089559 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4317ba58-7f3d-455c-aa9f-b4f77099ccc9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:52.097566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4317ba58-7f3d-455c-aa9f-b4f77099ccc9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152478 Oct 28 20:16:52.098126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 826/1647] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:51 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:52.777928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a211d422-66f5-4bb1-85bf-6baed9f84ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:52.780065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a211d422-66f5-4bb1-85bf-6baed9f84ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:52.786319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a211d422-66f5-4bb1-85bf-6baed9f84ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:52.786791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a211d422-66f5-4bb1-85bf-6baed9f84ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:52.787221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a211d422-66f5-4bb1-85bf-6baed9f84ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:52.787901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a211d422-66f5-4bb1-85bf-6baed9f84ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:52.788348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a211d422-66f5-4bb1-85bf-6baed9f84ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:52.788766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a211d422-66f5-4bb1-85bf-6baed9f84ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:52.818941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a211d422-66f5-4bb1-85bf-6baed9f84ed4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045481 Oct 28 20:16:52.819500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 822/1648] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:52 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:53.120370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-627bf2f2-5cb7-4491-a9bb-197da508dfc6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:53.120985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-627bf2f2-5cb7-4491-a9bb-197da508dfc6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:53.127319 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-627bf2f2-5cb7-4491-a9bb-197da508dfc6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:53.127799 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-627bf2f2-5cb7-4491-a9bb-197da508dfc6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:53.128237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-627bf2f2-5cb7-4491-a9bb-197da508dfc6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:53.128926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-627bf2f2-5cb7-4491-a9bb-197da508dfc6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:53.129404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-627bf2f2-5cb7-4491-a9bb-197da508dfc6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:53.129838 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-627bf2f2-5cb7-4491-a9bb-197da508dfc6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:53.261713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-627bf2f2-5cb7-4491-a9bb-197da508dfc6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:53.269914 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-627bf2f2-5cb7-4491-a9bb-197da508dfc6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153446 Oct 28 20:16:53.270490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 827/1649] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:53 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:53.830888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a9a3851-c80c-492e-8677-7977fddc7565 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:53.833090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2a9a3851-c80c-492e-8677-7977fddc7565 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:53.840051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a9a3851-c80c-492e-8677-7977fddc7565 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:53.840536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a9a3851-c80c-492e-8677-7977fddc7565 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:53.840975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a9a3851-c80c-492e-8677-7977fddc7565 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:53.841727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a9a3851-c80c-492e-8677-7977fddc7565 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:53.842212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a9a3851-c80c-492e-8677-7977fddc7565 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:53.842662 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a9a3851-c80c-492e-8677-7977fddc7565 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:53.872801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a9a3851-c80c-492e-8677-7977fddc7565 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045980 Oct 28 20:16:53.873389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 823/1650] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:53 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:54.294639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-50cf5192-5c1f-4ec6-b3d4-9e9448e01419 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:54.295202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-50cf5192-5c1f-4ec6-b3d4-9e9448e01419 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:54.301610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50cf5192-5c1f-4ec6-b3d4-9e9448e01419 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:54.302099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50cf5192-5c1f-4ec6-b3d4-9e9448e01419 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:54.302539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50cf5192-5c1f-4ec6-b3d4-9e9448e01419 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:54.303240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50cf5192-5c1f-4ec6-b3d4-9e9448e01419 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:54.303698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50cf5192-5c1f-4ec6-b3d4-9e9448e01419 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:54.304126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50cf5192-5c1f-4ec6-b3d4-9e9448e01419 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:54.434672 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-50cf5192-5c1f-4ec6-b3d4-9e9448e01419 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:54.442764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-50cf5192-5c1f-4ec6-b3d4-9e9448e01419 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152805 Oct 28 20:16:54.443327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 828/1651] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:54 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:54.884770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-53a2aad9-564c-4ecb-9340-32bb78e41eed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:54.887468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-53a2aad9-564c-4ecb-9340-32bb78e41eed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:54.893789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53a2aad9-564c-4ecb-9340-32bb78e41eed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:54.894269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53a2aad9-564c-4ecb-9340-32bb78e41eed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:54.894706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53a2aad9-564c-4ecb-9340-32bb78e41eed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:54.895394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53a2aad9-564c-4ecb-9340-32bb78e41eed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:54.895847 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53a2aad9-564c-4ecb-9340-32bb78e41eed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:54.896274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53a2aad9-564c-4ecb-9340-32bb78e41eed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:54.926356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-53a2aad9-564c-4ecb-9340-32bb78e41eed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045506 Oct 28 20:16:54.926909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 824/1652] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:54 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:55.466654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34cfe7a8-64ff-44e7-ae37-42c03c83ea3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:55.467301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-34cfe7a8-64ff-44e7-ae37-42c03c83ea3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:55.473728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34cfe7a8-64ff-44e7-ae37-42c03c83ea3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:55.474218 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34cfe7a8-64ff-44e7-ae37-42c03c83ea3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:55.474652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34cfe7a8-64ff-44e7-ae37-42c03c83ea3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:55.475342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34cfe7a8-64ff-44e7-ae37-42c03c83ea3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:55.475799 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34cfe7a8-64ff-44e7-ae37-42c03c83ea3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:55.476228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34cfe7a8-64ff-44e7-ae37-42c03c83ea3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:55.608187 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-34cfe7a8-64ff-44e7-ae37-42c03c83ea3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:55.616240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34cfe7a8-64ff-44e7-ae37-42c03c83ea3c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154083 Oct 28 20:16:55.616802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 829/1653] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:55 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:55.939866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a8e52c57-8bca-4c83-99c3-e006d1504b92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:55.944945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a8e52c57-8bca-4c83-99c3-e006d1504b92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:55.948560 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8e52c57-8bca-4c83-99c3-e006d1504b92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:55.949285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8e52c57-8bca-4c83-99c3-e006d1504b92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:55.949750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8e52c57-8bca-4c83-99c3-e006d1504b92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:55.950456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8e52c57-8bca-4c83-99c3-e006d1504b92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:55.950912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8e52c57-8bca-4c83-99c3-e006d1504b92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:55.951339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8e52c57-8bca-4c83-99c3-e006d1504b92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:55.982537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a8e52c57-8bca-4c83-99c3-e006d1504b92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046572 Oct 28 20:16:55.983106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 825/1654] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:55 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:56.640490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-29e2bf2f-6ee3-4f30-a221-6f2af11b1000 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:56.641098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-29e2bf2f-6ee3-4f30-a221-6f2af11b1000 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:56.647489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29e2bf2f-6ee3-4f30-a221-6f2af11b1000 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:56.647969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29e2bf2f-6ee3-4f30-a221-6f2af11b1000 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:56.648405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29e2bf2f-6ee3-4f30-a221-6f2af11b1000 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:56.649085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29e2bf2f-6ee3-4f30-a221-6f2af11b1000 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:56.649566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29e2bf2f-6ee3-4f30-a221-6f2af11b1000 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:56.649990 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29e2bf2f-6ee3-4f30-a221-6f2af11b1000 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:56.779505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-29e2bf2f-6ee3-4f30-a221-6f2af11b1000 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:56.785277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-29e2bf2f-6ee3-4f30-a221-6f2af11b1000 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.148647 Oct 28 20:16:56.785862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 830/1655] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:56 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:56.995209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-70cae3af-7f44-413e-8a93-9b3f1e01ce6a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:56.997529 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-70cae3af-7f44-413e-8a93-9b3f1e01ce6a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:57.003916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70cae3af-7f44-413e-8a93-9b3f1e01ce6a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:57.004387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70cae3af-7f44-413e-8a93-9b3f1e01ce6a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:57.004819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70cae3af-7f44-413e-8a93-9b3f1e01ce6a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:57.005537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70cae3af-7f44-413e-8a93-9b3f1e01ce6a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:57.006139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70cae3af-7f44-413e-8a93-9b3f1e01ce6a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:57.006404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70cae3af-7f44-413e-8a93-9b3f1e01ce6a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:57.038066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-70cae3af-7f44-413e-8a93-9b3f1e01ce6a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047611 Oct 28 20:16:57.038627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 826/1656] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:56 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:57.808876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43a6259c-dcd2-4935-b002-03817e85dc28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:57.809597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-43a6259c-dcd2-4935-b002-03817e85dc28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:57.815969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43a6259c-dcd2-4935-b002-03817e85dc28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:57.816456 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43a6259c-dcd2-4935-b002-03817e85dc28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:57.816896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43a6259c-dcd2-4935-b002-03817e85dc28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:57.817631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43a6259c-dcd2-4935-b002-03817e85dc28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:57.818091 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43a6259c-dcd2-4935-b002-03817e85dc28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:57.818514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43a6259c-dcd2-4935-b002-03817e85dc28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:57.944525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-43a6259c-dcd2-4935-b002-03817e85dc28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:57.952820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-43a6259c-dcd2-4935-b002-03817e85dc28 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.148618 Oct 28 20:16:57.953403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 831/1657] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:57 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:16:58.050392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-de7ae019-9b33-4ded-ae5c-2049300e5940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:58.052571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-de7ae019-9b33-4ded-ae5c-2049300e5940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:58.055084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=54 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:16:58.060164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de7ae019-9b33-4ded-ae5c-2049300e5940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:58.060601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de7ae019-9b33-4ded-ae5c-2049300e5940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:58.061043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de7ae019-9b33-4ded-ae5c-2049300e5940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:58.061774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de7ae019-9b33-4ded-ae5c-2049300e5940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:58.062232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de7ae019-9b33-4ded-ae5c-2049300e5940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:58.062660 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de7ae019-9b33-4ded-ae5c-2049300e5940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:58.094536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-de7ae019-9b33-4ded-ae5c-2049300e5940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047829 Oct 28 20:16:58.094848 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 827/1658] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:58 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:58.976805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1d368581-ab71-40a7-be5d-c40711340f62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:58.977459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1d368581-ab71-40a7-be5d-c40711340f62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:58.984053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d368581-ab71-40a7-be5d-c40711340f62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:58.984540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d368581-ab71-40a7-be5d-c40711340f62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:58.984978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d368581-ab71-40a7-be5d-c40711340f62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:58.985699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d368581-ab71-40a7-be5d-c40711340f62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:58.986159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d368581-ab71-40a7-be5d-c40711340f62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:58.986585 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d368581-ab71-40a7-be5d-c40711340f62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:59.107834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed6c3559-d5b4-4199-b918-cf06806d5b14 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:59.110066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ed6c3559-d5b4-4199-b918-cf06806d5b14 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:59.116647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed6c3559-d5b4-4199-b918-cf06806d5b14 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:59.117312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed6c3559-d5b4-4199-b918-cf06806d5b14 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:59.117582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1d368581-ab71-40a7-be5d-c40711340f62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:59.117717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed6c3559-d5b4-4199-b918-cf06806d5b14 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:59.118291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed6c3559-d5b4-4199-b918-cf06806d5b14 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:59.118753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed6c3559-d5b4-4199-b918-cf06806d5b14 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:59.119308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed6c3559-d5b4-4199-b918-cf06806d5b14 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:59.127014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1d368581-ab71-40a7-be5d-c40711340f62 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154019 Oct 28 20:16:59.138779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 832/1659] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:58 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:59.154333 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ed6c3559-d5b4-4199-b918-cf06806d5b14 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051703 Oct 28 20:16:59.154920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 828/1660] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:16:59 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:17:00.152467 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e3d574c2-a6a7-478b-94cd-0b6aea8517a7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:00.153076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e3d574c2-a6a7-478b-94cd-0b6aea8517a7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:00.159440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d574c2-a6a7-478b-94cd-0b6aea8517a7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:00.159920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d574c2-a6a7-478b-94cd-0b6aea8517a7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:00.160358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d574c2-a6a7-478b-94cd-0b6aea8517a7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:00.161043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d574c2-a6a7-478b-94cd-0b6aea8517a7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:00.161635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d574c2-a6a7-478b-94cd-0b6aea8517a7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:00.162081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d574c2-a6a7-478b-94cd-0b6aea8517a7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:00.166787 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c8d7b676-fd8e-41c9-8074-5b7078a4f813 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:00.168981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c8d7b676-fd8e-41c9-8074-5b7078a4f813 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:00.175386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d7b676-fd8e-41c9-8074-5b7078a4f813 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:00.175860 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d7b676-fd8e-41c9-8074-5b7078a4f813 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:00.176291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d7b676-fd8e-41c9-8074-5b7078a4f813 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:00.176985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d7b676-fd8e-41c9-8074-5b7078a4f813 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:00.177457 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d7b676-fd8e-41c9-8074-5b7078a4f813 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:00.177882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d7b676-fd8e-41c9-8074-5b7078a4f813 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:00.211159 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c8d7b676-fd8e-41c9-8074-5b7078a4f813 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048417 Oct 28 20:17:00.211735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 829/1661] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:00 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:17:00.302781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e3d574c2-a6a7-478b-94cd-0b6aea8517a7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:00.311808 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e3d574c2-a6a7-478b-94cd-0b6aea8517a7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.163850 Oct 28 20:17:00.312370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 833/1662] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:00 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:01.224169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-10600dbd-90de-4d67-a1b2-59f81486f48a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:01.226371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-10600dbd-90de-4d67-a1b2-59f81486f48a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:01.233055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10600dbd-90de-4d67-a1b2-59f81486f48a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:01.233573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10600dbd-90de-4d67-a1b2-59f81486f48a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:01.234007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10600dbd-90de-4d67-a1b2-59f81486f48a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:01.234687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10600dbd-90de-4d67-a1b2-59f81486f48a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:01.235138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10600dbd-90de-4d67-a1b2-59f81486f48a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:01.235558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10600dbd-90de-4d67-a1b2-59f81486f48a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:01.265561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-10600dbd-90de-4d67-a1b2-59f81486f48a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045277 Oct 28 20:17:01.266106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 830/1663] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:01 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:01.336120 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d7b18ecc-10eb-429b-9698-0236d2ebf900 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:01.336727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d7b18ecc-10eb-429b-9698-0236d2ebf900 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:01.339140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=56 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:17:01.344200 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7b18ecc-10eb-429b-9698-0236d2ebf900 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:01.344691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7b18ecc-10eb-429b-9698-0236d2ebf900 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:01.345126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7b18ecc-10eb-429b-9698-0236d2ebf900 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:01.345965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7b18ecc-10eb-429b-9698-0236d2ebf900 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:01.346464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7b18ecc-10eb-429b-9698-0236d2ebf900 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:01.346911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7b18ecc-10eb-429b-9698-0236d2ebf900 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:01.496919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d7b18ecc-10eb-429b-9698-0236d2ebf900 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:01.504962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d7b18ecc-10eb-429b-9698-0236d2ebf900 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.172826 Oct 28 20:17:01.505565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 834/1664] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:01 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:02.278910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-65b250f3-7818-40d5-8277-685b96a564f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:02.281138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-65b250f3-7818-40d5-8277-685b96a564f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:02.287495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65b250f3-7818-40d5-8277-685b96a564f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:02.287909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65b250f3-7818-40d5-8277-685b96a564f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:02.288342 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65b250f3-7818-40d5-8277-685b96a564f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:02.289063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65b250f3-7818-40d5-8277-685b96a564f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:02.289548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65b250f3-7818-40d5-8277-685b96a564f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:02.289973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65b250f3-7818-40d5-8277-685b96a564f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:02.319732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-65b250f3-7818-40d5-8277-685b96a564f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045194 Oct 28 20:17:02.320302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 831/1665] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:02 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:02.528533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6870afa2-1746-4c9f-bea5-c02ba43c0527 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:02.529427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6870afa2-1746-4c9f-bea5-c02ba43c0527 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:02.536081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6870afa2-1746-4c9f-bea5-c02ba43c0527 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:02.536559 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6870afa2-1746-4c9f-bea5-c02ba43c0527 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:02.537238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6870afa2-1746-4c9f-bea5-c02ba43c0527 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:02.538429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6870afa2-1746-4c9f-bea5-c02ba43c0527 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:02.539292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6870afa2-1746-4c9f-bea5-c02ba43c0527 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:02.539877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6870afa2-1746-4c9f-bea5-c02ba43c0527 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:02.674472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6870afa2-1746-4c9f-bea5-c02ba43c0527 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:02.682560 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6870afa2-1746-4c9f-bea5-c02ba43c0527 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.158428 Oct 28 20:17:02.683651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 835/1666] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:02 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:03.368446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a22afbe8-3f0e-4f88-8b79-db181ace8828 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:03.368446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a22afbe8-3f0e-4f88-8b79-db181ace8828 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:03.368446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a22afbe8-3f0e-4f88-8b79-db181ace8828 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:03.368446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a22afbe8-3f0e-4f88-8b79-db181ace8828 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:03.370365 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a22afbe8-3f0e-4f88-8b79-db181ace8828 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:03.370365 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a22afbe8-3f0e-4f88-8b79-db181ace8828 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:03.370365 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a22afbe8-3f0e-4f88-8b79-db181ace8828 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:03.370365 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a22afbe8-3f0e-4f88-8b79-db181ace8828 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:03.376028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a22afbe8-3f0e-4f88-8b79-db181ace8828 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047161 Oct 28 20:17:03.376583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 832/1667] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:03 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:03.705516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e912e2e4-9a4b-4fd0-b936-0dbfaac03e7c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:03.706149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e912e2e4-9a4b-4fd0-b936-0dbfaac03e7c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:03.712767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e912e2e4-9a4b-4fd0-b936-0dbfaac03e7c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:03.713254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e912e2e4-9a4b-4fd0-b936-0dbfaac03e7c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:03.713725 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e912e2e4-9a4b-4fd0-b936-0dbfaac03e7c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:03.715535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e912e2e4-9a4b-4fd0-b936-0dbfaac03e7c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:03.716000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e912e2e4-9a4b-4fd0-b936-0dbfaac03e7c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:03.716435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e912e2e4-9a4b-4fd0-b936-0dbfaac03e7c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:03.843067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e912e2e4-9a4b-4fd0-b936-0dbfaac03e7c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:03.851153 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e912e2e4-9a4b-4fd0-b936-0dbfaac03e7c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149497 Oct 28 20:17:03.851716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 836/1668] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:03 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:04.388266 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bdb90ebc-1f6c-4432-9e97-d46e95c81391 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:04.390412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bdb90ebc-1f6c-4432-9e97-d46e95c81391 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:04.396840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdb90ebc-1f6c-4432-9e97-d46e95c81391 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:04.397336 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdb90ebc-1f6c-4432-9e97-d46e95c81391 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:04.397775 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdb90ebc-1f6c-4432-9e97-d46e95c81391 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:04.398460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdb90ebc-1f6c-4432-9e97-d46e95c81391 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:04.398912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdb90ebc-1f6c-4432-9e97-d46e95c81391 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:04.399333 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdb90ebc-1f6c-4432-9e97-d46e95c81391 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:04.428944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bdb90ebc-1f6c-4432-9e97-d46e95c81391 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045270 Oct 28 20:17:04.429533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 833/1669] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:04 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:04.874590 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b092d0f2-8aa6-4464-9752-33daa1a79554 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:04.875206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b092d0f2-8aa6-4464-9752-33daa1a79554 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:04.881554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b092d0f2-8aa6-4464-9752-33daa1a79554 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:04.882038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b092d0f2-8aa6-4464-9752-33daa1a79554 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:04.882495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b092d0f2-8aa6-4464-9752-33daa1a79554 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:04.883164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b092d0f2-8aa6-4464-9752-33daa1a79554 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:04.883617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b092d0f2-8aa6-4464-9752-33daa1a79554 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:04.884038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b092d0f2-8aa6-4464-9752-33daa1a79554 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:05.013777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b092d0f2-8aa6-4464-9752-33daa1a79554 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:05.022018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b092d0f2-8aa6-4464-9752-33daa1a79554 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151294 Oct 28 20:17:05.022590 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 837/1670] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:04 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:05.441790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9b7cdb97-87c9-4473-a515-93525634f076 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:05.444004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9b7cdb97-87c9-4473-a515-93525634f076 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:05.450926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b7cdb97-87c9-4473-a515-93525634f076 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:05.451408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b7cdb97-87c9-4473-a515-93525634f076 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:05.451847 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b7cdb97-87c9-4473-a515-93525634f076 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:05.452539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b7cdb97-87c9-4473-a515-93525634f076 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:05.452990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b7cdb97-87c9-4473-a515-93525634f076 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:05.453447 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b7cdb97-87c9-4473-a515-93525634f076 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:05.490115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9b7cdb97-87c9-4473-a515-93525634f076 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052289 Oct 28 20:17:05.490676 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 834/1671] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:05 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:06.046387 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3c5444d-51dd-4f79-a31b-da389561478d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:06.047007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b3c5444d-51dd-4f79-a31b-da389561478d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:06.053432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3c5444d-51dd-4f79-a31b-da389561478d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:06.053920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3c5444d-51dd-4f79-a31b-da389561478d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:06.054363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3c5444d-51dd-4f79-a31b-da389561478d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:06.055053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3c5444d-51dd-4f79-a31b-da389561478d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:06.055516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3c5444d-51dd-4f79-a31b-da389561478d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:06.055945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3c5444d-51dd-4f79-a31b-da389561478d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:06.194853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b3c5444d-51dd-4f79-a31b-da389561478d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:06.203835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b3c5444d-51dd-4f79-a31b-da389561478d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.161878 Oct 28 20:17:06.204395 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 838/1672] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:06 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:06.502659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36a6a1d3-86b7-4698-8b2a-9bdbe60160ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:06.504812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36a6a1d3-86b7-4698-8b2a-9bdbe60160ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:06.511836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36a6a1d3-86b7-4698-8b2a-9bdbe60160ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:06.512314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36a6a1d3-86b7-4698-8b2a-9bdbe60160ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:06.512750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36a6a1d3-86b7-4698-8b2a-9bdbe60160ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:06.513462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36a6a1d3-86b7-4698-8b2a-9bdbe60160ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:06.513915 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36a6a1d3-86b7-4698-8b2a-9bdbe60160ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:06.514340 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36a6a1d3-86b7-4698-8b2a-9bdbe60160ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:06.538741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:17:06.543489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36a6a1d3-86b7-4698-8b2a-9bdbe60160ec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044812 Oct 28 20:17:06.544044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 835/1673] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:06 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:07.226080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0b895cf5-8a3d-4249-99b5-ff5fd3e2fcc2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:07.226696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0b895cf5-8a3d-4249-99b5-ff5fd3e2fcc2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:07.233617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b895cf5-8a3d-4249-99b5-ff5fd3e2fcc2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:07.234095 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b895cf5-8a3d-4249-99b5-ff5fd3e2fcc2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:07.234526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b895cf5-8a3d-4249-99b5-ff5fd3e2fcc2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:07.235202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b895cf5-8a3d-4249-99b5-ff5fd3e2fcc2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:07.235654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b895cf5-8a3d-4249-99b5-ff5fd3e2fcc2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:07.236070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b895cf5-8a3d-4249-99b5-ff5fd3e2fcc2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:07.368677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0b895cf5-8a3d-4249-99b5-ff5fd3e2fcc2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:07.377261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0b895cf5-8a3d-4249-99b5-ff5fd3e2fcc2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155005 Oct 28 20:17:07.377859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 839/1674] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:07 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:07.556457 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-838d8024-ec19-46d6-a4e1-437cd1ec1f54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:07.558545 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-838d8024-ec19-46d6-a4e1-437cd1ec1f54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:07.564987 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838d8024-ec19-46d6-a4e1-437cd1ec1f54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:07.565502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838d8024-ec19-46d6-a4e1-437cd1ec1f54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:07.565943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838d8024-ec19-46d6-a4e1-437cd1ec1f54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:07.566626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838d8024-ec19-46d6-a4e1-437cd1ec1f54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:07.567080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838d8024-ec19-46d6-a4e1-437cd1ec1f54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:07.567504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-838d8024-ec19-46d6-a4e1-437cd1ec1f54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:07.596790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-838d8024-ec19-46d6-a4e1-437cd1ec1f54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044729 Oct 28 20:17:07.597358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 836/1675] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:07 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:08.400816 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-38d3dbec-d09b-4527-aa6b-a661174a480a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:08.401527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-38d3dbec-d09b-4527-aa6b-a661174a480a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:08.408456 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38d3dbec-d09b-4527-aa6b-a661174a480a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:08.408944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38d3dbec-d09b-4527-aa6b-a661174a480a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:08.409408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38d3dbec-d09b-4527-aa6b-a661174a480a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:08.410098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38d3dbec-d09b-4527-aa6b-a661174a480a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:08.410556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38d3dbec-d09b-4527-aa6b-a661174a480a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:08.410983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38d3dbec-d09b-4527-aa6b-a661174a480a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:08.538209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-38d3dbec-d09b-4527-aa6b-a661174a480a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:08.541613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:17:08.546712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-38d3dbec-d09b-4527-aa6b-a661174a480a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149808 Oct 28 20:17:08.547284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 840/1676] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:08 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:08.609180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ddded55e-2f2d-4a29-ae4b-be6b03b77bc9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:08.611362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ddded55e-2f2d-4a29-ae4b-be6b03b77bc9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:08.617681 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddded55e-2f2d-4a29-ae4b-be6b03b77bc9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:08.618163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddded55e-2f2d-4a29-ae4b-be6b03b77bc9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:08.618599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddded55e-2f2d-4a29-ae4b-be6b03b77bc9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:08.619287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddded55e-2f2d-4a29-ae4b-be6b03b77bc9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:08.619736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddded55e-2f2d-4a29-ae4b-be6b03b77bc9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:08.620154 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddded55e-2f2d-4a29-ae4b-be6b03b77bc9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:08.649047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ddded55e-2f2d-4a29-ae4b-be6b03b77bc9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043817 Oct 28 20:17:08.649623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 837/1677] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:08 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:09.570228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ada7bc63-e30a-4d2a-865e-cdb0d8e80919 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:09.570768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ada7bc63-e30a-4d2a-865e-cdb0d8e80919 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:09.577977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ada7bc63-e30a-4d2a-865e-cdb0d8e80919 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:09.578467 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ada7bc63-e30a-4d2a-865e-cdb0d8e80919 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:09.578907 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ada7bc63-e30a-4d2a-865e-cdb0d8e80919 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:09.579600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ada7bc63-e30a-4d2a-865e-cdb0d8e80919 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:09.580057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ada7bc63-e30a-4d2a-865e-cdb0d8e80919 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:09.580488 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ada7bc63-e30a-4d2a-865e-cdb0d8e80919 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:09.662246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1c83bc90-f8e1-4e58-bc68-ea54b562ce95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:09.664505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1c83bc90-f8e1-4e58-bc68-ea54b562ce95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:09.672081 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c83bc90-f8e1-4e58-bc68-ea54b562ce95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:09.672682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c83bc90-f8e1-4e58-bc68-ea54b562ce95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:09.672991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c83bc90-f8e1-4e58-bc68-ea54b562ce95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:09.673719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c83bc90-f8e1-4e58-bc68-ea54b562ce95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:09.674168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c83bc90-f8e1-4e58-bc68-ea54b562ce95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:09.674591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c83bc90-f8e1-4e58-bc68-ea54b562ce95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:09.704732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1c83bc90-f8e1-4e58-bc68-ea54b562ce95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046359 Oct 28 20:17:09.705302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 838/1678] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:09 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:17:09.714122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ada7bc63-e30a-4d2a-865e-cdb0d8e80919 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:09.722782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ada7bc63-e30a-4d2a-865e-cdb0d8e80919 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.156828 Oct 28 20:17:09.723371 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 841/1679] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:09 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:10.718183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b1575dc5-0476-4cec-80d6-e8156282d2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:10.720399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b1575dc5-0476-4cec-80d6-e8156282d2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:10.726766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1575dc5-0476-4cec-80d6-e8156282d2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:10.727247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1575dc5-0476-4cec-80d6-e8156282d2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:10.727686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1575dc5-0476-4cec-80d6-e8156282d2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:10.728374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1575dc5-0476-4cec-80d6-e8156282d2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:10.728826 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1575dc5-0476-4cec-80d6-e8156282d2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:10.729277 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1575dc5-0476-4cec-80d6-e8156282d2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:10.746889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bbf2564a-40a3-48db-8b67-62f3f3fb30e1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:10.747505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bbf2564a-40a3-48db-8b67-62f3f3fb30e1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:10.753814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbf2564a-40a3-48db-8b67-62f3f3fb30e1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:10.754303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbf2564a-40a3-48db-8b67-62f3f3fb30e1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:10.754744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbf2564a-40a3-48db-8b67-62f3f3fb30e1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:10.755445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbf2564a-40a3-48db-8b67-62f3f3fb30e1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:10.755901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbf2564a-40a3-48db-8b67-62f3f3fb30e1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:10.756331 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbf2564a-40a3-48db-8b67-62f3f3fb30e1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:10.759471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b1575dc5-0476-4cec-80d6-e8156282d2f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046214 Oct 28 20:17:10.760034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 839/1680] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:10 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:10.886004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bbf2564a-40a3-48db-8b67-62f3f3fb30e1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:10.894581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bbf2564a-40a3-48db-8b67-62f3f3fb30e1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151545 Oct 28 20:17:10.895168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 842/1681] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:10 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:17:11.772576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-007e1e7e-41cf-4df9-ab55-59346ec0880b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:11.774768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-007e1e7e-41cf-4df9-ab55-59346ec0880b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:11.781226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-007e1e7e-41cf-4df9-ab55-59346ec0880b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:11.781745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-007e1e7e-41cf-4df9-ab55-59346ec0880b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:11.782181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-007e1e7e-41cf-4df9-ab55-59346ec0880b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:11.782864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-007e1e7e-41cf-4df9-ab55-59346ec0880b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:11.783319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-007e1e7e-41cf-4df9-ab55-59346ec0880b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:11.783737 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-007e1e7e-41cf-4df9-ab55-59346ec0880b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:11.813110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-007e1e7e-41cf-4df9-ab55-59346ec0880b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044535 Oct 28 20:17:11.813683 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 840/1682] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:11 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:11.918581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-18e6e7c7-49d7-416d-9c84-dcac98512bfe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:11.919326 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-18e6e7c7-49d7-416d-9c84-dcac98512bfe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:11.925733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18e6e7c7-49d7-416d-9c84-dcac98512bfe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:11.926214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18e6e7c7-49d7-416d-9c84-dcac98512bfe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:11.926654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18e6e7c7-49d7-416d-9c84-dcac98512bfe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:11.927336 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18e6e7c7-49d7-416d-9c84-dcac98512bfe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:11.927790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18e6e7c7-49d7-416d-9c84-dcac98512bfe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:11.928213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18e6e7c7-49d7-416d-9c84-dcac98512bfe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:12.056443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-18e6e7c7-49d7-416d-9c84-dcac98512bfe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:12.064597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-18e6e7c7-49d7-416d-9c84-dcac98512bfe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150551 Oct 28 20:17:12.065217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 843/1683] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:11 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:12.826424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-67074766-353b-4390-98ea-ce5c09e36f4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:12.828605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-67074766-353b-4390-98ea-ce5c09e36f4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:12.835283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67074766-353b-4390-98ea-ce5c09e36f4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:12.835762 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67074766-353b-4390-98ea-ce5c09e36f4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:12.836198 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67074766-353b-4390-98ea-ce5c09e36f4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:12.836884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67074766-353b-4390-98ea-ce5c09e36f4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:12.837353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67074766-353b-4390-98ea-ce5c09e36f4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:12.837779 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67074766-353b-4390-98ea-ce5c09e36f4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:12.866347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-67074766-353b-4390-98ea-ce5c09e36f4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044476 Oct 28 20:17:12.866896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 841/1684] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:12 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:13.088400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-beb034f0-3f1a-44fd-a8da-525e4b229122 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:13.088946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-beb034f0-3f1a-44fd-a8da-525e4b229122 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:13.095504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beb034f0-3f1a-44fd-a8da-525e4b229122 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:13.095990 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beb034f0-3f1a-44fd-a8da-525e4b229122 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:13.096430 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beb034f0-3f1a-44fd-a8da-525e4b229122 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:13.097116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beb034f0-3f1a-44fd-a8da-525e4b229122 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:13.097870 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beb034f0-3f1a-44fd-a8da-525e4b229122 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:13.098301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beb034f0-3f1a-44fd-a8da-525e4b229122 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:13.249207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-beb034f0-3f1a-44fd-a8da-525e4b229122 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:13.257671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-beb034f0-3f1a-44fd-a8da-525e4b229122 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.173286 Oct 28 20:17:13.258247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 844/1685] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:13 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:13.878749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e8d593a1-0ae1-4fc9-bc01-b23c24cba046 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:13.880912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e8d593a1-0ae1-4fc9-bc01-b23c24cba046 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:13.888409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d593a1-0ae1-4fc9-bc01-b23c24cba046 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:13.888895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d593a1-0ae1-4fc9-bc01-b23c24cba046 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:13.889357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d593a1-0ae1-4fc9-bc01-b23c24cba046 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:13.890061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d593a1-0ae1-4fc9-bc01-b23c24cba046 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:13.890516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d593a1-0ae1-4fc9-bc01-b23c24cba046 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:13.890942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d593a1-0ae1-4fc9-bc01-b23c24cba046 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:13.921203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e8d593a1-0ae1-4fc9-bc01-b23c24cba046 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046389 Oct 28 20:17:13.921785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 842/1686] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:13 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:14.287805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-05790919-3631-4ab8-88a8-9d6624337934 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:14.289481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-05790919-3631-4ab8-88a8-9d6624337934 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:14.301608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05790919-3631-4ab8-88a8-9d6624337934 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:14.302495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05790919-3631-4ab8-88a8-9d6624337934 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:14.303551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05790919-3631-4ab8-88a8-9d6624337934 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:14.304818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05790919-3631-4ab8-88a8-9d6624337934 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:14.305696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05790919-3631-4ab8-88a8-9d6624337934 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:14.306498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05790919-3631-4ab8-88a8-9d6624337934 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:14.446850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-05790919-3631-4ab8-88a8-9d6624337934 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:14.455653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-05790919-3631-4ab8-88a8-9d6624337934 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.174828 Oct 28 20:17:14.456219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 845/1687] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:14 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:17:14.934314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7c61624b-350d-4614-92e4-6e4179edc5a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:14.936395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7c61624b-350d-4614-92e4-6e4179edc5a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:14.942812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c61624b-350d-4614-92e4-6e4179edc5a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:14.943287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c61624b-350d-4614-92e4-6e4179edc5a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:14.943721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c61624b-350d-4614-92e4-6e4179edc5a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:14.944409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c61624b-350d-4614-92e4-6e4179edc5a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:14.944858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c61624b-350d-4614-92e4-6e4179edc5a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:14.945295 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c61624b-350d-4614-92e4-6e4179edc5a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:14.974949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7c61624b-350d-4614-92e4-6e4179edc5a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045317 Oct 28 20:17:14.975492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 843/1688] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:14 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:15.480191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a5bdde3e-e2a3-4074-81e0-96def79334f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:15.481803 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a5bdde3e-e2a3-4074-81e0-96def79334f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:15.488018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5bdde3e-e2a3-4074-81e0-96def79334f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:15.488504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5bdde3e-e2a3-4074-81e0-96def79334f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:15.488940 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5bdde3e-e2a3-4074-81e0-96def79334f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:15.489655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5bdde3e-e2a3-4074-81e0-96def79334f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:15.490114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5bdde3e-e2a3-4074-81e0-96def79334f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:15.490545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5bdde3e-e2a3-4074-81e0-96def79334f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:15.632317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a5bdde3e-e2a3-4074-81e0-96def79334f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:15.641015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a5bdde3e-e2a3-4074-81e0-96def79334f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.164817 Oct 28 20:17:15.641625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 846/1689] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:15 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:15.987425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05f4cddf-c36e-40df-b00d-400fce1d653f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:15.991303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-05f4cddf-c36e-40df-b00d-400fce1d653f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:15.996347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05f4cddf-c36e-40df-b00d-400fce1d653f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:15.997081 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05f4cddf-c36e-40df-b00d-400fce1d653f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:15.997559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05f4cddf-c36e-40df-b00d-400fce1d653f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:15.998259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05f4cddf-c36e-40df-b00d-400fce1d653f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:15.998720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05f4cddf-c36e-40df-b00d-400fce1d653f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:15.999147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05f4cddf-c36e-40df-b00d-400fce1d653f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:16.030828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05f4cddf-c36e-40df-b00d-400fce1d653f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047393 Oct 28 20:17:16.031458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 844/1690] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:15 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:16.664171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c6b4a5cb-bc67-452d-bcba-cc0d1ba090e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:16.664767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c6b4a5cb-bc67-452d-bcba-cc0d1ba090e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:16.666784 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:17:16.666926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:17:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 (ip 10.222.0.66) !!! Oct 28 20:17:16.674342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6b4a5cb-bc67-452d-bcba-cc0d1ba090e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:16.674819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6b4a5cb-bc67-452d-bcba-cc0d1ba090e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:16.675249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6b4a5cb-bc67-452d-bcba-cc0d1ba090e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:16.675928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6b4a5cb-bc67-452d-bcba-cc0d1ba090e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:16.676374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6b4a5cb-bc67-452d-bcba-cc0d1ba090e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:16.676788 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6b4a5cb-bc67-452d-bcba-cc0d1ba090e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:16.805160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c6b4a5cb-bc67-452d-bcba-cc0d1ba090e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:16.813439 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c6b4a5cb-bc67-452d-bcba-cc0d1ba090e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153089 Oct 28 20:17:16.814002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 847/1691] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:16 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:17.043524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2e48d2d3-45da-4004-a6db-c53d0cb96746 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:17.045789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2e48d2d3-45da-4004-a6db-c53d0cb96746 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:17.051686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e48d2d3-45da-4004-a6db-c53d0cb96746 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:17.052170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e48d2d3-45da-4004-a6db-c53d0cb96746 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:17.052609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e48d2d3-45da-4004-a6db-c53d0cb96746 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:17.053352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e48d2d3-45da-4004-a6db-c53d0cb96746 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:17.053803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e48d2d3-45da-4004-a6db-c53d0cb96746 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:17.054230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e48d2d3-45da-4004-a6db-c53d0cb96746 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:17.085604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2e48d2d3-45da-4004-a6db-c53d0cb96746 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046234 Oct 28 20:17:17.086160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 845/1692] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:17 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:17.836578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9f703648-da1a-4cdf-8b0f-1ee89e7814e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:17.837198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9f703648-da1a-4cdf-8b0f-1ee89e7814e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:17.844244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f703648-da1a-4cdf-8b0f-1ee89e7814e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:17.844731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f703648-da1a-4cdf-8b0f-1ee89e7814e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:17.845161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f703648-da1a-4cdf-8b0f-1ee89e7814e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:17.845895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f703648-da1a-4cdf-8b0f-1ee89e7814e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:17.846334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f703648-da1a-4cdf-8b0f-1ee89e7814e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:17.846755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f703648-da1a-4cdf-8b0f-1ee89e7814e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:17.972715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9f703648-da1a-4cdf-8b0f-1ee89e7814e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:17.980971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9f703648-da1a-4cdf-8b0f-1ee89e7814e4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.148312 Oct 28 20:17:17.981575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 848/1693] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:17 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:18.099085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-da68b293-47cb-488b-aca1-ce454d719919 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:18.101191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-da68b293-47cb-488b-aca1-ce454d719919 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:18.107983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da68b293-47cb-488b-aca1-ce454d719919 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:18.108469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da68b293-47cb-488b-aca1-ce454d719919 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:18.108909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da68b293-47cb-488b-aca1-ce454d719919 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:18.109634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da68b293-47cb-488b-aca1-ce454d719919 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:18.110091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da68b293-47cb-488b-aca1-ce454d719919 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:18.110517 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da68b293-47cb-488b-aca1-ce454d719919 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:18.140166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-da68b293-47cb-488b-aca1-ce454d719919 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045157 Oct 28 20:17:18.140712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 846/1694] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:18 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:19.003779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-adaf9d75-e1e6-4016-88f2-044fc80bbb16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:19.004396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-adaf9d75-e1e6-4016-88f2-044fc80bbb16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:19.010879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adaf9d75-e1e6-4016-88f2-044fc80bbb16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:19.011374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adaf9d75-e1e6-4016-88f2-044fc80bbb16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:19.011818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adaf9d75-e1e6-4016-88f2-044fc80bbb16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:19.012510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adaf9d75-e1e6-4016-88f2-044fc80bbb16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:19.013715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adaf9d75-e1e6-4016-88f2-044fc80bbb16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:19.014245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adaf9d75-e1e6-4016-88f2-044fc80bbb16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:19.145180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-adaf9d75-e1e6-4016-88f2-044fc80bbb16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:19.152204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-62763e01-51f4-436a-a2e2-4fc424df50ef tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:19.154057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-adaf9d75-e1e6-4016-88f2-044fc80bbb16 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153486 Oct 28 20:17:19.154903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 849/1695] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:18 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:19.155221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-62763e01-51f4-436a-a2e2-4fc424df50ef tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:19.161582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62763e01-51f4-436a-a2e2-4fc424df50ef tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:19.162062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62763e01-51f4-436a-a2e2-4fc424df50ef tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:19.162506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62763e01-51f4-436a-a2e2-4fc424df50ef tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:19.163217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62763e01-51f4-436a-a2e2-4fc424df50ef tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:19.163667 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62763e01-51f4-436a-a2e2-4fc424df50ef tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:19.164087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62763e01-51f4-436a-a2e2-4fc424df50ef tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:19.192957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-62763e01-51f4-436a-a2e2-4fc424df50ef tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044731 Oct 28 20:17:19.193538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 847/1696] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:19 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:20.178310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2d91a90d-826c-4e0f-8fb0-56461b2e3344 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:20.179211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2d91a90d-826c-4e0f-8fb0-56461b2e3344 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:20.186645 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d91a90d-826c-4e0f-8fb0-56461b2e3344 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:20.187134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d91a90d-826c-4e0f-8fb0-56461b2e3344 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:20.187573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d91a90d-826c-4e0f-8fb0-56461b2e3344 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:20.188262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d91a90d-826c-4e0f-8fb0-56461b2e3344 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:20.188717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d91a90d-826c-4e0f-8fb0-56461b2e3344 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:20.189140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d91a90d-826c-4e0f-8fb0-56461b2e3344 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:20.205941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c0e7cbe6-0a33-4ace-a834-e429ff3c4e73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:20.208087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c0e7cbe6-0a33-4ace-a834-e429ff3c4e73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:20.214642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0e7cbe6-0a33-4ace-a834-e429ff3c4e73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:20.215114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0e7cbe6-0a33-4ace-a834-e429ff3c4e73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:20.215546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0e7cbe6-0a33-4ace-a834-e429ff3c4e73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:20.216298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0e7cbe6-0a33-4ace-a834-e429ff3c4e73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:20.216747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0e7cbe6-0a33-4ace-a834-e429ff3c4e73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:20.217165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0e7cbe6-0a33-4ace-a834-e429ff3c4e73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:20.247413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c0e7cbe6-0a33-4ace-a834-e429ff3c4e73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044797 Oct 28 20:17:20.247999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 848/1697] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:20 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:20.317642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2d91a90d-826c-4e0f-8fb0-56461b2e3344 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:20.326657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2d91a90d-826c-4e0f-8fb0-56461b2e3344 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152139 Oct 28 20:17:20.327231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 850/1698] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:20 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:21.259898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e3b9d17a-4322-4771-b207-89074518412f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:21.262131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e3b9d17a-4322-4771-b207-89074518412f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:21.269087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3b9d17a-4322-4771-b207-89074518412f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:21.269601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3b9d17a-4322-4771-b207-89074518412f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:21.270039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3b9d17a-4322-4771-b207-89074518412f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:21.270724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3b9d17a-4322-4771-b207-89074518412f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:21.271173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3b9d17a-4322-4771-b207-89074518412f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:21.271595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3b9d17a-4322-4771-b207-89074518412f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:21.301252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e3b9d17a-4322-4771-b207-89074518412f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045244 Oct 28 20:17:21.301785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 849/1699] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:21 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:21.349963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d6d5c73-521c-4c48-bb88-caf36b4f0438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:21.350573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3d6d5c73-521c-4c48-bb88-caf36b4f0438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:21.357550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d6d5c73-521c-4c48-bb88-caf36b4f0438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:21.358015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d6d5c73-521c-4c48-bb88-caf36b4f0438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:21.358449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d6d5c73-521c-4c48-bb88-caf36b4f0438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:21.359118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d6d5c73-521c-4c48-bb88-caf36b4f0438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:21.359587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d6d5c73-521c-4c48-bb88-caf36b4f0438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:21.360005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d6d5c73-521c-4c48-bb88-caf36b4f0438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:21.489015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3d6d5c73-521c-4c48-bb88-caf36b4f0438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:21.497924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3d6d5c73-521c-4c48-bb88-caf36b4f0438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151236 Oct 28 20:17:21.498566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 851/1700] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:21 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:22.313457 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8da01cc8-1844-49fd-8225-29467a529191 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:22.315582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8da01cc8-1844-49fd-8225-29467a529191 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:22.322038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8da01cc8-1844-49fd-8225-29467a529191 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:22.322521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8da01cc8-1844-49fd-8225-29467a529191 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:22.322970 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8da01cc8-1844-49fd-8225-29467a529191 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:22.323659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8da01cc8-1844-49fd-8225-29467a529191 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:22.324116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8da01cc8-1844-49fd-8225-29467a529191 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:22.324543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8da01cc8-1844-49fd-8225-29467a529191 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:22.354909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8da01cc8-1844-49fd-8225-29467a529191 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045760 Oct 28 20:17:22.355459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 850/1701] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:22 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:22.520877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fad2c034-c6b8-4ec4-b366-a1c4e5d75534 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:22.521518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fad2c034-c6b8-4ec4-b366-a1c4e5d75534 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:22.528162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad2c034-c6b8-4ec4-b366-a1c4e5d75534 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:22.529229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad2c034-c6b8-4ec4-b366-a1c4e5d75534 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:22.529703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad2c034-c6b8-4ec4-b366-a1c4e5d75534 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:22.530437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad2c034-c6b8-4ec4-b366-a1c4e5d75534 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:22.530898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad2c034-c6b8-4ec4-b366-a1c4e5d75534 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:22.531325 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad2c034-c6b8-4ec4-b366-a1c4e5d75534 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:22.659654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fad2c034-c6b8-4ec4-b366-a1c4e5d75534 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:22.667344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fad2c034-c6b8-4ec4-b366-a1c4e5d75534 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150359 Oct 28 20:17:22.667904 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 852/1702] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:22 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:23.367479 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4681628e-a3e0-4f88-9684-20587feb05ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:23.369716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4681628e-a3e0-4f88-9684-20587feb05ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:23.376857 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4681628e-a3e0-4f88-9684-20587feb05ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:23.377373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4681628e-a3e0-4f88-9684-20587feb05ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:23.377817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4681628e-a3e0-4f88-9684-20587feb05ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:23.378509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4681628e-a3e0-4f88-9684-20587feb05ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:23.378963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4681628e-a3e0-4f88-9684-20587feb05ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:23.379386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4681628e-a3e0-4f88-9684-20587feb05ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:23.408659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4681628e-a3e0-4f88-9684-20587feb05ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045164 Oct 28 20:17:23.414429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 851/1703] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:23 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:23.691287 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a9c4486a-32b9-44a0-a086-b68f2a7b6d24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:23.691830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a9c4486a-32b9-44a0-a086-b68f2a7b6d24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:23.698277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9c4486a-32b9-44a0-a086-b68f2a7b6d24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:23.698765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9c4486a-32b9-44a0-a086-b68f2a7b6d24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:23.699206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9c4486a-32b9-44a0-a086-b68f2a7b6d24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:23.699894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9c4486a-32b9-44a0-a086-b68f2a7b6d24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:23.700820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9c4486a-32b9-44a0-a086-b68f2a7b6d24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:23.701257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9c4486a-32b9-44a0-a086-b68f2a7b6d24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:23.829400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a9c4486a-32b9-44a0-a086-b68f2a7b6d24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:23.837684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a9c4486a-32b9-44a0-a086-b68f2a7b6d24 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150316 Oct 28 20:17:23.838281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 853/1704] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:23 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:24.421596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-977d6d78-0f20-4cfc-9881-5ee07d1c94a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:24.423678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-977d6d78-0f20-4cfc-9881-5ee07d1c94a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:24.430010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-977d6d78-0f20-4cfc-9881-5ee07d1c94a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:24.430491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-977d6d78-0f20-4cfc-9881-5ee07d1c94a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:24.430930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-977d6d78-0f20-4cfc-9881-5ee07d1c94a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:24.431620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-977d6d78-0f20-4cfc-9881-5ee07d1c94a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:24.432073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-977d6d78-0f20-4cfc-9881-5ee07d1c94a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:24.432495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-977d6d78-0f20-4cfc-9881-5ee07d1c94a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:24.445886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:17:24.462248 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-977d6d78-0f20-4cfc-9881-5ee07d1c94a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045081 Oct 28 20:17:24.466355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 852/1705] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:24 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:24.861134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a00c49b-d3b4-4437-a61d-68c35bd91631 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:24.861768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0a00c49b-d3b4-4437-a61d-68c35bd91631 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:24.867779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a00c49b-d3b4-4437-a61d-68c35bd91631 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:24.868277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a00c49b-d3b4-4437-a61d-68c35bd91631 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:24.868727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a00c49b-d3b4-4437-a61d-68c35bd91631 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:24.869421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a00c49b-d3b4-4437-a61d-68c35bd91631 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:24.869878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a00c49b-d3b4-4437-a61d-68c35bd91631 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:24.870303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a00c49b-d3b4-4437-a61d-68c35bd91631 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:25.003050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a00c49b-d3b4-4437-a61d-68c35bd91631 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:25.011117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0a00c49b-d3b4-4437-a61d-68c35bd91631 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153892 Oct 28 20:17:25.011687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 854/1706] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:24 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:25.477280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-052dd086-6477-4dcc-80e4-d44801695444 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:25.479515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-052dd086-6477-4dcc-80e4-d44801695444 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:25.486813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-052dd086-6477-4dcc-80e4-d44801695444 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:25.487297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-052dd086-6477-4dcc-80e4-d44801695444 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:25.487735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-052dd086-6477-4dcc-80e4-d44801695444 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:25.488428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-052dd086-6477-4dcc-80e4-d44801695444 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:25.488890 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-052dd086-6477-4dcc-80e4-d44801695444 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:25.489312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-052dd086-6477-4dcc-80e4-d44801695444 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:25.518286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-052dd086-6477-4dcc-80e4-d44801695444 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045363 Oct 28 20:17:25.518837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 853/1707] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:25 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:26.035025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a61bfb74-67b5-4718-9c49-45208b2624c6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:26.035648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a61bfb74-67b5-4718-9c49-45208b2624c6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:26.042259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a61bfb74-67b5-4718-9c49-45208b2624c6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:26.043108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a61bfb74-67b5-4718-9c49-45208b2624c6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:26.043559 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a61bfb74-67b5-4718-9c49-45208b2624c6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:26.044275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a61bfb74-67b5-4718-9c49-45208b2624c6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:26.044733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a61bfb74-67b5-4718-9c49-45208b2624c6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:26.045164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a61bfb74-67b5-4718-9c49-45208b2624c6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:26.179844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a61bfb74-67b5-4718-9c49-45208b2624c6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:26.188566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a61bfb74-67b5-4718-9c49-45208b2624c6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.157328 Oct 28 20:17:26.189212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 855/1708] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:26 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:17:26.530818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e4082717-6c56-47dc-8121-19557fb242f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:26.532943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e4082717-6c56-47dc-8121-19557fb242f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:26.539256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4082717-6c56-47dc-8121-19557fb242f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:26.539731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4082717-6c56-47dc-8121-19557fb242f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:26.540164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4082717-6c56-47dc-8121-19557fb242f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:26.540844 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4082717-6c56-47dc-8121-19557fb242f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:26.541291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4082717-6c56-47dc-8121-19557fb242f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:26.541735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4082717-6c56-47dc-8121-19557fb242f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:26.571219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e4082717-6c56-47dc-8121-19557fb242f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 Oct 28 20:17:26.571752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 854/1709] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:26 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:27.213060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-741588ab-cad7-4da4-a7d8-7a329ba1e0ca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:27.213775 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-741588ab-cad7-4da4-a7d8-7a329ba1e0ca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:27.220713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-741588ab-cad7-4da4-a7d8-7a329ba1e0ca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:27.221199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-741588ab-cad7-4da4-a7d8-7a329ba1e0ca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:27.221670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-741588ab-cad7-4da4-a7d8-7a329ba1e0ca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:27.222355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-741588ab-cad7-4da4-a7d8-7a329ba1e0ca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:27.222804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-741588ab-cad7-4da4-a7d8-7a329ba1e0ca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:27.223225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-741588ab-cad7-4da4-a7d8-7a329ba1e0ca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:27.360382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-741588ab-cad7-4da4-a7d8-7a329ba1e0ca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:27.368544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-741588ab-cad7-4da4-a7d8-7a329ba1e0ca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.160535 Oct 28 20:17:27.369107 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 856/1710] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:27 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:27.583795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9dcc88ea-8595-4111-8f56-9fd1865df3e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:27.586214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9dcc88ea-8595-4111-8f56-9fd1865df3e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:27.593544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dcc88ea-8595-4111-8f56-9fd1865df3e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:27.594031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dcc88ea-8595-4111-8f56-9fd1865df3e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:27.594468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dcc88ea-8595-4111-8f56-9fd1865df3e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:27.595160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dcc88ea-8595-4111-8f56-9fd1865df3e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:27.595615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dcc88ea-8595-4111-8f56-9fd1865df3e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:27.596039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dcc88ea-8595-4111-8f56-9fd1865df3e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:27.626185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9dcc88ea-8595-4111-8f56-9fd1865df3e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046515 Oct 28 20:17:27.626747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 855/1711] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:27 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:28.391643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a568d942-accb-45c1-9b7f-3feeb45cbcbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:28.392259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a568d942-accb-45c1-9b7f-3feeb45cbcbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:28.398697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a568d942-accb-45c1-9b7f-3feeb45cbcbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:28.399183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a568d942-accb-45c1-9b7f-3feeb45cbcbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:28.399631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a568d942-accb-45c1-9b7f-3feeb45cbcbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:28.400315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a568d942-accb-45c1-9b7f-3feeb45cbcbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:28.400775 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a568d942-accb-45c1-9b7f-3feeb45cbcbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:28.401203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a568d942-accb-45c1-9b7f-3feeb45cbcbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:28.419788 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:17:28.530195 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a568d942-accb-45c1-9b7f-3feeb45cbcbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:28.538320 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a568d942-accb-45c1-9b7f-3feeb45cbcbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151369 Oct 28 20:17:28.538828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 857/1712] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:28 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:28.639172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9daab0ee-e54b-4d43-b1c2-c8b558f89171 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:28.641343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9daab0ee-e54b-4d43-b1c2-c8b558f89171 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:28.647710 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9daab0ee-e54b-4d43-b1c2-c8b558f89171 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:28.648187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9daab0ee-e54b-4d43-b1c2-c8b558f89171 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:28.648623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9daab0ee-e54b-4d43-b1c2-c8b558f89171 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:28.649308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9daab0ee-e54b-4d43-b1c2-c8b558f89171 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:28.649782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9daab0ee-e54b-4d43-b1c2-c8b558f89171 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:28.650203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9daab0ee-e54b-4d43-b1c2-c8b558f89171 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:28.679039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9daab0ee-e54b-4d43-b1c2-c8b558f89171 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Oct 28 20:17:28.679581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 856/1713] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:28 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:29.562703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3054e406-8c5d-45bb-9ee5-8c37de98879b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:29.563325 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3054e406-8c5d-45bb-9ee5-8c37de98879b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:29.571475 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3054e406-8c5d-45bb-9ee5-8c37de98879b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:29.571957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3054e406-8c5d-45bb-9ee5-8c37de98879b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:29.572466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3054e406-8c5d-45bb-9ee5-8c37de98879b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:29.573538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3054e406-8c5d-45bb-9ee5-8c37de98879b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:29.573993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3054e406-8c5d-45bb-9ee5-8c37de98879b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:29.574411 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3054e406-8c5d-45bb-9ee5-8c37de98879b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:29.691890 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aa0a1c69-42d6-4568-93dc-0ccd438863b2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:29.694079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aa0a1c69-42d6-4568-93dc-0ccd438863b2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:29.696419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=60 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:17:29.702108 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0a1c69-42d6-4568-93dc-0ccd438863b2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:29.702661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0a1c69-42d6-4568-93dc-0ccd438863b2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:29.703147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0a1c69-42d6-4568-93dc-0ccd438863b2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:29.703877 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0a1c69-42d6-4568-93dc-0ccd438863b2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:29.704339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0a1c69-42d6-4568-93dc-0ccd438863b2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:29.704768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0a1c69-42d6-4568-93dc-0ccd438863b2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:29.712428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3054e406-8c5d-45bb-9ee5-8c37de98879b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:29.720817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3054e406-8c5d-45bb-9ee5-8c37de98879b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.163253 Oct 28 20:17:29.721517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 858/1714] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:29 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:29.738377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aa0a1c69-42d6-4568-93dc-0ccd438863b2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050636 Oct 28 20:17:29.738944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 857/1715] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:29 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:17:30.743920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-974df355-993e-4bd3-bec4-bdbc61b54017 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:30.744531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-974df355-993e-4bd3-bec4-bdbc61b54017 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:30.747659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:17:30.747815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:17:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 (ip 10.222.0.66) !!! Oct 28 20:17:30.751548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b77dc44d-782b-4652-99c7-c73d9e531c54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:30.753486 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-974df355-993e-4bd3-bec4-bdbc61b54017 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:30.753967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-974df355-993e-4bd3-bec4-bdbc61b54017 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:30.754403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-974df355-993e-4bd3-bec4-bdbc61b54017 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:30.754968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b77dc44d-782b-4652-99c7-c73d9e531c54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:30.755083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-974df355-993e-4bd3-bec4-bdbc61b54017 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:30.755529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-974df355-993e-4bd3-bec4-bdbc61b54017 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:30.755946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-974df355-993e-4bd3-bec4-bdbc61b54017 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:30.757465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:17:30.757611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:17:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments (ip 10.222.0.66) !!! Oct 28 20:17:30.772493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b77dc44d-782b-4652-99c7-c73d9e531c54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:30.772682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b77dc44d-782b-4652-99c7-c73d9e531c54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:30.773000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b77dc44d-782b-4652-99c7-c73d9e531c54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:30.773747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b77dc44d-782b-4652-99c7-c73d9e531c54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:30.774205 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b77dc44d-782b-4652-99c7-c73d9e531c54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:30.774634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b77dc44d-782b-4652-99c7-c73d9e531c54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:30.804391 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b77dc44d-782b-4652-99c7-c73d9e531c54 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058067 Oct 28 20:17:30.804959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 858/1716] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:30 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:17:30.885601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-974df355-993e-4bd3-bec4-bdbc61b54017 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:30.894415 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-974df355-993e-4bd3-bec4-bdbc61b54017 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154328 Oct 28 20:17:30.894973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 859/1717] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:30 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:31.816706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8fb7548a-dd0f-47e2-bd59-c1be19b311e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:31.818912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8fb7548a-dd0f-47e2-bd59-c1be19b311e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:31.825828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fb7548a-dd0f-47e2-bd59-c1be19b311e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:31.826300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fb7548a-dd0f-47e2-bd59-c1be19b311e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:31.826727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fb7548a-dd0f-47e2-bd59-c1be19b311e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:31.827407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fb7548a-dd0f-47e2-bd59-c1be19b311e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:31.827853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fb7548a-dd0f-47e2-bd59-c1be19b311e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:31.828270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fb7548a-dd0f-47e2-bd59-c1be19b311e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:31.857525 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8fb7548a-dd0f-47e2-bd59-c1be19b311e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044832 Oct 28 20:17:31.858062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 859/1718] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:31 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:31.917647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-74cd685d-666c-42e6-90e4-c87d5a3bab53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:31.918298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-74cd685d-666c-42e6-90e4-c87d5a3bab53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:31.920623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=52 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:17:31.925257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74cd685d-666c-42e6-90e4-c87d5a3bab53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:31.925775 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74cd685d-666c-42e6-90e4-c87d5a3bab53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:31.926215 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74cd685d-666c-42e6-90e4-c87d5a3bab53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:31.926902 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74cd685d-666c-42e6-90e4-c87d5a3bab53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:31.927404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74cd685d-666c-42e6-90e4-c87d5a3bab53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:31.933348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74cd685d-666c-42e6-90e4-c87d5a3bab53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:32.055871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-74cd685d-666c-42e6-90e4-c87d5a3bab53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:32.064648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-74cd685d-666c-42e6-90e4-c87d5a3bab53 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150812 Oct 28 20:17:32.065276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 860/1719] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:31 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:32.869589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8f5d72b7-fe51-4dc5-b6c5-c6726d9b7d1c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:32.872254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8f5d72b7-fe51-4dc5-b6c5-c6726d9b7d1c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:32.878583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f5d72b7-fe51-4dc5-b6c5-c6726d9b7d1c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:32.879054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f5d72b7-fe51-4dc5-b6c5-c6726d9b7d1c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:32.879483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f5d72b7-fe51-4dc5-b6c5-c6726d9b7d1c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:32.880158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f5d72b7-fe51-4dc5-b6c5-c6726d9b7d1c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:32.880604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f5d72b7-fe51-4dc5-b6c5-c6726d9b7d1c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:32.881021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f5d72b7-fe51-4dc5-b6c5-c6726d9b7d1c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:32.909835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8f5d72b7-fe51-4dc5-b6c5-c6726d9b7d1c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044309 Oct 28 20:17:32.910375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 860/1720] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:32 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:33.087956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-078b0ec6-4c25-4a61-ae1f-f7ec6bc8cc37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:33.088567 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-078b0ec6-4c25-4a61-ae1f-f7ec6bc8cc37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:33.095790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-078b0ec6-4c25-4a61-ae1f-f7ec6bc8cc37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:33.096277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-078b0ec6-4c25-4a61-ae1f-f7ec6bc8cc37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:33.096712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-078b0ec6-4c25-4a61-ae1f-f7ec6bc8cc37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:33.097433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-078b0ec6-4c25-4a61-ae1f-f7ec6bc8cc37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:33.097891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-078b0ec6-4c25-4a61-ae1f-f7ec6bc8cc37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:33.098315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-078b0ec6-4c25-4a61-ae1f-f7ec6bc8cc37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:33.228964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-078b0ec6-4c25-4a61-ae1f-f7ec6bc8cc37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:33.237047 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-078b0ec6-4c25-4a61-ae1f-f7ec6bc8cc37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153165 Oct 28 20:17:33.237636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 861/1721] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:33 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:33.922170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-07352fc5-c63e-4d39-af7a-11007a7bc727 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:33.924993 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-07352fc5-c63e-4d39-af7a-11007a7bc727 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:33.931535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07352fc5-c63e-4d39-af7a-11007a7bc727 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:33.932008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07352fc5-c63e-4d39-af7a-11007a7bc727 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:33.932436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07352fc5-c63e-4d39-af7a-11007a7bc727 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:33.933112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07352fc5-c63e-4d39-af7a-11007a7bc727 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:33.933586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07352fc5-c63e-4d39-af7a-11007a7bc727 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:33.934543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07352fc5-c63e-4d39-af7a-11007a7bc727 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:33.964061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-07352fc5-c63e-4d39-af7a-11007a7bc727 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046113 Oct 28 20:17:33.964599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 861/1722] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:33 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:34.259966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4a0ad9a0-cc6b-4494-a482-484507756ebe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:34.260575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4a0ad9a0-cc6b-4494-a482-484507756ebe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:34.267456 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a0ad9a0-cc6b-4494-a482-484507756ebe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:34.267935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a0ad9a0-cc6b-4494-a482-484507756ebe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:34.268366 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a0ad9a0-cc6b-4494-a482-484507756ebe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:34.269044 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a0ad9a0-cc6b-4494-a482-484507756ebe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:34.269526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a0ad9a0-cc6b-4494-a482-484507756ebe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:34.269947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a0ad9a0-cc6b-4494-a482-484507756ebe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:34.398372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4a0ad9a0-cc6b-4494-a482-484507756ebe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:34.406618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4a0ad9a0-cc6b-4494-a482-484507756ebe tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150465 Oct 28 20:17:34.407183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 862/1723] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:34 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:34.975946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e9f85e0f-8cb8-4243-80ff-1a47edb24ed7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:34.978114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e9f85e0f-8cb8-4243-80ff-1a47edb24ed7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:34.984929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9f85e0f-8cb8-4243-80ff-1a47edb24ed7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:34.985431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9f85e0f-8cb8-4243-80ff-1a47edb24ed7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:34.985860 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9f85e0f-8cb8-4243-80ff-1a47edb24ed7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:34.986567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9f85e0f-8cb8-4243-80ff-1a47edb24ed7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:34.987014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9f85e0f-8cb8-4243-80ff-1a47edb24ed7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:34.987435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9f85e0f-8cb8-4243-80ff-1a47edb24ed7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:35.016665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e9f85e0f-8cb8-4243-80ff-1a47edb24ed7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Oct 28 20:17:35.017215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 862/1724] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:34 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:35.428800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b2dbc7c0-c9a2-48c5-b834-582826931389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:35.429437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b2dbc7c0-c9a2-48c5-b834-582826931389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:35.436046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2dbc7c0-c9a2-48c5-b834-582826931389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:35.436536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2dbc7c0-c9a2-48c5-b834-582826931389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:35.436980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2dbc7c0-c9a2-48c5-b834-582826931389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:35.437705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2dbc7c0-c9a2-48c5-b834-582826931389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:35.438160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2dbc7c0-c9a2-48c5-b834-582826931389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:35.438583 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2dbc7c0-c9a2-48c5-b834-582826931389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:35.569659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b2dbc7c0-c9a2-48c5-b834-582826931389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:35.578191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b2dbc7c0-c9a2-48c5-b834-582826931389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153181 Oct 28 20:17:35.578759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 863/1725] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:35 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:36.028501 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5c835d25-672e-4f18-b6a4-aee7a8e15c4a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:36.031383 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5c835d25-672e-4f18-b6a4-aee7a8e15c4a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:36.038136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c835d25-672e-4f18-b6a4-aee7a8e15c4a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:36.038623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c835d25-672e-4f18-b6a4-aee7a8e15c4a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:36.039065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c835d25-672e-4f18-b6a4-aee7a8e15c4a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:36.039765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c835d25-672e-4f18-b6a4-aee7a8e15c4a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:36.040224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c835d25-672e-4f18-b6a4-aee7a8e15c4a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:36.040683 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c835d25-672e-4f18-b6a4-aee7a8e15c4a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:36.070747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5c835d25-672e-4f18-b6a4-aee7a8e15c4a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046206 Oct 28 20:17:36.071213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 863/1726] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:36 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:36.601570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-58ad4522-a2ca-4b8b-8370-1e66cae9cb5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:36.602188 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-58ad4522-a2ca-4b8b-8370-1e66cae9cb5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:36.608580 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58ad4522-a2ca-4b8b-8370-1e66cae9cb5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:36.609060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58ad4522-a2ca-4b8b-8370-1e66cae9cb5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:36.609530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58ad4522-a2ca-4b8b-8370-1e66cae9cb5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:36.610221 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58ad4522-a2ca-4b8b-8370-1e66cae9cb5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:36.610707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58ad4522-a2ca-4b8b-8370-1e66cae9cb5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:36.611136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58ad4522-a2ca-4b8b-8370-1e66cae9cb5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:36.738814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-58ad4522-a2ca-4b8b-8370-1e66cae9cb5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:36.746941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-58ad4522-a2ca-4b8b-8370-1e66cae9cb5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149227 Oct 28 20:17:36.747504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 864/1727] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:36 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:37.083222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a77a3d8-b7b0-4350-93ac-0a9d778fab70 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:37.085658 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7a77a3d8-b7b0-4350-93ac-0a9d778fab70 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:37.091964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a77a3d8-b7b0-4350-93ac-0a9d778fab70 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:37.092527 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a77a3d8-b7b0-4350-93ac-0a9d778fab70 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:37.092963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a77a3d8-b7b0-4350-93ac-0a9d778fab70 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:37.093703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a77a3d8-b7b0-4350-93ac-0a9d778fab70 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:37.094156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a77a3d8-b7b0-4350-93ac-0a9d778fab70 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:37.094582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a77a3d8-b7b0-4350-93ac-0a9d778fab70 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:37.126101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7a77a3d8-b7b0-4350-93ac-0a9d778fab70 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046720 Oct 28 20:17:37.126581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 864/1728] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:37 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:37.770642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9f504dda-f54b-42bc-95f2-57168b48dc2c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:37.771293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9f504dda-f54b-42bc-95f2-57168b48dc2c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:37.777786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f504dda-f54b-42bc-95f2-57168b48dc2c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:37.778271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f504dda-f54b-42bc-95f2-57168b48dc2c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:37.778712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f504dda-f54b-42bc-95f2-57168b48dc2c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:37.779991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f504dda-f54b-42bc-95f2-57168b48dc2c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:37.780460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f504dda-f54b-42bc-95f2-57168b48dc2c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:37.780895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f504dda-f54b-42bc-95f2-57168b48dc2c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:37.913578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9f504dda-f54b-42bc-95f2-57168b48dc2c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:37.922573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9f504dda-f54b-42bc-95f2-57168b48dc2c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155822 Oct 28 20:17:37.923225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 865/1729] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:37 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:38.137821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-27c516a8-4b0c-4952-b520-071c8bb3650b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:38.140171 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-27c516a8-4b0c-4952-b520-071c8bb3650b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:38.146516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c516a8-4b0c-4952-b520-071c8bb3650b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:38.146988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c516a8-4b0c-4952-b520-071c8bb3650b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:38.147414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c516a8-4b0c-4952-b520-071c8bb3650b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:38.148087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c516a8-4b0c-4952-b520-071c8bb3650b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:38.148530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c516a8-4b0c-4952-b520-071c8bb3650b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:38.148944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c516a8-4b0c-4952-b520-071c8bb3650b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:38.179112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-27c516a8-4b0c-4952-b520-071c8bb3650b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045201 Oct 28 20:17:38.179647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 865/1730] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:38 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:38.947039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5c33d490-bb40-473e-b09a-4d1734052139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:38.947685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5c33d490-bb40-473e-b09a-4d1734052139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:38.954691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c33d490-bb40-473e-b09a-4d1734052139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:38.955120 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c33d490-bb40-473e-b09a-4d1734052139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:38.955553 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c33d490-bb40-473e-b09a-4d1734052139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:38.956244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c33d490-bb40-473e-b09a-4d1734052139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:38.956695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c33d490-bb40-473e-b09a-4d1734052139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:38.957120 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c33d490-bb40-473e-b09a-4d1734052139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:39.100005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5c33d490-bb40-473e-b09a-4d1734052139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:39.111265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5c33d490-bb40-473e-b09a-4d1734052139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.168087 Oct 28 20:17:39.111847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 866/1731] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:38 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:39.192128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-22cbeec8-1ead-49fd-bbc9-34f192f4379b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:39.194356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22cbeec8-1ead-49fd-bbc9-34f192f4379b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:39.200736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22cbeec8-1ead-49fd-bbc9-34f192f4379b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:39.201365 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22cbeec8-1ead-49fd-bbc9-34f192f4379b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:39.201806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22cbeec8-1ead-49fd-bbc9-34f192f4379b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:39.202490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22cbeec8-1ead-49fd-bbc9-34f192f4379b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:39.202942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22cbeec8-1ead-49fd-bbc9-34f192f4379b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:39.203364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22cbeec8-1ead-49fd-bbc9-34f192f4379b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:39.232863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-22cbeec8-1ead-49fd-bbc9-34f192f4379b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044162 Oct 28 20:17:39.233422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 866/1732] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:39 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:40.136466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-56b9b825-19e1-4f37-bb59-1ad7f07508e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:40.137084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-56b9b825-19e1-4f37-bb59-1ad7f07508e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:40.145733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56b9b825-19e1-4f37-bb59-1ad7f07508e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:40.146224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56b9b825-19e1-4f37-bb59-1ad7f07508e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:40.146666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56b9b825-19e1-4f37-bb59-1ad7f07508e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:40.147368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56b9b825-19e1-4f37-bb59-1ad7f07508e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:40.147829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56b9b825-19e1-4f37-bb59-1ad7f07508e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:40.148258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56b9b825-19e1-4f37-bb59-1ad7f07508e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:40.254522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e970c9ca-b8f1-41ad-bfe4-08edf867b886 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:40.254522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e970c9ca-b8f1-41ad-bfe4-08edf867b886 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:40.256290 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e970c9ca-b8f1-41ad-bfe4-08edf867b886 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:40.256784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e970c9ca-b8f1-41ad-bfe4-08edf867b886 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:40.257225 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e970c9ca-b8f1-41ad-bfe4-08edf867b886 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:40.257973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e970c9ca-b8f1-41ad-bfe4-08edf867b886 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:40.258443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e970c9ca-b8f1-41ad-bfe4-08edf867b886 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:40.258874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e970c9ca-b8f1-41ad-bfe4-08edf867b886 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:40.290041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e970c9ca-b8f1-41ad-bfe4-08edf867b886 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047445 Oct 28 20:17:40.290614 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 867/1733] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:40 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:17:40.300888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-56b9b825-19e1-4f37-bb59-1ad7f07508e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:40.309531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-56b9b825-19e1-4f37-bb59-1ad7f07508e5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.177631 Oct 28 20:17:40.310125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 867/1734] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:40 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:41.302156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-913438df-123b-4d51-8a94-78d82b29fc38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:41.304294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-913438df-123b-4d51-8a94-78d82b29fc38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:41.311801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-913438df-123b-4d51-8a94-78d82b29fc38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:41.312286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-913438df-123b-4d51-8a94-78d82b29fc38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:41.312733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-913438df-123b-4d51-8a94-78d82b29fc38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:41.313459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-913438df-123b-4d51-8a94-78d82b29fc38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:41.313921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-913438df-123b-4d51-8a94-78d82b29fc38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:41.314350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-913438df-123b-4d51-8a94-78d82b29fc38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:41.337275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c5bbf75a-2acd-4031-80b7-14dce7a31f8a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:41.337924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c5bbf75a-2acd-4031-80b7-14dce7a31f8a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:41.344344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5bbf75a-2acd-4031-80b7-14dce7a31f8a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:41.344826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5bbf75a-2acd-4031-80b7-14dce7a31f8a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:41.345195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-913438df-123b-4d51-8a94-78d82b29fc38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047161 Oct 28 20:17:41.345360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5bbf75a-2acd-4031-80b7-14dce7a31f8a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:41.345805 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 868/1735] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:41 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:41.345946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5bbf75a-2acd-4031-80b7-14dce7a31f8a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:41.346403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5bbf75a-2acd-4031-80b7-14dce7a31f8a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:41.346827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5bbf75a-2acd-4031-80b7-14dce7a31f8a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:41.479658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c5bbf75a-2acd-4031-80b7-14dce7a31f8a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:41.488428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c5bbf75a-2acd-4031-80b7-14dce7a31f8a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155168 Oct 28 20:17:41.488991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 868/1736] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:41 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:17:42.360149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eaf683d8-9202-477c-9dae-20aaaac47f3a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:42.362053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eaf683d8-9202-477c-9dae-20aaaac47f3a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:42.368678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf683d8-9202-477c-9dae-20aaaac47f3a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:42.369404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf683d8-9202-477c-9dae-20aaaac47f3a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:42.369850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf683d8-9202-477c-9dae-20aaaac47f3a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:42.370581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf683d8-9202-477c-9dae-20aaaac47f3a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:42.371002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf683d8-9202-477c-9dae-20aaaac47f3a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:42.371430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf683d8-9202-477c-9dae-20aaaac47f3a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:42.376214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:17:42.406449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eaf683d8-9202-477c-9dae-20aaaac47f3a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052690 Oct 28 20:17:42.407031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 869/1737] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:42 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:42.511240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0d2f37e8-1494-4740-96ea-eebfc5787193 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:42.511841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0d2f37e8-1494-4740-96ea-eebfc5787193 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:42.518992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d2f37e8-1494-4740-96ea-eebfc5787193 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:42.519477 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d2f37e8-1494-4740-96ea-eebfc5787193 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:42.519913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d2f37e8-1494-4740-96ea-eebfc5787193 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:42.520603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d2f37e8-1494-4740-96ea-eebfc5787193 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:42.521066 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d2f37e8-1494-4740-96ea-eebfc5787193 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:42.521520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d2f37e8-1494-4740-96ea-eebfc5787193 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:42.651429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0d2f37e8-1494-4740-96ea-eebfc5787193 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:42.660424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0d2f37e8-1494-4740-96ea-eebfc5787193 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153031 Oct 28 20:17:42.660995 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 869/1738] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:42 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:43.419045 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-af77fe34-9088-46e5-831a-48bcad8049d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:43.422183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-af77fe34-9088-46e5-831a-48bcad8049d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:43.428803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af77fe34-9088-46e5-831a-48bcad8049d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:43.429287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af77fe34-9088-46e5-831a-48bcad8049d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:43.429755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af77fe34-9088-46e5-831a-48bcad8049d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:43.430444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af77fe34-9088-46e5-831a-48bcad8049d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:43.430896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af77fe34-9088-46e5-831a-48bcad8049d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:43.431341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af77fe34-9088-46e5-831a-48bcad8049d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:43.467329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-af77fe34-9088-46e5-831a-48bcad8049d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051993 Oct 28 20:17:43.467897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 870/1739] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:43 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:43.684012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-536daf62-cec2-419c-b71c-21f8e8fdcd00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:43.684622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-536daf62-cec2-419c-b71c-21f8e8fdcd00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:43.691068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536daf62-cec2-419c-b71c-21f8e8fdcd00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:43.691551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536daf62-cec2-419c-b71c-21f8e8fdcd00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:43.691986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536daf62-cec2-419c-b71c-21f8e8fdcd00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:43.692670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536daf62-cec2-419c-b71c-21f8e8fdcd00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:43.693122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536daf62-cec2-419c-b71c-21f8e8fdcd00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:43.693619 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536daf62-cec2-419c-b71c-21f8e8fdcd00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:43.823673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-536daf62-cec2-419c-b71c-21f8e8fdcd00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:43.831845 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-536daf62-cec2-419c-b71c-21f8e8fdcd00 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151743 Oct 28 20:17:43.832410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 870/1740] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:43 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:44.479551 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c1c3b152-e236-4f2a-930a-cdafbcfb3a78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:44.481772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c1c3b152-e236-4f2a-930a-cdafbcfb3a78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:44.488461 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c3b152-e236-4f2a-930a-cdafbcfb3a78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:44.488946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c3b152-e236-4f2a-930a-cdafbcfb3a78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:44.489410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c3b152-e236-4f2a-930a-cdafbcfb3a78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:44.490110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c3b152-e236-4f2a-930a-cdafbcfb3a78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:44.490569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c3b152-e236-4f2a-930a-cdafbcfb3a78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:44.491181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c3b152-e236-4f2a-930a-cdafbcfb3a78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:44.521470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c1c3b152-e236-4f2a-930a-cdafbcfb3a78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045825 Oct 28 20:17:44.522030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 871/1741] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:44 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:44.853764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ae894747-ea5b-4412-855c-6cd332cf4558 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:44.854368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ae894747-ea5b-4412-855c-6cd332cf4558 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:44.860780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae894747-ea5b-4412-855c-6cd332cf4558 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:44.861265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae894747-ea5b-4412-855c-6cd332cf4558 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:44.861725 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae894747-ea5b-4412-855c-6cd332cf4558 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:44.862401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae894747-ea5b-4412-855c-6cd332cf4558 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:44.862849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae894747-ea5b-4412-855c-6cd332cf4558 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:44.863289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae894747-ea5b-4412-855c-6cd332cf4558 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:44.989014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ae894747-ea5b-4412-855c-6cd332cf4558 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:44.996929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ae894747-ea5b-4412-855c-6cd332cf4558 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.146939 Oct 28 20:17:44.997570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 871/1742] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:44 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:45.534203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-662a2f25-cca6-4ca8-a21a-77e705e50df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:45.536396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-662a2f25-cca6-4ca8-a21a-77e705e50df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:45.542855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-662a2f25-cca6-4ca8-a21a-77e705e50df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:45.543409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-662a2f25-cca6-4ca8-a21a-77e705e50df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:45.543908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-662a2f25-cca6-4ca8-a21a-77e705e50df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:45.544724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-662a2f25-cca6-4ca8-a21a-77e705e50df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:45.545293 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-662a2f25-cca6-4ca8-a21a-77e705e50df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:45.545858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-662a2f25-cca6-4ca8-a21a-77e705e50df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:45.576930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-662a2f25-cca6-4ca8-a21a-77e705e50df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045912 Oct 28 20:17:45.577532 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 872/1743] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:45 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:46.020304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-71a15b9c-158d-4b35-90bd-499b5c060fd3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:46.020978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-71a15b9c-158d-4b35-90bd-499b5c060fd3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:46.027359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71a15b9c-158d-4b35-90bd-499b5c060fd3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:46.027844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71a15b9c-158d-4b35-90bd-499b5c060fd3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:46.028283 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71a15b9c-158d-4b35-90bd-499b5c060fd3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:46.029598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71a15b9c-158d-4b35-90bd-499b5c060fd3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:46.030141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71a15b9c-158d-4b35-90bd-499b5c060fd3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:46.030491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71a15b9c-158d-4b35-90bd-499b5c060fd3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:46.156678 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-71a15b9c-158d-4b35-90bd-499b5c060fd3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:46.164785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-71a15b9c-158d-4b35-90bd-499b5c060fd3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.148462 Oct 28 20:17:46.165367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 872/1744] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:46 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:46.589457 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6db20653-0aab-4206-a5f9-f47e551ff624 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:46.592331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6db20653-0aab-4206-a5f9-f47e551ff624 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:46.598525 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6db20653-0aab-4206-a5f9-f47e551ff624 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:46.599033 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6db20653-0aab-4206-a5f9-f47e551ff624 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:46.599468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6db20653-0aab-4206-a5f9-f47e551ff624 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:46.601165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6db20653-0aab-4206-a5f9-f47e551ff624 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:46.601165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6db20653-0aab-4206-a5f9-f47e551ff624 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:46.601165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6db20653-0aab-4206-a5f9-f47e551ff624 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:46.631563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6db20653-0aab-4206-a5f9-f47e551ff624 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046304 Oct 28 20:17:46.632189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 873/1745] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:46 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:47.188141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9af48b6d-1ac5-4c80-8d9b-650fae6637fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:47.188754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9af48b6d-1ac5-4c80-8d9b-650fae6637fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:47.195226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9af48b6d-1ac5-4c80-8d9b-650fae6637fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:47.195709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9af48b6d-1ac5-4c80-8d9b-650fae6637fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:47.196145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9af48b6d-1ac5-4c80-8d9b-650fae6637fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:47.196825 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9af48b6d-1ac5-4c80-8d9b-650fae6637fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:47.197277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9af48b6d-1ac5-4c80-8d9b-650fae6637fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:47.197730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9af48b6d-1ac5-4c80-8d9b-650fae6637fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:47.356035 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9af48b6d-1ac5-4c80-8d9b-650fae6637fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:47.366092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9af48b6d-1ac5-4c80-8d9b-650fae6637fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.181719 Oct 28 20:17:47.366670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 873/1746] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:47 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:47.645403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0820fdc6-d39e-489c-ab76-8531d4a3da3f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:47.648075 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0820fdc6-d39e-489c-ab76-8531d4a3da3f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:47.661083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0820fdc6-d39e-489c-ab76-8531d4a3da3f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:47.661809 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0820fdc6-d39e-489c-ab76-8531d4a3da3f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:47.662261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0820fdc6-d39e-489c-ab76-8531d4a3da3f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:47.664829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0820fdc6-d39e-489c-ab76-8531d4a3da3f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:47.665303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0820fdc6-d39e-489c-ab76-8531d4a3da3f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:47.665768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0820fdc6-d39e-489c-ab76-8531d4a3da3f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:47.708732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0820fdc6-d39e-489c-ab76-8531d4a3da3f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068668 Oct 28 20:17:47.709346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 874/1747] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:47 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:48.398694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b2727011-e19a-4287-91c5-46c52ba7ff09 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:48.399214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b2727011-e19a-4287-91c5-46c52ba7ff09 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:48.406338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2727011-e19a-4287-91c5-46c52ba7ff09 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:48.406819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2727011-e19a-4287-91c5-46c52ba7ff09 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:48.407256 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2727011-e19a-4287-91c5-46c52ba7ff09 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:48.407942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2727011-e19a-4287-91c5-46c52ba7ff09 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:48.408395 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2727011-e19a-4287-91c5-46c52ba7ff09 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:48.408817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2727011-e19a-4287-91c5-46c52ba7ff09 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:48.412645 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:17:48.534349 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b2727011-e19a-4287-91c5-46c52ba7ff09 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:48.542350 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b2727011-e19a-4287-91c5-46c52ba7ff09 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.147616 Oct 28 20:17:48.542909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 874/1748] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:48 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:48.722927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ae291db9-b56d-4d4c-a647-3c00a4e5a4b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:48.725470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ae291db9-b56d-4d4c-a647-3c00a4e5a4b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:48.734203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae291db9-b56d-4d4c-a647-3c00a4e5a4b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:48.734898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae291db9-b56d-4d4c-a647-3c00a4e5a4b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:48.739894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae291db9-b56d-4d4c-a647-3c00a4e5a4b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:48.739894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae291db9-b56d-4d4c-a647-3c00a4e5a4b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:48.739894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae291db9-b56d-4d4c-a647-3c00a4e5a4b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:48.739894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae291db9-b56d-4d4c-a647-3c00a4e5a4b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:48.770805 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ae291db9-b56d-4d4c-a647-3c00a4e5a4b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051923 Oct 28 20:17:48.771735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 875/1749] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:48 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:49.567229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3f944e1b-1b31-4f5a-8386-8ce24e11f369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:49.567800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3f944e1b-1b31-4f5a-8386-8ce24e11f369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:49.574214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f944e1b-1b31-4f5a-8386-8ce24e11f369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:49.574699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f944e1b-1b31-4f5a-8386-8ce24e11f369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:49.575136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f944e1b-1b31-4f5a-8386-8ce24e11f369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:49.576529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f944e1b-1b31-4f5a-8386-8ce24e11f369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:49.576990 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f944e1b-1b31-4f5a-8386-8ce24e11f369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:49.577446 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f944e1b-1b31-4f5a-8386-8ce24e11f369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:49.720869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3f944e1b-1b31-4f5a-8386-8ce24e11f369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:49.729370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3f944e1b-1b31-4f5a-8386-8ce24e11f369 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.165992 Oct 28 20:17:49.729942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 875/1750] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:49 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:49.785615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6e54defe-99c6-439a-9c8a-a0b73c36f7bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:49.787970 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6e54defe-99c6-439a-9c8a-a0b73c36f7bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:49.795335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e54defe-99c6-439a-9c8a-a0b73c36f7bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:49.796423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e54defe-99c6-439a-9c8a-a0b73c36f7bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:49.797257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e54defe-99c6-439a-9c8a-a0b73c36f7bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:49.798299 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e54defe-99c6-439a-9c8a-a0b73c36f7bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:49.798938 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e54defe-99c6-439a-9c8a-a0b73c36f7bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:49.799544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e54defe-99c6-439a-9c8a-a0b73c36f7bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:49.831878 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6e54defe-99c6-439a-9c8a-a0b73c36f7bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051137 Oct 28 20:17:49.832522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 876/1751] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:49 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:50.753643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-778c9bed-540a-41f6-bd60-19797912646e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:50.754156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-778c9bed-540a-41f6-bd60-19797912646e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:50.760764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-778c9bed-540a-41f6-bd60-19797912646e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:50.761106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-778c9bed-540a-41f6-bd60-19797912646e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:50.761575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-778c9bed-540a-41f6-bd60-19797912646e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:50.762263 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-778c9bed-540a-41f6-bd60-19797912646e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:50.762716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-778c9bed-540a-41f6-bd60-19797912646e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:50.763694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-778c9bed-540a-41f6-bd60-19797912646e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:50.846293 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-70fd005b-24ce-4542-8c9b-7a8cc62a781f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:50.848534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-70fd005b-24ce-4542-8c9b-7a8cc62a781f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:50.855318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fd005b-24ce-4542-8c9b-7a8cc62a781f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:50.855809 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fd005b-24ce-4542-8c9b-7a8cc62a781f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:50.856254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fd005b-24ce-4542-8c9b-7a8cc62a781f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:50.857884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fd005b-24ce-4542-8c9b-7a8cc62a781f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:50.858414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fd005b-24ce-4542-8c9b-7a8cc62a781f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:50.858865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fd005b-24ce-4542-8c9b-7a8cc62a781f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:50.898516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-70fd005b-24ce-4542-8c9b-7a8cc62a781f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057437 Oct 28 20:17:50.899399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 877/1752] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:50 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:51.046958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-778c9bed-540a-41f6-bd60-19797912646e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:51.055044 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-778c9bed-540a-41f6-bd60-19797912646e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.305389 Oct 28 20:17:51.055600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 876/1753] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:50 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:51.913138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a076fd52-8306-4677-912d-fd8fe50d9201 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:51.915463 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a076fd52-8306-4677-912d-fd8fe50d9201 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:51.922650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a076fd52-8306-4677-912d-fd8fe50d9201 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:51.923134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a076fd52-8306-4677-912d-fd8fe50d9201 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:51.923598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a076fd52-8306-4677-912d-fd8fe50d9201 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:51.924289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a076fd52-8306-4677-912d-fd8fe50d9201 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:51.924739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a076fd52-8306-4677-912d-fd8fe50d9201 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:51.925159 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a076fd52-8306-4677-912d-fd8fe50d9201 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:51.955159 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a076fd52-8306-4677-912d-fd8fe50d9201 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048162 Oct 28 20:17:51.959751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 878/1754] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:51 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:52.078711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7aa82f98-dfdc-4cf7-a5a2-e1e2ff520afc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:52.079329 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7aa82f98-dfdc-4cf7-a5a2-e1e2ff520afc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:52.086171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aa82f98-dfdc-4cf7-a5a2-e1e2ff520afc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:52.086661 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aa82f98-dfdc-4cf7-a5a2-e1e2ff520afc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:52.087101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aa82f98-dfdc-4cf7-a5a2-e1e2ff520afc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:52.087784 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aa82f98-dfdc-4cf7-a5a2-e1e2ff520afc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:52.088236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aa82f98-dfdc-4cf7-a5a2-e1e2ff520afc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:52.088658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aa82f98-dfdc-4cf7-a5a2-e1e2ff520afc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:52.225163 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7aa82f98-dfdc-4cf7-a5a2-e1e2ff520afc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:52.233162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7aa82f98-dfdc-4cf7-a5a2-e1e2ff520afc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.158911 Oct 28 20:17:52.233763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 877/1755] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:52 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:52.967909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4dd7c4a7-3a6f-44f3-a261-47e0f289a3bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:52.970142 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4dd7c4a7-3a6f-44f3-a261-47e0f289a3bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:52.976327 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dd7c4a7-3a6f-44f3-a261-47e0f289a3bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:52.976807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dd7c4a7-3a6f-44f3-a261-47e0f289a3bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:52.977245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dd7c4a7-3a6f-44f3-a261-47e0f289a3bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:52.978032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dd7c4a7-3a6f-44f3-a261-47e0f289a3bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:52.978481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dd7c4a7-3a6f-44f3-a261-47e0f289a3bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:52.978895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dd7c4a7-3a6f-44f3-a261-47e0f289a3bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:53.010195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4dd7c4a7-3a6f-44f3-a261-47e0f289a3bf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046759 Oct 28 20:17:53.010790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 879/1756] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:52 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:53.255922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-86d98b8b-35b2-4020-a89e-73619d80498c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:53.256530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-86d98b8b-35b2-4020-a89e-73619d80498c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:53.262739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86d98b8b-35b2-4020-a89e-73619d80498c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:53.263246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86d98b8b-35b2-4020-a89e-73619d80498c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:53.263672 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86d98b8b-35b2-4020-a89e-73619d80498c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:53.264348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86d98b8b-35b2-4020-a89e-73619d80498c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:53.264810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86d98b8b-35b2-4020-a89e-73619d80498c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:53.265212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86d98b8b-35b2-4020-a89e-73619d80498c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:53.618063 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-86d98b8b-35b2-4020-a89e-73619d80498c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:53.626764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-86d98b8b-35b2-4020-a89e-73619d80498c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.374726 Oct 28 20:17:53.627327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 878/1757] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:53 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:54.022954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7c6954fc-1c62-4b1f-89db-1c3b795d7f8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:54.025196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7c6954fc-1c62-4b1f-89db-1c3b795d7f8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:54.032751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c6954fc-1c62-4b1f-89db-1c3b795d7f8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:54.033727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c6954fc-1c62-4b1f-89db-1c3b795d7f8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:54.033727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c6954fc-1c62-4b1f-89db-1c3b795d7f8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:54.034394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c6954fc-1c62-4b1f-89db-1c3b795d7f8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:54.034854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c6954fc-1c62-4b1f-89db-1c3b795d7f8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:54.035283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c6954fc-1c62-4b1f-89db-1c3b795d7f8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:54.067810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7c6954fc-1c62-4b1f-89db-1c3b795d7f8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048724 Oct 28 20:17:54.068560 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 880/1758] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:54 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:54.649348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-90cdbbcf-2586-4c55-a6bc-ca87161366da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:54.650383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-90cdbbcf-2586-4c55-a6bc-ca87161366da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:54.657082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90cdbbcf-2586-4c55-a6bc-ca87161366da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:54.657600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90cdbbcf-2586-4c55-a6bc-ca87161366da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:54.658045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90cdbbcf-2586-4c55-a6bc-ca87161366da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:54.658750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90cdbbcf-2586-4c55-a6bc-ca87161366da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:54.659211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90cdbbcf-2586-4c55-a6bc-ca87161366da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:54.659642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90cdbbcf-2586-4c55-a6bc-ca87161366da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:54.787843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-90cdbbcf-2586-4c55-a6bc-ca87161366da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:54.796480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-90cdbbcf-2586-4c55-a6bc-ca87161366da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151178 Oct 28 20:17:54.797037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 879/1759] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:54 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:55.079997 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ffbdab31-16c7-4998-96c3-29de2bc90c9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:55.082255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ffbdab31-16c7-4998-96c3-29de2bc90c9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:55.084205 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:17:55.084373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:17:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments (ip 10.222.0.66) !!! Oct 28 20:17:55.090692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffbdab31-16c7-4998-96c3-29de2bc90c9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:55.091248 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffbdab31-16c7-4998-96c3-29de2bc90c9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:55.091689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffbdab31-16c7-4998-96c3-29de2bc90c9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:55.092382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffbdab31-16c7-4998-96c3-29de2bc90c9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:55.092831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffbdab31-16c7-4998-96c3-29de2bc90c9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:55.093482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffbdab31-16c7-4998-96c3-29de2bc90c9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:55.126824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ffbdab31-16c7-4998-96c3-29de2bc90c9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050790 Oct 28 20:17:55.127412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 881/1760] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:55 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:55.819622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aecb9510-854d-4841-8f95-d27aa8282b6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:55.820273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aecb9510-854d-4841-8f95-d27aa8282b6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:55.827013 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aecb9510-854d-4841-8f95-d27aa8282b6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:55.827504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aecb9510-854d-4841-8f95-d27aa8282b6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:55.827949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aecb9510-854d-4841-8f95-d27aa8282b6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:55.828647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aecb9510-854d-4841-8f95-d27aa8282b6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:55.829114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aecb9510-854d-4841-8f95-d27aa8282b6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:55.829573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aecb9510-854d-4841-8f95-d27aa8282b6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:55.958634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-aecb9510-854d-4841-8f95-d27aa8282b6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:55.967134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aecb9510-854d-4841-8f95-d27aa8282b6f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151429 Oct 28 20:17:55.967691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 880/1761] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:55 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:56.138560 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5827936b-9bad-418b-b852-0acff94477ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:56.140636 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5827936b-9bad-418b-b852-0acff94477ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:56.146967 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5827936b-9bad-418b-b852-0acff94477ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:56.147443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5827936b-9bad-418b-b852-0acff94477ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:56.147869 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5827936b-9bad-418b-b852-0acff94477ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:56.148559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5827936b-9bad-418b-b852-0acff94477ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:56.149005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5827936b-9bad-418b-b852-0acff94477ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:56.149453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5827936b-9bad-418b-b852-0acff94477ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:56.179448 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5827936b-9bad-418b-b852-0acff94477ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044920 Oct 28 20:17:56.180015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 882/1762] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:56 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:56.991114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f467cd4f-7c10-4260-9a15-db6259f57a23 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:56.991723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f467cd4f-7c10-4260-9a15-db6259f57a23 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:56.998337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f467cd4f-7c10-4260-9a15-db6259f57a23 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:57.002934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f467cd4f-7c10-4260-9a15-db6259f57a23 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:57.002934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f467cd4f-7c10-4260-9a15-db6259f57a23 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:57.002934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f467cd4f-7c10-4260-9a15-db6259f57a23 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:57.002934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f467cd4f-7c10-4260-9a15-db6259f57a23 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:57.003343 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f467cd4f-7c10-4260-9a15-db6259f57a23 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:57.128583 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f467cd4f-7c10-4260-9a15-db6259f57a23 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:57.136746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f467cd4f-7c10-4260-9a15-db6259f57a23 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149466 Oct 28 20:17:57.137311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 881/1763] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:56 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:57.191903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-adc3c8b4-4fb4-4906-97cc-164e1c465b5f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:57.194124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-adc3c8b4-4fb4-4906-97cc-164e1c465b5f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:57.201649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adc3c8b4-4fb4-4906-97cc-164e1c465b5f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:57.202141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adc3c8b4-4fb4-4906-97cc-164e1c465b5f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:57.202580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adc3c8b4-4fb4-4906-97cc-164e1c465b5f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:57.203278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adc3c8b4-4fb4-4906-97cc-164e1c465b5f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:57.203733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adc3c8b4-4fb4-4906-97cc-164e1c465b5f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:57.204162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adc3c8b4-4fb4-4906-97cc-164e1c465b5f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:57.235185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-adc3c8b4-4fb4-4906-97cc-164e1c465b5f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047195 Oct 28 20:17:57.235752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 883/1764] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:57 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:58.160546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4a64523b-ebf2-49fc-a6a9-db9afdf08830 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:58.161152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4a64523b-ebf2-49fc-a6a9-db9afdf08830 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:58.167566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a64523b-ebf2-49fc-a6a9-db9afdf08830 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:58.168046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a64523b-ebf2-49fc-a6a9-db9afdf08830 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:58.168478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a64523b-ebf2-49fc-a6a9-db9afdf08830 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:58.169193 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a64523b-ebf2-49fc-a6a9-db9afdf08830 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:58.169664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a64523b-ebf2-49fc-a6a9-db9afdf08830 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:58.170086 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a64523b-ebf2-49fc-a6a9-db9afdf08830 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:58.247873 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a078cb5a-3745-4a5c-a06e-59c315f901d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:58.249990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a078cb5a-3745-4a5c-a06e-59c315f901d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:58.256318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a078cb5a-3745-4a5c-a06e-59c315f901d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:58.256804 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a078cb5a-3745-4a5c-a06e-59c315f901d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:58.257252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a078cb5a-3745-4a5c-a06e-59c315f901d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:58.258043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a078cb5a-3745-4a5c-a06e-59c315f901d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:58.258499 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a078cb5a-3745-4a5c-a06e-59c315f901d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:58.258928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a078cb5a-3745-4a5c-a06e-59c315f901d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:58.289752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a078cb5a-3745-4a5c-a06e-59c315f901d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045946 Oct 28 20:17:58.290420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 884/1765] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:58 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:17:58.306210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4a64523b-ebf2-49fc-a6a9-db9afdf08830 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:58.315324 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4a64523b-ebf2-49fc-a6a9-db9afdf08830 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.158640 Oct 28 20:17:58.316274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 882/1766] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:58 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:59.302222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-16027eaa-cd4d-4638-9fcf-f6deab347c69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:59.304466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-16027eaa-cd4d-4638-9fcf-f6deab347c69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:59.311551 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16027eaa-cd4d-4638-9fcf-f6deab347c69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:59.312040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16027eaa-cd4d-4638-9fcf-f6deab347c69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:59.312475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16027eaa-cd4d-4638-9fcf-f6deab347c69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:59.313163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16027eaa-cd4d-4638-9fcf-f6deab347c69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:59.313648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16027eaa-cd4d-4638-9fcf-f6deab347c69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:59.314075 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16027eaa-cd4d-4638-9fcf-f6deab347c69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:59.339887 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:17:59.340101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1d7dfffe-0b86-4216-b6ff-48ff4a40c4c2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:59.340692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1d7dfffe-0b86-4216-b6ff-48ff4a40c4c2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:59.345294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-16027eaa-cd4d-4638-9fcf-f6deab347c69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047168 Oct 28 20:17:59.345874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 885/1767] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:17:59 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:59.347722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d7dfffe-0b86-4216-b6ff-48ff4a40c4c2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:59.348209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d7dfffe-0b86-4216-b6ff-48ff4a40c4c2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:59.348654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d7dfffe-0b86-4216-b6ff-48ff4a40c4c2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:59.349379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d7dfffe-0b86-4216-b6ff-48ff4a40c4c2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:59.349848 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d7dfffe-0b86-4216-b6ff-48ff4a40c4c2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:59.360765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d7dfffe-0b86-4216-b6ff-48ff4a40c4c2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:59.483319 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1d7dfffe-0b86-4216-b6ff-48ff4a40c4c2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:59.491875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1d7dfffe-0b86-4216-b6ff-48ff4a40c4c2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155539 Oct 28 20:17:59.492587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 883/1768] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:59 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:00.357169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4a3e77f0-6514-4bdf-b5f3-163e8c09249e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:00.359446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4a3e77f0-6514-4bdf-b5f3-163e8c09249e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:00.362165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=58 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:18:00.367084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a3e77f0-6514-4bdf-b5f3-163e8c09249e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:00.367581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a3e77f0-6514-4bdf-b5f3-163e8c09249e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:00.368026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a3e77f0-6514-4bdf-b5f3-163e8c09249e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:00.368726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a3e77f0-6514-4bdf-b5f3-163e8c09249e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:00.369220 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a3e77f0-6514-4bdf-b5f3-163e8c09249e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:00.369676 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a3e77f0-6514-4bdf-b5f3-163e8c09249e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:00.398995 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4a3e77f0-6514-4bdf-b5f3-163e8c09249e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045810 Oct 28 20:18:00.399552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 886/1769] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:00 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:00.516267 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1209d2af-33c0-4c4d-8166-4b01a57dd3f4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:00.516949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1209d2af-33c0-4c4d-8166-4b01a57dd3f4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:00.523182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1209d2af-33c0-4c4d-8166-4b01a57dd3f4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:00.523660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1209d2af-33c0-4c4d-8166-4b01a57dd3f4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:00.524094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1209d2af-33c0-4c4d-8166-4b01a57dd3f4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:00.524779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1209d2af-33c0-4c4d-8166-4b01a57dd3f4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:00.525224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1209d2af-33c0-4c4d-8166-4b01a57dd3f4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:00.525672 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1209d2af-33c0-4c4d-8166-4b01a57dd3f4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:00.664576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1209d2af-33c0-4c4d-8166-4b01a57dd3f4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:00.673085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1209d2af-33c0-4c4d-8166-4b01a57dd3f4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.161086 Oct 28 20:18:00.674298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 884/1770] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:00 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:01.412178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4eae6593-b4c1-4e55-afe3-c44626b3f041 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:01.414346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4eae6593-b4c1-4e55-afe3-c44626b3f041 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:01.421073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eae6593-b4c1-4e55-afe3-c44626b3f041 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:01.421575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eae6593-b4c1-4e55-afe3-c44626b3f041 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:01.422009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eae6593-b4c1-4e55-afe3-c44626b3f041 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:01.422687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eae6593-b4c1-4e55-afe3-c44626b3f041 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:01.423139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eae6593-b4c1-4e55-afe3-c44626b3f041 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:01.423561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eae6593-b4c1-4e55-afe3-c44626b3f041 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:01.452849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4eae6593-b4c1-4e55-afe3-c44626b3f041 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Oct 28 20:18:01.453414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 887/1771] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:01 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:01.697662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f84e0e35-9da1-42ae-a5c5-660e293dfb35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:01.698404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f84e0e35-9da1-42ae-a5c5-660e293dfb35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:01.705804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f84e0e35-9da1-42ae-a5c5-660e293dfb35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:01.706363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f84e0e35-9da1-42ae-a5c5-660e293dfb35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:01.706939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f84e0e35-9da1-42ae-a5c5-660e293dfb35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:01.707686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f84e0e35-9da1-42ae-a5c5-660e293dfb35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:01.708251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f84e0e35-9da1-42ae-a5c5-660e293dfb35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:01.708738 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f84e0e35-9da1-42ae-a5c5-660e293dfb35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:01.837398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f84e0e35-9da1-42ae-a5c5-660e293dfb35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:01.846264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f84e0e35-9da1-42ae-a5c5-660e293dfb35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152547 Oct 28 20:18:01.846826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 885/1772] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:01 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:02.465123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-64d3c396-d1e0-4db5-a2eb-68bdac83fcb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:02.468384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-64d3c396-d1e0-4db5-a2eb-68bdac83fcb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:02.475022 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64d3c396-d1e0-4db5-a2eb-68bdac83fcb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:02.475501 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64d3c396-d1e0-4db5-a2eb-68bdac83fcb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:02.475935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64d3c396-d1e0-4db5-a2eb-68bdac83fcb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:02.476623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64d3c396-d1e0-4db5-a2eb-68bdac83fcb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:02.477077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64d3c396-d1e0-4db5-a2eb-68bdac83fcb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:02.477529 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64d3c396-d1e0-4db5-a2eb-68bdac83fcb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:02.506368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-64d3c396-d1e0-4db5-a2eb-68bdac83fcb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045197 Oct 28 20:18:02.506919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 888/1773] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:02 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:02.870057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81c53b08-2d02-46b3-ba77-4f86873e37fc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:02.870701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-81c53b08-2d02-46b3-ba77-4f86873e37fc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:02.873018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=52 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:18:02.878355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81c53b08-2d02-46b3-ba77-4f86873e37fc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:02.878844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81c53b08-2d02-46b3-ba77-4f86873e37fc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:02.880622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81c53b08-2d02-46b3-ba77-4f86873e37fc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:02.880622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81c53b08-2d02-46b3-ba77-4f86873e37fc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:02.880622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81c53b08-2d02-46b3-ba77-4f86873e37fc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:02.880939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81c53b08-2d02-46b3-ba77-4f86873e37fc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:03.007765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-81c53b08-2d02-46b3-ba77-4f86873e37fc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:03.016393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-81c53b08-2d02-46b3-ba77-4f86873e37fc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151683 Oct 28 20:18:03.016961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 886/1774] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:02 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:03.518971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c80dacdc-7f8c-409c-ab23-22640f20931c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:03.521104 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c80dacdc-7f8c-409c-ab23-22640f20931c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:03.527478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c80dacdc-7f8c-409c-ab23-22640f20931c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:03.527956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c80dacdc-7f8c-409c-ab23-22640f20931c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:03.528388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c80dacdc-7f8c-409c-ab23-22640f20931c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:03.529067 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c80dacdc-7f8c-409c-ab23-22640f20931c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:03.530114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c80dacdc-7f8c-409c-ab23-22640f20931c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:03.530575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c80dacdc-7f8c-409c-ab23-22640f20931c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:03.560483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c80dacdc-7f8c-409c-ab23-22640f20931c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045384 Oct 28 20:18:03.560997 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 889/1775] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:03 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:04.039334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-619cb296-9027-48a3-b5af-7a207dab02de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:04.039961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-619cb296-9027-48a3-b5af-7a207dab02de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:04.046527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619cb296-9027-48a3-b5af-7a207dab02de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:04.047017 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619cb296-9027-48a3-b5af-7a207dab02de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:04.047464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619cb296-9027-48a3-b5af-7a207dab02de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:04.048161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619cb296-9027-48a3-b5af-7a207dab02de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:04.048623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619cb296-9027-48a3-b5af-7a207dab02de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:04.049059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619cb296-9027-48a3-b5af-7a207dab02de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:04.180278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-619cb296-9027-48a3-b5af-7a207dab02de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:04.188462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-619cb296-9027-48a3-b5af-7a207dab02de tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152994 Oct 28 20:18:04.189024 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 887/1776] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:04 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:04.572989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-86df95ac-d3ad-4668-83d3-cf48d34cd9e5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:04.575193 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-86df95ac-d3ad-4668-83d3-cf48d34cd9e5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:04.582212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86df95ac-d3ad-4668-83d3-cf48d34cd9e5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:04.582697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86df95ac-d3ad-4668-83d3-cf48d34cd9e5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:04.583139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86df95ac-d3ad-4668-83d3-cf48d34cd9e5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:04.583857 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86df95ac-d3ad-4668-83d3-cf48d34cd9e5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:04.584314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86df95ac-d3ad-4668-83d3-cf48d34cd9e5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:04.584736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86df95ac-d3ad-4668-83d3-cf48d34cd9e5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:04.613719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-86df95ac-d3ad-4668-83d3-cf48d34cd9e5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044629 Oct 28 20:18:04.614262 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 890/1777] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:04 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:05.211437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ff3ed259-6482-4021-b591-0e932e96502d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:05.212051 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ff3ed259-6482-4021-b591-0e932e96502d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:05.219281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff3ed259-6482-4021-b591-0e932e96502d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:05.219763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff3ed259-6482-4021-b591-0e932e96502d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:05.220203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff3ed259-6482-4021-b591-0e932e96502d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:05.220889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff3ed259-6482-4021-b591-0e932e96502d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:05.221365 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff3ed259-6482-4021-b591-0e932e96502d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:05.221796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff3ed259-6482-4021-b591-0e932e96502d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:05.350555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ff3ed259-6482-4021-b591-0e932e96502d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:05.359192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ff3ed259-6482-4021-b591-0e932e96502d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151904 Oct 28 20:18:05.359748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 888/1778] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:05 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:05.626718 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-44bf467e-6be5-4bd9-848c-0ba3cd96f5fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:05.628839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-44bf467e-6be5-4bd9-848c-0ba3cd96f5fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:05.635241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44bf467e-6be5-4bd9-848c-0ba3cd96f5fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:05.635728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44bf467e-6be5-4bd9-848c-0ba3cd96f5fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:05.636172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44bf467e-6be5-4bd9-848c-0ba3cd96f5fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:05.636868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44bf467e-6be5-4bd9-848c-0ba3cd96f5fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:05.637347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44bf467e-6be5-4bd9-848c-0ba3cd96f5fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:05.637791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44bf467e-6be5-4bd9-848c-0ba3cd96f5fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:05.667802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-44bf467e-6be5-4bd9-848c-0ba3cd96f5fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045628 Oct 28 20:18:05.668354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 891/1779] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:05 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:06.382274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d7052b63-5867-4842-9d63-7d3b978240c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:06.382853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d7052b63-5867-4842-9d63-7d3b978240c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:06.389308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7052b63-5867-4842-9d63-7d3b978240c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:06.389914 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7052b63-5867-4842-9d63-7d3b978240c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:06.390358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7052b63-5867-4842-9d63-7d3b978240c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:06.391049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7052b63-5867-4842-9d63-7d3b978240c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:06.391508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7052b63-5867-4842-9d63-7d3b978240c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:06.391945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7052b63-5867-4842-9d63-7d3b978240c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:06.520588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d7052b63-5867-4842-9d63-7d3b978240c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:06.528818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d7052b63-5867-4842-9d63-7d3b978240c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150477 Oct 28 20:18:06.529406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 889/1780] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:06 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:06.679622 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b112d8f7-af9e-48d1-9cbc-67aeb9ea42b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:06.681718 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b112d8f7-af9e-48d1-9cbc-67aeb9ea42b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:06.688297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b112d8f7-af9e-48d1-9cbc-67aeb9ea42b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:06.688784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b112d8f7-af9e-48d1-9cbc-67aeb9ea42b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:06.689221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b112d8f7-af9e-48d1-9cbc-67aeb9ea42b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:06.689934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b112d8f7-af9e-48d1-9cbc-67aeb9ea42b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:06.690391 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b112d8f7-af9e-48d1-9cbc-67aeb9ea42b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:06.690816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b112d8f7-af9e-48d1-9cbc-67aeb9ea42b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:06.721561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b112d8f7-af9e-48d1-9cbc-67aeb9ea42b0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045980 Oct 28 20:18:06.722116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 892/1781] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:06 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:07.554235 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-116babef-75b7-49a7-b71f-2cd8d6ae1a7e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:07.554823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-116babef-75b7-49a7-b71f-2cd8d6ae1a7e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:07.561484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-116babef-75b7-49a7-b71f-2cd8d6ae1a7e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:07.561917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-116babef-75b7-49a7-b71f-2cd8d6ae1a7e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:07.562380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-116babef-75b7-49a7-b71f-2cd8d6ae1a7e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:07.563058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-116babef-75b7-49a7-b71f-2cd8d6ae1a7e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:07.563515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-116babef-75b7-49a7-b71f-2cd8d6ae1a7e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:07.563961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-116babef-75b7-49a7-b71f-2cd8d6ae1a7e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:07.690759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-116babef-75b7-49a7-b71f-2cd8d6ae1a7e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:07.694158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:18:07.699443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-116babef-75b7-49a7-b71f-2cd8d6ae1a7e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149145 Oct 28 20:18:07.700005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 890/1782] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:07 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:07.734436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9b030dca-c00d-456e-9a95-d6481de74b8b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:07.736628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9b030dca-c00d-456e-9a95-d6481de74b8b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:07.743174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b030dca-c00d-456e-9a95-d6481de74b8b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:07.743661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b030dca-c00d-456e-9a95-d6481de74b8b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:07.744147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b030dca-c00d-456e-9a95-d6481de74b8b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:07.744837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b030dca-c00d-456e-9a95-d6481de74b8b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:07.745294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b030dca-c00d-456e-9a95-d6481de74b8b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:07.745742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b030dca-c00d-456e-9a95-d6481de74b8b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:07.785329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9b030dca-c00d-456e-9a95-d6481de74b8b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055354 Oct 28 20:18:07.785909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 893/1783] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:07 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:08.722759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b6a79351-f361-4fb1-94f0-a74d0896ef5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:08.727491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b6a79351-f361-4fb1-94f0-a74d0896ef5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:08.729876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6a79351-f361-4fb1-94f0-a74d0896ef5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:08.730353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6a79351-f361-4fb1-94f0-a74d0896ef5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:08.730785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6a79351-f361-4fb1-94f0-a74d0896ef5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:08.731468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6a79351-f361-4fb1-94f0-a74d0896ef5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:08.731918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6a79351-f361-4fb1-94f0-a74d0896ef5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:08.732342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6a79351-f361-4fb1-94f0-a74d0896ef5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:08.798735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1f31604-1992-4e87-97c5-bfcbd576fa21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:08.801101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f1f31604-1992-4e87-97c5-bfcbd576fa21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:08.807662 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1f31604-1992-4e87-97c5-bfcbd576fa21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:08.808281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1f31604-1992-4e87-97c5-bfcbd576fa21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:08.809094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1f31604-1992-4e87-97c5-bfcbd576fa21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:08.809537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1f31604-1992-4e87-97c5-bfcbd576fa21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:08.809992 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1f31604-1992-4e87-97c5-bfcbd576fa21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:08.814289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1f31604-1992-4e87-97c5-bfcbd576fa21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:08.843599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1f31604-1992-4e87-97c5-bfcbd576fa21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049039 Oct 28 20:18:08.844398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 894/1784] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:08 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:18:08.865264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b6a79351-f361-4fb1-94f0-a74d0896ef5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:08.873435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b6a79351-f361-4fb1-94f0-a74d0896ef5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154855 Oct 28 20:18:08.873995 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 891/1785] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:08 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:09.856251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dcd08426-7bc2-47bb-b0ce-52cf92c81991 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:09.858544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dcd08426-7bc2-47bb-b0ce-52cf92c81991 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:09.864979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcd08426-7bc2-47bb-b0ce-52cf92c81991 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:09.865499 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcd08426-7bc2-47bb-b0ce-52cf92c81991 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:09.865943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcd08426-7bc2-47bb-b0ce-52cf92c81991 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:09.866665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcd08426-7bc2-47bb-b0ce-52cf92c81991 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:09.867121 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcd08426-7bc2-47bb-b0ce-52cf92c81991 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:09.867547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcd08426-7bc2-47bb-b0ce-52cf92c81991 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:09.897235 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-022e1d38-b0b7-4089-9962-2357d34b3a4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:09.897886 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-022e1d38-b0b7-4089-9962-2357d34b3a4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:09.899370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dcd08426-7bc2-47bb-b0ce-52cf92c81991 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047067 Oct 28 20:18:09.899931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 895/1786] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:09 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:09.904367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-022e1d38-b0b7-4089-9962-2357d34b3a4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:09.905105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-022e1d38-b0b7-4089-9962-2357d34b3a4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:09.905579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-022e1d38-b0b7-4089-9962-2357d34b3a4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:09.906281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-022e1d38-b0b7-4089-9962-2357d34b3a4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:09.906745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-022e1d38-b0b7-4089-9962-2357d34b3a4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:09.907174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-022e1d38-b0b7-4089-9962-2357d34b3a4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:10.038729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-022e1d38-b0b7-4089-9962-2357d34b3a4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:10.046957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-022e1d38-b0b7-4089-9962-2357d34b3a4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153496 Oct 28 20:18:10.047510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 892/1787] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:09 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:18:10.911759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-548df5bb-a20d-4d92-980d-c04f18ef6c6d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:10.913972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-548df5bb-a20d-4d92-980d-c04f18ef6c6d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:10.920892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-548df5bb-a20d-4d92-980d-c04f18ef6c6d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:10.921446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-548df5bb-a20d-4d92-980d-c04f18ef6c6d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:10.921914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-548df5bb-a20d-4d92-980d-c04f18ef6c6d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:10.922599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-548df5bb-a20d-4d92-980d-c04f18ef6c6d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:10.923051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-548df5bb-a20d-4d92-980d-c04f18ef6c6d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:10.923473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-548df5bb-a20d-4d92-980d-c04f18ef6c6d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:10.952573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-548df5bb-a20d-4d92-980d-c04f18ef6c6d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044766 Oct 28 20:18:10.953114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 896/1788] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:10 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:11.069821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3c0ccaf2-511f-4644-8c5b-0f3f10aa7ff6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:11.070445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3c0ccaf2-511f-4644-8c5b-0f3f10aa7ff6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:11.076903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0ccaf2-511f-4644-8c5b-0f3f10aa7ff6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:11.077490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0ccaf2-511f-4644-8c5b-0f3f10aa7ff6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:11.077934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0ccaf2-511f-4644-8c5b-0f3f10aa7ff6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:11.078631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0ccaf2-511f-4644-8c5b-0f3f10aa7ff6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:11.079092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0ccaf2-511f-4644-8c5b-0f3f10aa7ff6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:11.079522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0ccaf2-511f-4644-8c5b-0f3f10aa7ff6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:11.204225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3c0ccaf2-511f-4644-8c5b-0f3f10aa7ff6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:11.212581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3c0ccaf2-511f-4644-8c5b-0f3f10aa7ff6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.146606 Oct 28 20:18:11.213149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 893/1789] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:11 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:11.965207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40efd1bd-d03a-4ef1-816e-1457ee188965 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:11.967494 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40efd1bd-d03a-4ef1-816e-1457ee188965 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:11.973789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40efd1bd-d03a-4ef1-816e-1457ee188965 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:11.974289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40efd1bd-d03a-4ef1-816e-1457ee188965 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:11.974720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40efd1bd-d03a-4ef1-816e-1457ee188965 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:11.975396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40efd1bd-d03a-4ef1-816e-1457ee188965 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:11.975862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40efd1bd-d03a-4ef1-816e-1457ee188965 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:11.976262 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40efd1bd-d03a-4ef1-816e-1457ee188965 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:12.005182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40efd1bd-d03a-4ef1-816e-1457ee188965 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043914 Oct 28 20:18:12.005749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 897/1790] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:11 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:12.236545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-12973fec-43c6-4365-8fdd-423bcc1b91cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:12.237099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-12973fec-43c6-4365-8fdd-423bcc1b91cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:12.244145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12973fec-43c6-4365-8fdd-423bcc1b91cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:12.244622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12973fec-43c6-4365-8fdd-423bcc1b91cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:12.245055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12973fec-43c6-4365-8fdd-423bcc1b91cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:12.245765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12973fec-43c6-4365-8fdd-423bcc1b91cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:12.246217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12973fec-43c6-4365-8fdd-423bcc1b91cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:12.246636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12973fec-43c6-4365-8fdd-423bcc1b91cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:12.377450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-12973fec-43c6-4365-8fdd-423bcc1b91cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:12.385528 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-12973fec-43c6-4365-8fdd-423bcc1b91cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152899 Oct 28 20:18:12.386081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 894/1791] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:12 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:18:13.018378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-12c8e594-1458-4400-b671-cf1338e7747d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:13.021004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-12c8e594-1458-4400-b671-cf1338e7747d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:13.027533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12c8e594-1458-4400-b671-cf1338e7747d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:13.028028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12c8e594-1458-4400-b671-cf1338e7747d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:13.028470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12c8e594-1458-4400-b671-cf1338e7747d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:13.029169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12c8e594-1458-4400-b671-cf1338e7747d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:13.029653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12c8e594-1458-4400-b671-cf1338e7747d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:13.030265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12c8e594-1458-4400-b671-cf1338e7747d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:13.059911 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-12c8e594-1458-4400-b671-cf1338e7747d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046303 Oct 28 20:18:13.060468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 898/1792] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:13 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:13.407562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d56dc70b-d4d0-46a6-827a-f818531c4ec0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:13.408172 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d56dc70b-d4d0-46a6-827a-f818531c4ec0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:13.414586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56dc70b-d4d0-46a6-827a-f818531c4ec0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:13.415067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56dc70b-d4d0-46a6-827a-f818531c4ec0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:13.415500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56dc70b-d4d0-46a6-827a-f818531c4ec0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:13.416182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56dc70b-d4d0-46a6-827a-f818531c4ec0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:13.416637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56dc70b-d4d0-46a6-827a-f818531c4ec0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:13.417058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56dc70b-d4d0-46a6-827a-f818531c4ec0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:13.549357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d56dc70b-d4d0-46a6-827a-f818531c4ec0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:13.557876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d56dc70b-d4d0-46a6-827a-f818531c4ec0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154231 Oct 28 20:18:13.558597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 895/1793] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:13 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:14.072139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d227cd2c-4d9f-45bd-9062-5a5562aa1c26 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:14.074393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d227cd2c-4d9f-45bd-9062-5a5562aa1c26 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:14.080939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d227cd2c-4d9f-45bd-9062-5a5562aa1c26 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:14.081456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d227cd2c-4d9f-45bd-9062-5a5562aa1c26 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:14.081900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d227cd2c-4d9f-45bd-9062-5a5562aa1c26 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:14.082591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d227cd2c-4d9f-45bd-9062-5a5562aa1c26 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:14.083045 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d227cd2c-4d9f-45bd-9062-5a5562aa1c26 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:14.083471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d227cd2c-4d9f-45bd-9062-5a5562aa1c26 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:14.113180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d227cd2c-4d9f-45bd-9062-5a5562aa1c26 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045003 Oct 28 20:18:14.113759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 899/1794] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:14 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:14.581600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1b3862d1-27a4-481d-bf44-1a86a65c0855 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:14.582237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1b3862d1-27a4-481d-bf44-1a86a65c0855 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:14.588771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b3862d1-27a4-481d-bf44-1a86a65c0855 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:14.589243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b3862d1-27a4-481d-bf44-1a86a65c0855 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:14.589740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b3862d1-27a4-481d-bf44-1a86a65c0855 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:14.590422 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b3862d1-27a4-481d-bf44-1a86a65c0855 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:14.590871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b3862d1-27a4-481d-bf44-1a86a65c0855 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:14.591315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b3862d1-27a4-481d-bf44-1a86a65c0855 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:14.734556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1b3862d1-27a4-481d-bf44-1a86a65c0855 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:14.744306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1b3862d1-27a4-481d-bf44-1a86a65c0855 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.166440 Oct 28 20:18:14.745361 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 896/1795] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:14 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:15.125972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-319ed78d-9157-4a8f-a053-f2f427dd3075 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:15.128179 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-319ed78d-9157-4a8f-a053-f2f427dd3075 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:15.134721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-319ed78d-9157-4a8f-a053-f2f427dd3075 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:15.135207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-319ed78d-9157-4a8f-a053-f2f427dd3075 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:15.135649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-319ed78d-9157-4a8f-a053-f2f427dd3075 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:15.136343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-319ed78d-9157-4a8f-a053-f2f427dd3075 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:15.136800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-319ed78d-9157-4a8f-a053-f2f427dd3075 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:15.137230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-319ed78d-9157-4a8f-a053-f2f427dd3075 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:15.167874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-319ed78d-9157-4a8f-a053-f2f427dd3075 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046171 Oct 28 20:18:15.168435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 900/1796] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:15 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:15.775756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-888aebae-4a97-449f-99f2-96f9d8562ee1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:15.776271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-888aebae-4a97-449f-99f2-96f9d8562ee1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:15.784634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-888aebae-4a97-449f-99f2-96f9d8562ee1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:15.785123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-888aebae-4a97-449f-99f2-96f9d8562ee1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:15.785606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-888aebae-4a97-449f-99f2-96f9d8562ee1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:15.786311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-888aebae-4a97-449f-99f2-96f9d8562ee1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:15.786768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-888aebae-4a97-449f-99f2-96f9d8562ee1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:15.787204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-888aebae-4a97-449f-99f2-96f9d8562ee1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:15.924482 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-888aebae-4a97-449f-99f2-96f9d8562ee1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:15.932691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-888aebae-4a97-449f-99f2-96f9d8562ee1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.160818 Oct 28 20:18:15.933257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 897/1797] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:15 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:16.180227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91cbe3d9-a1d3-4ac6-ab83-c816d4904562 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:16.182343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-91cbe3d9-a1d3-4ac6-ab83-c816d4904562 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:16.189352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91cbe3d9-a1d3-4ac6-ab83-c816d4904562 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:16.193079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91cbe3d9-a1d3-4ac6-ab83-c816d4904562 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:16.193079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91cbe3d9-a1d3-4ac6-ab83-c816d4904562 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:16.193079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91cbe3d9-a1d3-4ac6-ab83-c816d4904562 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:16.193079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91cbe3d9-a1d3-4ac6-ab83-c816d4904562 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:16.193556 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91cbe3d9-a1d3-4ac6-ab83-c816d4904562 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:16.221814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-91cbe3d9-a1d3-4ac6-ab83-c816d4904562 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045633 Oct 28 20:18:16.222363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 901/1798] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:16 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:16.955802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c130aed1-d885-4e1c-bcad-ee53b06e064f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:16.956420 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c130aed1-d885-4e1c-bcad-ee53b06e064f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:16.965397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c130aed1-d885-4e1c-bcad-ee53b06e064f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:16.965397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c130aed1-d885-4e1c-bcad-ee53b06e064f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:16.965397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c130aed1-d885-4e1c-bcad-ee53b06e064f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:16.965397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c130aed1-d885-4e1c-bcad-ee53b06e064f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:16.965812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c130aed1-d885-4e1c-bcad-ee53b06e064f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:16.965812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c130aed1-d885-4e1c-bcad-ee53b06e064f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:17.098260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c130aed1-d885-4e1c-bcad-ee53b06e064f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:17.106531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c130aed1-d885-4e1c-bcad-ee53b06e064f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154505 Oct 28 20:18:17.107099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 898/1799] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:16 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:17.234827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-830bb85b-52ca-4188-84a2-2e8cff6226c4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:17.236953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-830bb85b-52ca-4188-84a2-2e8cff6226c4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:17.243336 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-830bb85b-52ca-4188-84a2-2e8cff6226c4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:17.243813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-830bb85b-52ca-4188-84a2-2e8cff6226c4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:17.244243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-830bb85b-52ca-4188-84a2-2e8cff6226c4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:17.244922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-830bb85b-52ca-4188-84a2-2e8cff6226c4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:17.245392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-830bb85b-52ca-4188-84a2-2e8cff6226c4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:17.245813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-830bb85b-52ca-4188-84a2-2e8cff6226c4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:17.259438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:18:17.274917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-830bb85b-52ca-4188-84a2-2e8cff6226c4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044710 Oct 28 20:18:17.275549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 902/1800] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:17 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:18.130137 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-180d7e99-6d0b-4116-bb1e-0f638f73bf07 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:18.130723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-180d7e99-6d0b-4116-bb1e-0f638f73bf07 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:18.137005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-180d7e99-6d0b-4116-bb1e-0f638f73bf07 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:18.137521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-180d7e99-6d0b-4116-bb1e-0f638f73bf07 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:18.137957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-180d7e99-6d0b-4116-bb1e-0f638f73bf07 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:18.138635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-180d7e99-6d0b-4116-bb1e-0f638f73bf07 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:18.139084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-180d7e99-6d0b-4116-bb1e-0f638f73bf07 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:18.140185 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-180d7e99-6d0b-4116-bb1e-0f638f73bf07 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:18.268226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-180d7e99-6d0b-4116-bb1e-0f638f73bf07 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:18.276295 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-180d7e99-6d0b-4116-bb1e-0f638f73bf07 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150117 Oct 28 20:18:18.276861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 899/1801] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:18 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:18.287720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc5e18de-51cd-4a94-94ef-bf75ac82fea3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:18.290047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dc5e18de-51cd-4a94-94ef-bf75ac82fea3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:18.296590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc5e18de-51cd-4a94-94ef-bf75ac82fea3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:18.297073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc5e18de-51cd-4a94-94ef-bf75ac82fea3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:18.297542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc5e18de-51cd-4a94-94ef-bf75ac82fea3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:18.298232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc5e18de-51cd-4a94-94ef-bf75ac82fea3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:18.298687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc5e18de-51cd-4a94-94ef-bf75ac82fea3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:18.299115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc5e18de-51cd-4a94-94ef-bf75ac82fea3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:18.328495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc5e18de-51cd-4a94-94ef-bf75ac82fea3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045106 Oct 28 20:18:18.329040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 903/1802] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:18 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:19.300101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bbb64174-bd9f-4860-99bb-5ff7a4fdbea3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:19.300719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bbb64174-bd9f-4860-99bb-5ff7a4fdbea3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:19.307185 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbb64174-bd9f-4860-99bb-5ff7a4fdbea3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:19.307670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbb64174-bd9f-4860-99bb-5ff7a4fdbea3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:19.308111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbb64174-bd9f-4860-99bb-5ff7a4fdbea3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:19.308799 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbb64174-bd9f-4860-99bb-5ff7a4fdbea3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:19.309253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbb64174-bd9f-4860-99bb-5ff7a4fdbea3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:19.309708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbb64174-bd9f-4860-99bb-5ff7a4fdbea3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:19.340431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ab191ada-108a-4e54-99dd-009f256f3937 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:19.343147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ab191ada-108a-4e54-99dd-009f256f3937 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:19.349618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab191ada-108a-4e54-99dd-009f256f3937 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:19.350108 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab191ada-108a-4e54-99dd-009f256f3937 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:19.350547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab191ada-108a-4e54-99dd-009f256f3937 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:19.351249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab191ada-108a-4e54-99dd-009f256f3937 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:19.351706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab191ada-108a-4e54-99dd-009f256f3937 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:19.352141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab191ada-108a-4e54-99dd-009f256f3937 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:19.383317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ab191ada-108a-4e54-99dd-009f256f3937 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046760 Oct 28 20:18:19.383899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 904/1803] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:19 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:18:19.438001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bbb64174-bd9f-4860-99bb-5ff7a4fdbea3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:19.446015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bbb64174-bd9f-4860-99bb-5ff7a4fdbea3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149913 Oct 28 20:18:19.446582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 900/1804] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:19 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:20.396622 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-347fd489-a26c-4655-9f63-809cdfcaa3e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:20.398774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-347fd489-a26c-4655-9f63-809cdfcaa3e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:20.405928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347fd489-a26c-4655-9f63-809cdfcaa3e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:20.406411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347fd489-a26c-4655-9f63-809cdfcaa3e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:20.406851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347fd489-a26c-4655-9f63-809cdfcaa3e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:20.407544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347fd489-a26c-4655-9f63-809cdfcaa3e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:20.407999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347fd489-a26c-4655-9f63-809cdfcaa3e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:20.408431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347fd489-a26c-4655-9f63-809cdfcaa3e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:20.436882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-347fd489-a26c-4655-9f63-809cdfcaa3e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044303 Oct 28 20:18:20.437438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 905/1805] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:20 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:20.470353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7d065e4e-1118-4252-b2c8-25702ec4473d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:20.470963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7d065e4e-1118-4252-b2c8-25702ec4473d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:20.477333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d065e4e-1118-4252-b2c8-25702ec4473d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:20.477822 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d065e4e-1118-4252-b2c8-25702ec4473d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:20.478257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d065e4e-1118-4252-b2c8-25702ec4473d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:20.478936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d065e4e-1118-4252-b2c8-25702ec4473d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:20.479389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d065e4e-1118-4252-b2c8-25702ec4473d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:20.479807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d065e4e-1118-4252-b2c8-25702ec4473d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:20.609874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7d065e4e-1118-4252-b2c8-25702ec4473d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:20.617901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7d065e4e-1118-4252-b2c8-25702ec4473d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151994 Oct 28 20:18:20.618457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 901/1806] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:20 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:21.449234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fea618f3-64a7-412b-8399-9a5e994f003a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:21.452091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fea618f3-64a7-412b-8399-9a5e994f003a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:21.458780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fea618f3-64a7-412b-8399-9a5e994f003a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:21.459261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fea618f3-64a7-412b-8399-9a5e994f003a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:21.459702 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fea618f3-64a7-412b-8399-9a5e994f003a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:21.460675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fea618f3-64a7-412b-8399-9a5e994f003a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:21.461133 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fea618f3-64a7-412b-8399-9a5e994f003a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:21.461592 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fea618f3-64a7-412b-8399-9a5e994f003a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:21.490813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fea618f3-64a7-412b-8399-9a5e994f003a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045555 Oct 28 20:18:21.491371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 906/1807] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:21 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:21.641226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-12bd40ef-e3d8-426f-a80e-bef2dc4e7526 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:21.641811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-12bd40ef-e3d8-426f-a80e-bef2dc4e7526 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:21.648155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12bd40ef-e3d8-426f-a80e-bef2dc4e7526 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:21.648639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12bd40ef-e3d8-426f-a80e-bef2dc4e7526 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:21.649118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12bd40ef-e3d8-426f-a80e-bef2dc4e7526 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:21.649832 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12bd40ef-e3d8-426f-a80e-bef2dc4e7526 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:21.650286 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12bd40ef-e3d8-426f-a80e-bef2dc4e7526 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:21.650708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12bd40ef-e3d8-426f-a80e-bef2dc4e7526 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:21.780966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-12bd40ef-e3d8-426f-a80e-bef2dc4e7526 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:21.789099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-12bd40ef-e3d8-426f-a80e-bef2dc4e7526 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152433 Oct 28 20:18:21.789700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 902/1808] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:21 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:22.503886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6090f6bb-0a3b-4e9b-9915-2b8e4a82ff57 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:22.506162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6090f6bb-0a3b-4e9b-9915-2b8e4a82ff57 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:22.512600 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6090f6bb-0a3b-4e9b-9915-2b8e4a82ff57 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:22.513075 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6090f6bb-0a3b-4e9b-9915-2b8e4a82ff57 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:22.513549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6090f6bb-0a3b-4e9b-9915-2b8e4a82ff57 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:22.514952 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6090f6bb-0a3b-4e9b-9915-2b8e4a82ff57 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:22.515586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6090f6bb-0a3b-4e9b-9915-2b8e4a82ff57 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:22.516010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6090f6bb-0a3b-4e9b-9915-2b8e4a82ff57 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:22.544899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6090f6bb-0a3b-4e9b-9915-2b8e4a82ff57 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044998 Oct 28 20:18:22.545548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 907/1809] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:22 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:22.812050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e5b6efc-5fc7-457e-a1ae-415dc4b3a569 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:22.812592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4e5b6efc-5fc7-457e-a1ae-415dc4b3a569 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:22.819022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5b6efc-5fc7-457e-a1ae-415dc4b3a569 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:22.819503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5b6efc-5fc7-457e-a1ae-415dc4b3a569 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:22.819974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5b6efc-5fc7-457e-a1ae-415dc4b3a569 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:22.820658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5b6efc-5fc7-457e-a1ae-415dc4b3a569 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:22.821112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5b6efc-5fc7-457e-a1ae-415dc4b3a569 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:22.821564 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5b6efc-5fc7-457e-a1ae-415dc4b3a569 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:22.948029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e5b6efc-5fc7-457e-a1ae-415dc4b3a569 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:22.956518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4e5b6efc-5fc7-457e-a1ae-415dc4b3a569 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.148405 Oct 28 20:18:22.957078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 903/1810] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:22 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:23.556764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-52f39595-5df3-477e-9788-040886945757 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:23.559032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-52f39595-5df3-477e-9788-040886945757 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:23.566745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52f39595-5df3-477e-9788-040886945757 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:23.567383 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52f39595-5df3-477e-9788-040886945757 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:23.567830 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52f39595-5df3-477e-9788-040886945757 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:23.568534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52f39595-5df3-477e-9788-040886945757 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:23.569008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52f39595-5df3-477e-9788-040886945757 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:23.569523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52f39595-5df3-477e-9788-040886945757 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:23.599286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-52f39595-5df3-477e-9788-040886945757 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046553 Oct 28 20:18:23.599847 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 908/1811] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:23 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:23.980427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-70703e09-7e56-4d7a-8c89-3bf8c996959f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:23.981039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-70703e09-7e56-4d7a-8c89-3bf8c996959f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:23.988230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70703e09-7e56-4d7a-8c89-3bf8c996959f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:23.988708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70703e09-7e56-4d7a-8c89-3bf8c996959f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:23.989169 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70703e09-7e56-4d7a-8c89-3bf8c996959f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:23.989880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70703e09-7e56-4d7a-8c89-3bf8c996959f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:23.990328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70703e09-7e56-4d7a-8c89-3bf8c996959f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:23.990746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70703e09-7e56-4d7a-8c89-3bf8c996959f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:24.120540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-70703e09-7e56-4d7a-8c89-3bf8c996959f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:24.128737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-70703e09-7e56-4d7a-8c89-3bf8c996959f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152575 Oct 28 20:18:24.129303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 904/1812] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:23 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:24.611741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-740b9869-0e98-402d-88c4-0e04f7d8d6d4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:24.613934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-740b9869-0e98-402d-88c4-0e04f7d8d6d4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:24.620215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-740b9869-0e98-402d-88c4-0e04f7d8d6d4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:24.620690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-740b9869-0e98-402d-88c4-0e04f7d8d6d4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:24.621119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-740b9869-0e98-402d-88c4-0e04f7d8d6d4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:24.621833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-740b9869-0e98-402d-88c4-0e04f7d8d6d4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:24.622281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-740b9869-0e98-402d-88c4-0e04f7d8d6d4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:24.622709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-740b9869-0e98-402d-88c4-0e04f7d8d6d4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:24.652062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-740b9869-0e98-402d-88c4-0e04f7d8d6d4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045042 Oct 28 20:18:24.652619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 909/1813] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:24 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:25.151926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8ad30f97-9d09-42ae-b2e2-4654c9f3c17b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:25.152538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8ad30f97-9d09-42ae-b2e2-4654c9f3c17b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:25.159228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ad30f97-9d09-42ae-b2e2-4654c9f3c17b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:25.159714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ad30f97-9d09-42ae-b2e2-4654c9f3c17b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:25.160151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ad30f97-9d09-42ae-b2e2-4654c9f3c17b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:25.160842 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ad30f97-9d09-42ae-b2e2-4654c9f3c17b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:25.161299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ad30f97-9d09-42ae-b2e2-4654c9f3c17b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:25.161751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ad30f97-9d09-42ae-b2e2-4654c9f3c17b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:25.286964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8ad30f97-9d09-42ae-b2e2-4654c9f3c17b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:25.295246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8ad30f97-9d09-42ae-b2e2-4654c9f3c17b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.147180 Oct 28 20:18:25.296392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 905/1814] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:25 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:25.664431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-92dec229-c452-4f36-be23-f0b71043ce51 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:25.666643 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-92dec229-c452-4f36-be23-f0b71043ce51 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:25.673448 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92dec229-c452-4f36-be23-f0b71043ce51 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:25.673935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92dec229-c452-4f36-be23-f0b71043ce51 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:25.674369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92dec229-c452-4f36-be23-f0b71043ce51 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:25.675055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92dec229-c452-4f36-be23-f0b71043ce51 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:25.675502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92dec229-c452-4f36-be23-f0b71043ce51 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:25.675918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92dec229-c452-4f36-be23-f0b71043ce51 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:25.706617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-92dec229-c452-4f36-be23-f0b71043ce51 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046098 Oct 28 20:18:25.707162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 910/1815] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:25 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:26.320066 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3be5a0d8-fae8-4721-a7a5-0f656f390330 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:26.320710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3be5a0d8-fae8-4721-a7a5-0f656f390330 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:26.327737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3be5a0d8-fae8-4721-a7a5-0f656f390330 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:26.328218 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3be5a0d8-fae8-4721-a7a5-0f656f390330 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:26.328653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3be5a0d8-fae8-4721-a7a5-0f656f390330 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:26.329354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3be5a0d8-fae8-4721-a7a5-0f656f390330 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:26.329810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3be5a0d8-fae8-4721-a7a5-0f656f390330 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:26.330235 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3be5a0d8-fae8-4721-a7a5-0f656f390330 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:26.462968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3be5a0d8-fae8-4721-a7a5-0f656f390330 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:26.471315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3be5a0d8-fae8-4721-a7a5-0f656f390330 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155255 Oct 28 20:18:26.471882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 906/1816] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:26 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:26.719694 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-77d1f1b5-2040-40a4-a46c-2ec36d26da23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:26.721948 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-77d1f1b5-2040-40a4-a46c-2ec36d26da23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:26.728310 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77d1f1b5-2040-40a4-a46c-2ec36d26da23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:26.728795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77d1f1b5-2040-40a4-a46c-2ec36d26da23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:26.729245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77d1f1b5-2040-40a4-a46c-2ec36d26da23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:26.729971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77d1f1b5-2040-40a4-a46c-2ec36d26da23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:26.730428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77d1f1b5-2040-40a4-a46c-2ec36d26da23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:26.730857 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77d1f1b5-2040-40a4-a46c-2ec36d26da23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:26.762168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-77d1f1b5-2040-40a4-a46c-2ec36d26da23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046638 Oct 28 20:18:26.762723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 911/1817] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:26 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:27.494737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aa08cb12-467d-475d-8899-233797388b89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:27.495352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aa08cb12-467d-475d-8899-233797388b89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:27.502662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa08cb12-467d-475d-8899-233797388b89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:27.503192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa08cb12-467d-475d-8899-233797388b89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:27.503634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa08cb12-467d-475d-8899-233797388b89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:27.504331 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa08cb12-467d-475d-8899-233797388b89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:27.504789 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa08cb12-467d-475d-8899-233797388b89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:27.505213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa08cb12-467d-475d-8899-233797388b89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:27.524017 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:18:27.637931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-aa08cb12-467d-475d-8899-233797388b89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:27.647184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aa08cb12-467d-475d-8899-233797388b89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.156207 Oct 28 20:18:27.647762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 907/1818] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:27 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:27.774926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fb495239-9c59-4aef-9787-72f11945ed9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:27.777069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fb495239-9c59-4aef-9787-72f11945ed9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:27.783333 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb495239-9c59-4aef-9787-72f11945ed9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:27.783809 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb495239-9c59-4aef-9787-72f11945ed9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:27.784240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb495239-9c59-4aef-9787-72f11945ed9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:27.784930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb495239-9c59-4aef-9787-72f11945ed9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:27.785403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb495239-9c59-4aef-9787-72f11945ed9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:27.785828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb495239-9c59-4aef-9787-72f11945ed9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:27.815091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fb495239-9c59-4aef-9787-72f11945ed9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043948 Oct 28 20:18:27.815571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 912/1819] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:27 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:28.669853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be48d474-e115-4099-9e3b-9a41f5bbc7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:28.670697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-be48d474-e115-4099-9e3b-9a41f5bbc7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:28.677010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be48d474-e115-4099-9e3b-9a41f5bbc7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:28.677521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be48d474-e115-4099-9e3b-9a41f5bbc7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:28.677951 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be48d474-e115-4099-9e3b-9a41f5bbc7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:28.679043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be48d474-e115-4099-9e3b-9a41f5bbc7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:28.679500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be48d474-e115-4099-9e3b-9a41f5bbc7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:28.680050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be48d474-e115-4099-9e3b-9a41f5bbc7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:28.814957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-be48d474-e115-4099-9e3b-9a41f5bbc7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:28.823527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-be48d474-e115-4099-9e3b-9a41f5bbc7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.157355 Oct 28 20:18:28.827209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2595b0d-5f7f-44c9-a193-cdd066e420cd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:28.829480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2595b0d-5f7f-44c9-a193-cdd066e420cd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:28.837451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2595b0d-5f7f-44c9-a193-cdd066e420cd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:28.837694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 908/1820] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:28 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:28.837947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2595b0d-5f7f-44c9-a193-cdd066e420cd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:28.838386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2595b0d-5f7f-44c9-a193-cdd066e420cd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:28.839092 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2595b0d-5f7f-44c9-a193-cdd066e420cd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:28.839554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2595b0d-5f7f-44c9-a193-cdd066e420cd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:28.840097 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2595b0d-5f7f-44c9-a193-cdd066e420cd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:28.869476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2595b0d-5f7f-44c9-a193-cdd066e420cd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046217 Oct 28 20:18:28.870030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 913/1821] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:28 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:29.847890 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4ede7351-ed76-4b3c-ae3f-fee8df7fe7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:29.848516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4ede7351-ed76-4b3c-ae3f-fee8df7fe7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:29.854733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ede7351-ed76-4b3c-ae3f-fee8df7fe7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:29.855221 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ede7351-ed76-4b3c-ae3f-fee8df7fe7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:29.855660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ede7351-ed76-4b3c-ae3f-fee8df7fe7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:29.856355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ede7351-ed76-4b3c-ae3f-fee8df7fe7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:29.856812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ede7351-ed76-4b3c-ae3f-fee8df7fe7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:29.857273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ede7351-ed76-4b3c-ae3f-fee8df7fe7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:29.883110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5a354cc1-a2c1-489b-b739-53cbdb7313aa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:29.885274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5a354cc1-a2c1-489b-b739-53cbdb7313aa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:29.894346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a354cc1-a2c1-489b-b739-53cbdb7313aa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:29.894831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a354cc1-a2c1-489b-b739-53cbdb7313aa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:29.895324 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a354cc1-a2c1-489b-b739-53cbdb7313aa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:29.896060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a354cc1-a2c1-489b-b739-53cbdb7313aa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:29.896518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a354cc1-a2c1-489b-b739-53cbdb7313aa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:29.896941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a354cc1-a2c1-489b-b739-53cbdb7313aa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:29.940850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5a354cc1-a2c1-489b-b739-53cbdb7313aa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051159 Oct 28 20:18:29.940850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 914/1822] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:29 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:30.001254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4ede7351-ed76-4b3c-ae3f-fee8df7fe7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:30.009414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4ede7351-ed76-4b3c-ae3f-fee8df7fe7ce tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.165363 Oct 28 20:18:30.010075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 909/1823] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:29 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:30.942870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34279877-3c18-44e6-915d-5d44b354dc04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:30.945011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-34279877-3c18-44e6-915d-5d44b354dc04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:30.951318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34279877-3c18-44e6-915d-5d44b354dc04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:30.951865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34279877-3c18-44e6-915d-5d44b354dc04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:30.952218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34279877-3c18-44e6-915d-5d44b354dc04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:30.952902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34279877-3c18-44e6-915d-5d44b354dc04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:30.953367 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34279877-3c18-44e6-915d-5d44b354dc04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:30.953796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34279877-3c18-44e6-915d-5d44b354dc04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:30.985069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-34279877-3c18-44e6-915d-5d44b354dc04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046040 Oct 28 20:18:30.985679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 915/1824] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:30 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:31.032750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-df6dac10-64ab-4372-9c4e-ac27e8f47e64 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:31.033390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-df6dac10-64ab-4372-9c4e-ac27e8f47e64 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:31.039728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df6dac10-64ab-4372-9c4e-ac27e8f47e64 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:31.040210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df6dac10-64ab-4372-9c4e-ac27e8f47e64 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:31.040647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df6dac10-64ab-4372-9c4e-ac27e8f47e64 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:31.041353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df6dac10-64ab-4372-9c4e-ac27e8f47e64 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:31.041805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df6dac10-64ab-4372-9c4e-ac27e8f47e64 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:31.042231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df6dac10-64ab-4372-9c4e-ac27e8f47e64 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:31.171495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-df6dac10-64ab-4372-9c4e-ac27e8f47e64 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:31.179522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-df6dac10-64ab-4372-9c4e-ac27e8f47e64 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150632 Oct 28 20:18:31.180090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 910/1825] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:31 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:31.997423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82186e02-0014-4b7d-b453-09bd345bb4c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:32.000270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-82186e02-0014-4b7d-b453-09bd345bb4c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:32.002568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=60 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:18:32.007456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82186e02-0014-4b7d-b453-09bd345bb4c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:32.007930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82186e02-0014-4b7d-b453-09bd345bb4c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:32.008364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82186e02-0014-4b7d-b453-09bd345bb4c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:32.009059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82186e02-0014-4b7d-b453-09bd345bb4c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:32.009533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82186e02-0014-4b7d-b453-09bd345bb4c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:32.009962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82186e02-0014-4b7d-b453-09bd345bb4c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:32.042478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-82186e02-0014-4b7d-b453-09bd345bb4c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048931 Oct 28 20:18:32.043052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 916/1826] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:31 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:32.202730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8f9c4ca4-2677-4a36-84d3-e688aab892eb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:32.203348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8f9c4ca4-2677-4a36-84d3-e688aab892eb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:32.209744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f9c4ca4-2677-4a36-84d3-e688aab892eb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:32.210227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f9c4ca4-2677-4a36-84d3-e688aab892eb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:32.210926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f9c4ca4-2677-4a36-84d3-e688aab892eb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:32.211610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f9c4ca4-2677-4a36-84d3-e688aab892eb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:32.212074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f9c4ca4-2677-4a36-84d3-e688aab892eb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:32.212487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f9c4ca4-2677-4a36-84d3-e688aab892eb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:32.342781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8f9c4ca4-2677-4a36-84d3-e688aab892eb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:32.351365 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8f9c4ca4-2677-4a36-84d3-e688aab892eb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152480 Oct 28 20:18:32.351935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 911/1827] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:32 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:33.055406 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b78aab9f-84d6-47c6-9b85-77e07ee805ca tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:33.057627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b78aab9f-84d6-47c6-9b85-77e07ee805ca tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:33.064348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b78aab9f-84d6-47c6-9b85-77e07ee805ca tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:33.064838 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b78aab9f-84d6-47c6-9b85-77e07ee805ca tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:33.065283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b78aab9f-84d6-47c6-9b85-77e07ee805ca tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:33.066011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b78aab9f-84d6-47c6-9b85-77e07ee805ca tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:33.067201 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b78aab9f-84d6-47c6-9b85-77e07ee805ca tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:33.067647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b78aab9f-84d6-47c6-9b85-77e07ee805ca tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:33.098567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b78aab9f-84d6-47c6-9b85-77e07ee805ca tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047242 Oct 28 20:18:33.099134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 917/1828] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:33 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:18:33.375137 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bce3242c-516c-4349-aafb-fce6be12c15c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:33.375752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bce3242c-516c-4349-aafb-fce6be12c15c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:33.378113 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=52 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:18:33.382667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bce3242c-516c-4349-aafb-fce6be12c15c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:33.383148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bce3242c-516c-4349-aafb-fce6be12c15c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:33.383580 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bce3242c-516c-4349-aafb-fce6be12c15c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:33.384265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bce3242c-516c-4349-aafb-fce6be12c15c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:33.384718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bce3242c-516c-4349-aafb-fce6be12c15c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:33.385199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bce3242c-516c-4349-aafb-fce6be12c15c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:33.518270 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bce3242c-516c-4349-aafb-fce6be12c15c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:33.526437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bce3242c-516c-4349-aafb-fce6be12c15c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155374 Oct 28 20:18:33.531267 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 912/1829] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:33 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:34.110377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-98a642bb-ef4b-4312-97df-2fc6bcc4da60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:34.112586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-98a642bb-ef4b-4312-97df-2fc6bcc4da60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:34.119097 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98a642bb-ef4b-4312-97df-2fc6bcc4da60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:34.119578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98a642bb-ef4b-4312-97df-2fc6bcc4da60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:34.120017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98a642bb-ef4b-4312-97df-2fc6bcc4da60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:34.120713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98a642bb-ef4b-4312-97df-2fc6bcc4da60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:34.121254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98a642bb-ef4b-4312-97df-2fc6bcc4da60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:34.121976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98a642bb-ef4b-4312-97df-2fc6bcc4da60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:34.152207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-98a642bb-ef4b-4312-97df-2fc6bcc4da60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045943 Oct 28 20:18:34.152768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 918/1830] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:34 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:34.550343 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-858a34d3-1e67-4c7d-80fa-a1b7ea42f76d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:34.551085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-858a34d3-1e67-4c7d-80fa-a1b7ea42f76d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:34.557535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-858a34d3-1e67-4c7d-80fa-a1b7ea42f76d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:34.558014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-858a34d3-1e67-4c7d-80fa-a1b7ea42f76d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:34.558449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-858a34d3-1e67-4c7d-80fa-a1b7ea42f76d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:34.559131 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-858a34d3-1e67-4c7d-80fa-a1b7ea42f76d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:34.559579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-858a34d3-1e67-4c7d-80fa-a1b7ea42f76d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:34.560001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-858a34d3-1e67-4c7d-80fa-a1b7ea42f76d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:34.691181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-858a34d3-1e67-4c7d-80fa-a1b7ea42f76d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:34.699302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-858a34d3-1e67-4c7d-80fa-a1b7ea42f76d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152952 Oct 28 20:18:34.699888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 913/1831] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:34 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:35.165626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d0b6af67-68b1-44c0-ad83-fd0919bfdd0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:35.168044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d0b6af67-68b1-44c0-ad83-fd0919bfdd0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:35.175304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0b6af67-68b1-44c0-ad83-fd0919bfdd0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:35.175798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0b6af67-68b1-44c0-ad83-fd0919bfdd0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:35.176242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0b6af67-68b1-44c0-ad83-fd0919bfdd0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:35.176940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0b6af67-68b1-44c0-ad83-fd0919bfdd0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:35.177435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0b6af67-68b1-44c0-ad83-fd0919bfdd0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:35.177864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0b6af67-68b1-44c0-ad83-fd0919bfdd0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:35.183025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:18:35.211207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d0b6af67-68b1-44c0-ad83-fd0919bfdd0e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049067 Oct 28 20:18:35.211635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 919/1832] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:35 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:35.723467 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f603556d-7dd0-42c5-81e5-9d20622c872e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:35.724075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f603556d-7dd0-42c5-81e5-9d20622c872e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:35.730462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f603556d-7dd0-42c5-81e5-9d20622c872e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:35.730943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f603556d-7dd0-42c5-81e5-9d20622c872e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:35.731378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f603556d-7dd0-42c5-81e5-9d20622c872e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:35.732065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f603556d-7dd0-42c5-81e5-9d20622c872e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:35.733036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f603556d-7dd0-42c5-81e5-9d20622c872e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:35.733494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f603556d-7dd0-42c5-81e5-9d20622c872e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:35.860266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f603556d-7dd0-42c5-81e5-9d20622c872e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:35.868405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f603556d-7dd0-42c5-81e5-9d20622c872e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.148767 Oct 28 20:18:35.868966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 914/1833] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:35 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:36.223824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-710495b9-c99d-403a-ba23-40238a058a0d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:36.226021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-710495b9-c99d-403a-ba23-40238a058a0d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:36.233008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-710495b9-c99d-403a-ba23-40238a058a0d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:36.233544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-710495b9-c99d-403a-ba23-40238a058a0d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:36.233986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-710495b9-c99d-403a-ba23-40238a058a0d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:36.234699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-710495b9-c99d-403a-ba23-40238a058a0d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:36.235147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-710495b9-c99d-403a-ba23-40238a058a0d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:36.235572 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-710495b9-c99d-403a-ba23-40238a058a0d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:36.265727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-710495b9-c99d-403a-ba23-40238a058a0d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045867 Oct 28 20:18:36.266469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 920/1834] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:36 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:36.892005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-29702bc4-55f6-4112-976f-d8fa06efa6f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:36.892632 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-29702bc4-55f6-4112-976f-d8fa06efa6f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:36.899201 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29702bc4-55f6-4112-976f-d8fa06efa6f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:36.899719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29702bc4-55f6-4112-976f-d8fa06efa6f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:36.900163 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29702bc4-55f6-4112-976f-d8fa06efa6f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:36.900857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29702bc4-55f6-4112-976f-d8fa06efa6f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:36.901314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29702bc4-55f6-4112-976f-d8fa06efa6f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:36.901769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29702bc4-55f6-4112-976f-d8fa06efa6f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:37.032996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-29702bc4-55f6-4112-976f-d8fa06efa6f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:37.041215 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-29702bc4-55f6-4112-976f-d8fa06efa6f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153702 Oct 28 20:18:37.041814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 915/1835] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:36 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:37.277222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7c74c680-6494-4d54-8cc1-620706491b9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:37.280555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7c74c680-6494-4d54-8cc1-620706491b9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:37.286644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c74c680-6494-4d54-8cc1-620706491b9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:37.287157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c74c680-6494-4d54-8cc1-620706491b9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:37.287590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c74c680-6494-4d54-8cc1-620706491b9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:37.288287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c74c680-6494-4d54-8cc1-620706491b9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:37.288736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c74c680-6494-4d54-8cc1-620706491b9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:37.289183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c74c680-6494-4d54-8cc1-620706491b9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:37.320741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7c74c680-6494-4d54-8cc1-620706491b9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047443 Oct 28 20:18:37.325704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 921/1836] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:37 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:38.065238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aa7331f7-0522-4dad-af9c-40b17c999b29 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:38.065899 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aa7331f7-0522-4dad-af9c-40b17c999b29 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:38.072247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa7331f7-0522-4dad-af9c-40b17c999b29 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:38.072733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa7331f7-0522-4dad-af9c-40b17c999b29 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:38.073176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa7331f7-0522-4dad-af9c-40b17c999b29 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:38.073897 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa7331f7-0522-4dad-af9c-40b17c999b29 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:38.074360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa7331f7-0522-4dad-af9c-40b17c999b29 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:38.074798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa7331f7-0522-4dad-af9c-40b17c999b29 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:38.205670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-aa7331f7-0522-4dad-af9c-40b17c999b29 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:38.214093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aa7331f7-0522-4dad-af9c-40b17c999b29 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152742 Oct 28 20:18:38.214656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 916/1837] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:38 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:38.332761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-439080c8-a2a2-4b71-a28b-5a4828c0c69f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:38.335767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-439080c8-a2a2-4b71-a28b-5a4828c0c69f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:38.342072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-439080c8-a2a2-4b71-a28b-5a4828c0c69f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:38.342549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-439080c8-a2a2-4b71-a28b-5a4828c0c69f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:38.342988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-439080c8-a2a2-4b71-a28b-5a4828c0c69f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:38.343704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-439080c8-a2a2-4b71-a28b-5a4828c0c69f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:38.344153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-439080c8-a2a2-4b71-a28b-5a4828c0c69f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:38.344611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-439080c8-a2a2-4b71-a28b-5a4828c0c69f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:38.376198 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-439080c8-a2a2-4b71-a28b-5a4828c0c69f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047294 Oct 28 20:18:38.376763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 922/1838] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:38 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:39.237671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ed50353d-aa9e-476f-8586-6939c831d7f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:39.238318 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ed50353d-aa9e-476f-8586-6939c831d7f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:39.244666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed50353d-aa9e-476f-8586-6939c831d7f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:39.245151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed50353d-aa9e-476f-8586-6939c831d7f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:39.245623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed50353d-aa9e-476f-8586-6939c831d7f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:39.246315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed50353d-aa9e-476f-8586-6939c831d7f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:39.246774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed50353d-aa9e-476f-8586-6939c831d7f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:39.247204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed50353d-aa9e-476f-8586-6939c831d7f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:39.379140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ed50353d-aa9e-476f-8586-6939c831d7f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:39.387752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ed50353d-aa9e-476f-8586-6939c831d7f2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154278 Oct 28 20:18:39.389370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 917/1839] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:39 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:39.398405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0527f3fc-c524-47c0-9a31-362d99ec3a2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:39.400553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0527f3fc-c524-47c0-9a31-362d99ec3a2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:39.407836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0527f3fc-c524-47c0-9a31-362d99ec3a2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:39.408434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0527f3fc-c524-47c0-9a31-362d99ec3a2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:39.408729 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0527f3fc-c524-47c0-9a31-362d99ec3a2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:39.409445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0527f3fc-c524-47c0-9a31-362d99ec3a2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:39.409895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0527f3fc-c524-47c0-9a31-362d99ec3a2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:39.410319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0527f3fc-c524-47c0-9a31-362d99ec3a2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:39.439548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0527f3fc-c524-47c0-9a31-362d99ec3a2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044967 Oct 28 20:18:39.440248 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 923/1840] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:39 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:40.411536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43f95ef8-bcf4-4ac4-9fd6-75755d08dde7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:40.412367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-43f95ef8-bcf4-4ac4-9fd6-75755d08dde7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:40.418906 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43f95ef8-bcf4-4ac4-9fd6-75755d08dde7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:40.419408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43f95ef8-bcf4-4ac4-9fd6-75755d08dde7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:40.420477 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43f95ef8-bcf4-4ac4-9fd6-75755d08dde7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:40.421591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43f95ef8-bcf4-4ac4-9fd6-75755d08dde7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:40.422059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43f95ef8-bcf4-4ac4-9fd6-75755d08dde7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:40.422490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43f95ef8-bcf4-4ac4-9fd6-75755d08dde7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:40.453658 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5e5deb90-6e29-49ad-bf0a-1e36613cc94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:40.466125 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5e5deb90-6e29-49ad-bf0a-1e36613cc94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:40.481444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e5deb90-6e29-49ad-bf0a-1e36613cc94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:40.482191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e5deb90-6e29-49ad-bf0a-1e36613cc94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:40.483655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e5deb90-6e29-49ad-bf0a-1e36613cc94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:40.484649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e5deb90-6e29-49ad-bf0a-1e36613cc94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:40.485426 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e5deb90-6e29-49ad-bf0a-1e36613cc94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:40.486072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e5deb90-6e29-49ad-bf0a-1e36613cc94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:40.519130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5e5deb90-6e29-49ad-bf0a-1e36613cc94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070687 Oct 28 20:18:40.523529 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 924/1841] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:40 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:18:40.583340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-43f95ef8-bcf4-4ac4-9fd6-75755d08dde7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:40.592798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-43f95ef8-bcf4-4ac4-9fd6-75755d08dde7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.184570 Oct 28 20:18:40.593839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 918/1842] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:40 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:41.532011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0ee973a-82ba-4f2e-a859-72b5117a0d99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:41.534303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0ee973a-82ba-4f2e-a859-72b5117a0d99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:41.540868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0ee973a-82ba-4f2e-a859-72b5117a0d99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:41.541408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0ee973a-82ba-4f2e-a859-72b5117a0d99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:41.541817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0ee973a-82ba-4f2e-a859-72b5117a0d99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:41.542511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0ee973a-82ba-4f2e-a859-72b5117a0d99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:41.542966 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0ee973a-82ba-4f2e-a859-72b5117a0d99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:41.543389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0ee973a-82ba-4f2e-a859-72b5117a0d99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:41.573546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0ee973a-82ba-4f2e-a859-72b5117a0d99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046127 Oct 28 20:18:41.574106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 925/1843] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:41 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:41.615681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ac964b07-8eb8-4357-8374-42c07ac0df0b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:41.616297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ac964b07-8eb8-4357-8374-42c07ac0df0b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:41.622410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac964b07-8eb8-4357-8374-42c07ac0df0b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:41.622938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac964b07-8eb8-4357-8374-42c07ac0df0b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:41.623568 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac964b07-8eb8-4357-8374-42c07ac0df0b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:41.624440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac964b07-8eb8-4357-8374-42c07ac0df0b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:41.624893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac964b07-8eb8-4357-8374-42c07ac0df0b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:41.625312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac964b07-8eb8-4357-8374-42c07ac0df0b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:41.760476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ac964b07-8eb8-4357-8374-42c07ac0df0b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:41.769079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ac964b07-8eb8-4357-8374-42c07ac0df0b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.157020 Oct 28 20:18:41.769704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 919/1844] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:41 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:42.594498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c651fa7d-c852-437a-a0de-c00e771d7954 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:42.596688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c651fa7d-c852-437a-a0de-c00e771d7954 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:42.603218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c651fa7d-c852-437a-a0de-c00e771d7954 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:42.603704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c651fa7d-c852-437a-a0de-c00e771d7954 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:42.604142 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c651fa7d-c852-437a-a0de-c00e771d7954 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:42.604836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c651fa7d-c852-437a-a0de-c00e771d7954 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:42.605335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c651fa7d-c852-437a-a0de-c00e771d7954 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:42.605766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c651fa7d-c852-437a-a0de-c00e771d7954 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:42.636596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c651fa7d-c852-437a-a0de-c00e771d7954 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046102 Oct 28 20:18:42.637152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 926/1845] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:42 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:42.791767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3053eede-5da6-4787-b32e-8e547aab5db9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:42.792376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3053eede-5da6-4787-b32e-8e547aab5db9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:42.798780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3053eede-5da6-4787-b32e-8e547aab5db9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:42.799261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3053eede-5da6-4787-b32e-8e547aab5db9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:42.799721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3053eede-5da6-4787-b32e-8e547aab5db9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:42.800404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3053eede-5da6-4787-b32e-8e547aab5db9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:42.800852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3053eede-5da6-4787-b32e-8e547aab5db9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:42.801270 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3053eede-5da6-4787-b32e-8e547aab5db9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:42.932128 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3053eede-5da6-4787-b32e-8e547aab5db9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:42.941456 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3053eede-5da6-4787-b32e-8e547aab5db9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153455 Oct 28 20:18:42.942016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 920/1846] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:42 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:43.650162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3d458574-cbee-4cf4-a9bb-416d90671985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:43.652517 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3d458574-cbee-4cf4-a9bb-416d90671985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:43.660154 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d458574-cbee-4cf4-a9bb-416d90671985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:43.660645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d458574-cbee-4cf4-a9bb-416d90671985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:43.661093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d458574-cbee-4cf4-a9bb-416d90671985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:43.661912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d458574-cbee-4cf4-a9bb-416d90671985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:43.662377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d458574-cbee-4cf4-a9bb-416d90671985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:43.662808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d458574-cbee-4cf4-a9bb-416d90671985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:43.696991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3d458574-cbee-4cf4-a9bb-416d90671985 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050767 Oct 28 20:18:43.703119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 927/1847] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:43 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:43.964289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8a6eacc5-d551-4c43-9919-3fd6958f96be tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:43.964961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8a6eacc5-d551-4c43-9919-3fd6958f96be tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:43.971678 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a6eacc5-d551-4c43-9919-3fd6958f96be tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:43.972205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a6eacc5-d551-4c43-9919-3fd6958f96be tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:43.972670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a6eacc5-d551-4c43-9919-3fd6958f96be tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:43.973723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a6eacc5-d551-4c43-9919-3fd6958f96be tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:43.974538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a6eacc5-d551-4c43-9919-3fd6958f96be tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:43.975307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a6eacc5-d551-4c43-9919-3fd6958f96be tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:44.106562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8a6eacc5-d551-4c43-9919-3fd6958f96be tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:44.115247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8a6eacc5-d551-4c43-9919-3fd6958f96be tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155090 Oct 28 20:18:44.115806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 921/1848] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:43 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:44.711093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-89a49eaf-03af-4712-9d52-157c0d67a791 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:44.713098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-89a49eaf-03af-4712-9d52-157c0d67a791 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:44.720510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89a49eaf-03af-4712-9d52-157c0d67a791 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:44.720988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89a49eaf-03af-4712-9d52-157c0d67a791 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:44.721446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89a49eaf-03af-4712-9d52-157c0d67a791 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:44.722136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89a49eaf-03af-4712-9d52-157c0d67a791 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:44.722581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89a49eaf-03af-4712-9d52-157c0d67a791 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:44.723028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89a49eaf-03af-4712-9d52-157c0d67a791 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:44.756736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-89a49eaf-03af-4712-9d52-157c0d67a791 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049988 Oct 28 20:18:44.758711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 928/1849] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:44 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:45.139754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0b3ced41-2a30-437c-8428-7351d7aa623a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:45.140374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0b3ced41-2a30-437c-8428-7351d7aa623a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:45.146836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b3ced41-2a30-437c-8428-7351d7aa623a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:45.147322 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b3ced41-2a30-437c-8428-7351d7aa623a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:45.147764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b3ced41-2a30-437c-8428-7351d7aa623a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:45.148455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b3ced41-2a30-437c-8428-7351d7aa623a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:45.148934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b3ced41-2a30-437c-8428-7351d7aa623a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:45.149366 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b3ced41-2a30-437c-8428-7351d7aa623a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:45.280774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0b3ced41-2a30-437c-8428-7351d7aa623a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:45.288927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0b3ced41-2a30-437c-8428-7351d7aa623a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154387 Oct 28 20:18:45.289779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 922/1850] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:45 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:18:45.769909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f8bc5df1-46fc-4199-b354-137061ce2fc4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:45.772044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f8bc5df1-46fc-4199-b354-137061ce2fc4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:45.778436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8bc5df1-46fc-4199-b354-137061ce2fc4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:45.778954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8bc5df1-46fc-4199-b354-137061ce2fc4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:45.779672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8bc5df1-46fc-4199-b354-137061ce2fc4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:45.780365 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8bc5df1-46fc-4199-b354-137061ce2fc4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:45.780817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8bc5df1-46fc-4199-b354-137061ce2fc4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:45.781243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8bc5df1-46fc-4199-b354-137061ce2fc4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:45.811968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f8bc5df1-46fc-4199-b354-137061ce2fc4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045960 Oct 28 20:18:45.812839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 929/1851] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:45 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:46.312981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a127906-5242-4238-a7fa-d3dfe8f31e66 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:46.313574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0a127906-5242-4238-a7fa-d3dfe8f31e66 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:46.319959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a127906-5242-4238-a7fa-d3dfe8f31e66 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:46.320449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a127906-5242-4238-a7fa-d3dfe8f31e66 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:46.320891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a127906-5242-4238-a7fa-d3dfe8f31e66 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:46.321643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a127906-5242-4238-a7fa-d3dfe8f31e66 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:46.322104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a127906-5242-4238-a7fa-d3dfe8f31e66 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:46.322530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a127906-5242-4238-a7fa-d3dfe8f31e66 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:46.452741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a127906-5242-4238-a7fa-d3dfe8f31e66 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:46.461213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0a127906-5242-4238-a7fa-d3dfe8f31e66 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152726 Oct 28 20:18:46.461809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 923/1852] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:46 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:46.824821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c12a2c1d-3cae-447f-a995-1d0eff498e5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:46.827667 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c12a2c1d-3cae-447f-a995-1d0eff498e5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:46.833889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c12a2c1d-3cae-447f-a995-1d0eff498e5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:46.834372 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c12a2c1d-3cae-447f-a995-1d0eff498e5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:46.834811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c12a2c1d-3cae-447f-a995-1d0eff498e5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:46.835500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c12a2c1d-3cae-447f-a995-1d0eff498e5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:46.836219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c12a2c1d-3cae-447f-a995-1d0eff498e5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:46.836646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c12a2c1d-3cae-447f-a995-1d0eff498e5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:46.866935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c12a2c1d-3cae-447f-a995-1d0eff498e5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046439 Oct 28 20:18:46.867502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 930/1853] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:46 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:47.488255 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-77525a53-5073-4a55-af82-87747d860e32 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:47.488873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-77525a53-5073-4a55-af82-87747d860e32 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:47.495865 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77525a53-5073-4a55-af82-87747d860e32 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:47.496352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77525a53-5073-4a55-af82-87747d860e32 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:47.496790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77525a53-5073-4a55-af82-87747d860e32 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:47.497767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77525a53-5073-4a55-af82-87747d860e32 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:47.498074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77525a53-5073-4a55-af82-87747d860e32 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:47.498571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77525a53-5073-4a55-af82-87747d860e32 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:47.503049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:18:47.642514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-77525a53-5073-4a55-af82-87747d860e32 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:47.651367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-77525a53-5073-4a55-af82-87747d860e32 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.170718 Oct 28 20:18:47.651941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 924/1854] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:47 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:47.879798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ae0ab2de-bab2-4383-8236-00242f212b8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:47.882524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ae0ab2de-bab2-4383-8236-00242f212b8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:47.890139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae0ab2de-bab2-4383-8236-00242f212b8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:47.890729 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae0ab2de-bab2-4383-8236-00242f212b8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:47.891184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae0ab2de-bab2-4383-8236-00242f212b8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:47.891909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae0ab2de-bab2-4383-8236-00242f212b8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:47.892357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae0ab2de-bab2-4383-8236-00242f212b8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:47.892778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae0ab2de-bab2-4383-8236-00242f212b8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:47.933421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ae0ab2de-bab2-4383-8236-00242f212b8c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057655 Oct 28 20:18:47.933994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 931/1855] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:47 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:48.677075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-27a87bce-cff5-410c-b577-09f57b419977 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:48.677720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-27a87bce-cff5-410c-b577-09f57b419977 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:48.684067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27a87bce-cff5-410c-b577-09f57b419977 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:48.684557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27a87bce-cff5-410c-b577-09f57b419977 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:48.685053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27a87bce-cff5-410c-b577-09f57b419977 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:48.686408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27a87bce-cff5-410c-b577-09f57b419977 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:48.686872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27a87bce-cff5-410c-b577-09f57b419977 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:48.687305 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27a87bce-cff5-410c-b577-09f57b419977 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:48.819765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-27a87bce-cff5-410c-b577-09f57b419977 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:48.827922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-27a87bce-cff5-410c-b577-09f57b419977 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154803 Oct 28 20:18:48.828492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 925/1856] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:48 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:48.946567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-454bc416-8fd9-4ad8-b2e0-46dff091630c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:48.948721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-454bc416-8fd9-4ad8-b2e0-46dff091630c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:48.955666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-454bc416-8fd9-4ad8-b2e0-46dff091630c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:48.956142 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-454bc416-8fd9-4ad8-b2e0-46dff091630c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:48.956579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-454bc416-8fd9-4ad8-b2e0-46dff091630c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:48.957265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-454bc416-8fd9-4ad8-b2e0-46dff091630c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:48.957742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-454bc416-8fd9-4ad8-b2e0-46dff091630c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:48.958162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-454bc416-8fd9-4ad8-b2e0-46dff091630c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:48.987430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-454bc416-8fd9-4ad8-b2e0-46dff091630c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044914 Oct 28 20:18:48.987975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 932/1857] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:48 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:18:49.851558 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6123aed9-20a8-4649-a83f-58d10d4d58ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:49.852175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6123aed9-20a8-4649-a83f-58d10d4d58ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:49.859499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6123aed9-20a8-4649-a83f-58d10d4d58ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:49.859988 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6123aed9-20a8-4649-a83f-58d10d4d58ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:49.860436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6123aed9-20a8-4649-a83f-58d10d4d58ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:49.861127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6123aed9-20a8-4649-a83f-58d10d4d58ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:49.861617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6123aed9-20a8-4649-a83f-58d10d4d58ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:49.862048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6123aed9-20a8-4649-a83f-58d10d4d58ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:49.990652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6123aed9-20a8-4649-a83f-58d10d4d58ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:49.999887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6123aed9-20a8-4649-a83f-58d10d4d58ae tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152141 Oct 28 20:18:50.000453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 926/1858] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:49 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:50.001025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c17bcece-d5c3-4667-b379-c258045e5ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:50.003264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c17bcece-d5c3-4667-b379-c258045e5ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:50.009673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c17bcece-d5c3-4667-b379-c258045e5ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:50.010156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c17bcece-d5c3-4667-b379-c258045e5ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:50.010591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c17bcece-d5c3-4667-b379-c258045e5ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:50.011275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c17bcece-d5c3-4667-b379-c258045e5ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:50.011722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c17bcece-d5c3-4667-b379-c258045e5ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:50.012139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c17bcece-d5c3-4667-b379-c258045e5ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:50.042180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c17bcece-d5c3-4667-b379-c258045e5ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046189 Oct 28 20:18:50.042732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 933/1859] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:49 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:51.022810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9c12ea49-defa-4888-9ee3-8ce9b610cde5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:51.023421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9c12ea49-defa-4888-9ee3-8ce9b610cde5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:51.030605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c12ea49-defa-4888-9ee3-8ce9b610cde5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:51.031129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c12ea49-defa-4888-9ee3-8ce9b610cde5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:51.031573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c12ea49-defa-4888-9ee3-8ce9b610cde5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:51.032760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c12ea49-defa-4888-9ee3-8ce9b610cde5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:51.032760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c12ea49-defa-4888-9ee3-8ce9b610cde5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:51.033134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c12ea49-defa-4888-9ee3-8ce9b610cde5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:51.055062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-559ed169-ff7b-4e61-aca4-43e8da895d29 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:51.057196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-559ed169-ff7b-4e61-aca4-43e8da895d29 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:51.064239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-559ed169-ff7b-4e61-aca4-43e8da895d29 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:51.064716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-559ed169-ff7b-4e61-aca4-43e8da895d29 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:51.065149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-559ed169-ff7b-4e61-aca4-43e8da895d29 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:51.065973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-559ed169-ff7b-4e61-aca4-43e8da895d29 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:51.066427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-559ed169-ff7b-4e61-aca4-43e8da895d29 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:51.066845 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-559ed169-ff7b-4e61-aca4-43e8da895d29 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:51.097580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-559ed169-ff7b-4e61-aca4-43e8da895d29 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046346 Oct 28 20:18:51.098141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 934/1860] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:51 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:18:51.162702 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9c12ea49-defa-4888-9ee3-8ce9b610cde5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:51.172300 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9c12ea49-defa-4888-9ee3-8ce9b610cde5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153282 Oct 28 20:18:51.172866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 927/1861] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:51 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:52.109489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-afb2ae4e-923c-4e9a-93d4-1ae554303f2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:52.111648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-afb2ae4e-923c-4e9a-93d4-1ae554303f2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:52.118020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afb2ae4e-923c-4e9a-93d4-1ae554303f2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:52.118503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afb2ae4e-923c-4e9a-93d4-1ae554303f2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:52.118967 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afb2ae4e-923c-4e9a-93d4-1ae554303f2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:52.119649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afb2ae4e-923c-4e9a-93d4-1ae554303f2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:52.120100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afb2ae4e-923c-4e9a-93d4-1ae554303f2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:52.120526 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afb2ae4e-923c-4e9a-93d4-1ae554303f2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:52.145606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:18:52.150224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-afb2ae4e-923c-4e9a-93d4-1ae554303f2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044914 Oct 28 20:18:52.159176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 935/1862] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:52 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:52.195846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40ef181a-c7bc-47cd-892b-2a67ad347bcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:52.196454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-40ef181a-c7bc-47cd-892b-2a67ad347bcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:52.203727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40ef181a-c7bc-47cd-892b-2a67ad347bcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:52.204208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40ef181a-c7bc-47cd-892b-2a67ad347bcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:52.204718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40ef181a-c7bc-47cd-892b-2a67ad347bcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:52.205432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40ef181a-c7bc-47cd-892b-2a67ad347bcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:52.205884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40ef181a-c7bc-47cd-892b-2a67ad347bcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:52.206306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40ef181a-c7bc-47cd-892b-2a67ad347bcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:52.349519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-40ef181a-c7bc-47cd-892b-2a67ad347bcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:52.359142 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-40ef181a-c7bc-47cd-892b-2a67ad347bcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.167242 Oct 28 20:18:52.359717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 928/1863] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:52 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:53.170760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cb905a8f-5c43-404b-a0b4-36a01f105287 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:53.172883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cb905a8f-5c43-404b-a0b4-36a01f105287 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:53.179402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb905a8f-5c43-404b-a0b4-36a01f105287 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:53.179885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb905a8f-5c43-404b-a0b4-36a01f105287 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:53.180359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb905a8f-5c43-404b-a0b4-36a01f105287 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:53.181050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb905a8f-5c43-404b-a0b4-36a01f105287 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:53.181539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb905a8f-5c43-404b-a0b4-36a01f105287 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:53.181969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb905a8f-5c43-404b-a0b4-36a01f105287 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:53.213180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cb905a8f-5c43-404b-a0b4-36a01f105287 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047334 Oct 28 20:18:53.213779 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 936/1864] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:53 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:53.382522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e0710eac-4f8d-4c3f-b675-789511433c93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:53.383136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e0710eac-4f8d-4c3f-b675-789511433c93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:53.390453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0710eac-4f8d-4c3f-b675-789511433c93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:53.390949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0710eac-4f8d-4c3f-b675-789511433c93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:53.395991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0710eac-4f8d-4c3f-b675-789511433c93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:53.395991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0710eac-4f8d-4c3f-b675-789511433c93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:53.395991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0710eac-4f8d-4c3f-b675-789511433c93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:53.395991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0710eac-4f8d-4c3f-b675-789511433c93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:53.527555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e0710eac-4f8d-4c3f-b675-789511433c93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:53.535868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e0710eac-4f8d-4c3f-b675-789511433c93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.157282 Oct 28 20:18:53.536531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 929/1865] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:53 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:54.226095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b60ba6f-52a5-4e95-857a-abc7f1b00156 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:54.228242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0b60ba6f-52a5-4e95-857a-abc7f1b00156 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:54.235259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b60ba6f-52a5-4e95-857a-abc7f1b00156 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:54.235771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b60ba6f-52a5-4e95-857a-abc7f1b00156 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:54.236210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b60ba6f-52a5-4e95-857a-abc7f1b00156 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:54.236899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b60ba6f-52a5-4e95-857a-abc7f1b00156 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:54.237377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b60ba6f-52a5-4e95-857a-abc7f1b00156 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:54.237802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b60ba6f-52a5-4e95-857a-abc7f1b00156 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:54.267208 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0b60ba6f-52a5-4e95-857a-abc7f1b00156 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045079 Oct 28 20:18:54.267765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 937/1866] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:54 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:54.560977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d3213fcf-3f4f-4cbd-aa6c-7c5f498afbc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:54.561690 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d3213fcf-3f4f-4cbd-aa6c-7c5f498afbc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:54.567677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3213fcf-3f4f-4cbd-aa6c-7c5f498afbc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:54.568314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3213fcf-3f4f-4cbd-aa6c-7c5f498afbc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:54.568871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3213fcf-3f4f-4cbd-aa6c-7c5f498afbc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:54.569651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3213fcf-3f4f-4cbd-aa6c-7c5f498afbc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:54.570168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3213fcf-3f4f-4cbd-aa6c-7c5f498afbc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:54.570675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3213fcf-3f4f-4cbd-aa6c-7c5f498afbc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:54.703223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d3213fcf-3f4f-4cbd-aa6c-7c5f498afbc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:54.711713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d3213fcf-3f4f-4cbd-aa6c-7c5f498afbc5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155649 Oct 28 20:18:54.712271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 930/1867] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:54 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:55.280619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94a93931-dc16-4dd9-9147-6bc33b2ab0a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:55.283282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-94a93931-dc16-4dd9-9147-6bc33b2ab0a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:55.289127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94a93931-dc16-4dd9-9147-6bc33b2ab0a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:55.289644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94a93931-dc16-4dd9-9147-6bc33b2ab0a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:55.290087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94a93931-dc16-4dd9-9147-6bc33b2ab0a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:55.290778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94a93931-dc16-4dd9-9147-6bc33b2ab0a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:55.291236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94a93931-dc16-4dd9-9147-6bc33b2ab0a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:55.291658 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94a93931-dc16-4dd9-9147-6bc33b2ab0a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:55.322288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-94a93931-dc16-4dd9-9147-6bc33b2ab0a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046634 Oct 28 20:18:55.322913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 938/1868] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:55 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:55.734107 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f3936778-f4e4-4dc7-8a8a-531721d41cfc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:55.734722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f3936778-f4e4-4dc7-8a8a-531721d41cfc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:55.741084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3936778-f4e4-4dc7-8a8a-531721d41cfc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:55.741601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3936778-f4e4-4dc7-8a8a-531721d41cfc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:55.742038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3936778-f4e4-4dc7-8a8a-531721d41cfc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:55.742731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3936778-f4e4-4dc7-8a8a-531721d41cfc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:55.743186 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3936778-f4e4-4dc7-8a8a-531721d41cfc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:55.743606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3936778-f4e4-4dc7-8a8a-531721d41cfc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:55.871631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f3936778-f4e4-4dc7-8a8a-531721d41cfc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:55.879928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f3936778-f4e4-4dc7-8a8a-531721d41cfc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149748 Oct 28 20:18:55.880492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 931/1869] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:55 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:56.335185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e8f4511c-f48e-4d3d-8bb8-a0e1dfff6632 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:56.337684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e8f4511c-f48e-4d3d-8bb8-a0e1dfff6632 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:56.344102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8f4511c-f48e-4d3d-8bb8-a0e1dfff6632 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:56.344578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8f4511c-f48e-4d3d-8bb8-a0e1dfff6632 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:56.345006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8f4511c-f48e-4d3d-8bb8-a0e1dfff6632 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:56.345716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8f4511c-f48e-4d3d-8bb8-a0e1dfff6632 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:56.346165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8f4511c-f48e-4d3d-8bb8-a0e1dfff6632 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:56.346584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8f4511c-f48e-4d3d-8bb8-a0e1dfff6632 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:56.376598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e8f4511c-f48e-4d3d-8bb8-a0e1dfff6632 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045415 Oct 28 20:18:56.377139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 939/1870] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:56 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:56.904207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-acfa8043-420f-42bc-a64d-40063c34f880 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:56.904824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-acfa8043-420f-42bc-a64d-40063c34f880 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:56.911683 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acfa8043-420f-42bc-a64d-40063c34f880 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:56.912207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acfa8043-420f-42bc-a64d-40063c34f880 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:56.912668 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acfa8043-420f-42bc-a64d-40063c34f880 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:56.913406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acfa8043-420f-42bc-a64d-40063c34f880 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:56.913859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acfa8043-420f-42bc-a64d-40063c34f880 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:56.914281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acfa8043-420f-42bc-a64d-40063c34f880 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:57.055179 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-acfa8043-420f-42bc-a64d-40063c34f880 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:57.063463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-acfa8043-420f-42bc-a64d-40063c34f880 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.163946 Oct 28 20:18:57.066512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 932/1871] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:56 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:57.389695 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-99038939-5595-4ac0-b0a2-1c38fbf1eda7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:57.391941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-99038939-5595-4ac0-b0a2-1c38fbf1eda7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:57.398563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99038939-5595-4ac0-b0a2-1c38fbf1eda7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:57.398919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99038939-5595-4ac0-b0a2-1c38fbf1eda7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:57.399361 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99038939-5595-4ac0-b0a2-1c38fbf1eda7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:57.400054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99038939-5595-4ac0-b0a2-1c38fbf1eda7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:57.400509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99038939-5595-4ac0-b0a2-1c38fbf1eda7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:57.400936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99038939-5595-4ac0-b0a2-1c38fbf1eda7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:57.431190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-99038939-5595-4ac0-b0a2-1c38fbf1eda7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046288 Oct 28 20:18:57.431745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 940/1872] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:57 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:58.087016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1b0ffa45-0fc3-4a12-81eb-2fcd8265b4ea tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:58.087635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1b0ffa45-0fc3-4a12-81eb-2fcd8265b4ea tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:58.094277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b0ffa45-0fc3-4a12-81eb-2fcd8265b4ea tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:58.094765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b0ffa45-0fc3-4a12-81eb-2fcd8265b4ea tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:58.095210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b0ffa45-0fc3-4a12-81eb-2fcd8265b4ea tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:58.095907 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b0ffa45-0fc3-4a12-81eb-2fcd8265b4ea tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:58.096364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b0ffa45-0fc3-4a12-81eb-2fcd8265b4ea tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:58.096790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b0ffa45-0fc3-4a12-81eb-2fcd8265b4ea tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:58.224439 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1b0ffa45-0fc3-4a12-81eb-2fcd8265b4ea tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:58.232984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1b0ffa45-0fc3-4a12-81eb-2fcd8265b4ea tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150314 Oct 28 20:18:58.233582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 933/1873] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:58 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:58.443626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bbe79c41-cd09-461c-aa5a-0fcd80bd07dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:58.445882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bbe79c41-cd09-461c-aa5a-0fcd80bd07dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:58.452400 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbe79c41-cd09-461c-aa5a-0fcd80bd07dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:58.452882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbe79c41-cd09-461c-aa5a-0fcd80bd07dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:58.453346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbe79c41-cd09-461c-aa5a-0fcd80bd07dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:58.454038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbe79c41-cd09-461c-aa5a-0fcd80bd07dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:58.454497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbe79c41-cd09-461c-aa5a-0fcd80bd07dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:58.454923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbe79c41-cd09-461c-aa5a-0fcd80bd07dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:58.485474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bbe79c41-cd09-461c-aa5a-0fcd80bd07dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045698 Oct 28 20:18:58.485958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 941/1874] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:58 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:18:59.256360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-742e5c82-3681-4ad9-8eff-5ac44073401d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:59.256978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-742e5c82-3681-4ad9-8eff-5ac44073401d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:59.264278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-742e5c82-3681-4ad9-8eff-5ac44073401d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:59.264779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-742e5c82-3681-4ad9-8eff-5ac44073401d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:59.265226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-742e5c82-3681-4ad9-8eff-5ac44073401d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:59.265965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-742e5c82-3681-4ad9-8eff-5ac44073401d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:59.266427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-742e5c82-3681-4ad9-8eff-5ac44073401d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:59.266851 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-742e5c82-3681-4ad9-8eff-5ac44073401d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:59.394166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-742e5c82-3681-4ad9-8eff-5ac44073401d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:59.402337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-742e5c82-3681-4ad9-8eff-5ac44073401d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149809 Oct 28 20:18:59.402896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 934/1875] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:59 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:59.498414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3a962ae7-4fdb-4a79-adc2-75cf84d2172e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:59.500638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3a962ae7-4fdb-4a79-adc2-75cf84d2172e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:59.506956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a962ae7-4fdb-4a79-adc2-75cf84d2172e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:59.507578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a962ae7-4fdb-4a79-adc2-75cf84d2172e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:59.507876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a962ae7-4fdb-4a79-adc2-75cf84d2172e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:59.508568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a962ae7-4fdb-4a79-adc2-75cf84d2172e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:59.509025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a962ae7-4fdb-4a79-adc2-75cf84d2172e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:59.509508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a962ae7-4fdb-4a79-adc2-75cf84d2172e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:59.538189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3a962ae7-4fdb-4a79-adc2-75cf84d2172e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044498 Oct 28 20:18:59.538728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 942/1876] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:18:59 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:00.425245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81da74b1-aa15-48ed-be26-f621ac849476 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:00.425895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-81da74b1-aa15-48ed-be26-f621ac849476 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:00.432328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81da74b1-aa15-48ed-be26-f621ac849476 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:00.432819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81da74b1-aa15-48ed-be26-f621ac849476 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:00.433263 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81da74b1-aa15-48ed-be26-f621ac849476 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:00.433980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81da74b1-aa15-48ed-be26-f621ac849476 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:00.434438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81da74b1-aa15-48ed-be26-f621ac849476 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:00.434974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81da74b1-aa15-48ed-be26-f621ac849476 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:00.551218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6655bbe8-504e-4a52-ac27-d392aa9f1b38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:00.553512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6655bbe8-504e-4a52-ac27-d392aa9f1b38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:00.560647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6655bbe8-504e-4a52-ac27-d392aa9f1b38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:00.561256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6655bbe8-504e-4a52-ac27-d392aa9f1b38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:00.561720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6655bbe8-504e-4a52-ac27-d392aa9f1b38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:00.562415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6655bbe8-504e-4a52-ac27-d392aa9f1b38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:00.562865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6655bbe8-504e-4a52-ac27-d392aa9f1b38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:00.563284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6655bbe8-504e-4a52-ac27-d392aa9f1b38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:00.568092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-81da74b1-aa15-48ed-be26-f621ac849476 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:00.577212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-81da74b1-aa15-48ed-be26-f621ac849476 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155762 Oct 28 20:19:00.577828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 935/1877] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:00 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:00.594187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6655bbe8-504e-4a52-ac27-d392aa9f1b38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046981 Oct 28 20:19:00.594735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 943/1878] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:00 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:19:01.600003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f52ca9c-03c0-4f38-9c35-ef7e10bbe70f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:01.600555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f52ca9c-03c0-4f38-9c35-ef7e10bbe70f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:01.606247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ea85ef30-9a0f-42a1-824e-86a050592dcb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:01.607045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f52ca9c-03c0-4f38-9c35-ef7e10bbe70f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:01.607533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f52ca9c-03c0-4f38-9c35-ef7e10bbe70f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:01.608029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f52ca9c-03c0-4f38-9c35-ef7e10bbe70f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:01.608393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ea85ef30-9a0f-42a1-824e-86a050592dcb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:01.608722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f52ca9c-03c0-4f38-9c35-ef7e10bbe70f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:01.609174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f52ca9c-03c0-4f38-9c35-ef7e10bbe70f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:01.609646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f52ca9c-03c0-4f38-9c35-ef7e10bbe70f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:01.619353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea85ef30-9a0f-42a1-824e-86a050592dcb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:01.620221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea85ef30-9a0f-42a1-824e-86a050592dcb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:01.621000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea85ef30-9a0f-42a1-824e-86a050592dcb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:01.622254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea85ef30-9a0f-42a1-824e-86a050592dcb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:01.623071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea85ef30-9a0f-42a1-824e-86a050592dcb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:01.623833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea85ef30-9a0f-42a1-824e-86a050592dcb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:01.661764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ea85ef30-9a0f-42a1-824e-86a050592dcb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059317 Oct 28 20:19:01.662348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 944/1879] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:01 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:01.743238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4f52ca9c-03c0-4f38-9c35-ef7e10bbe70f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:01.751615 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f52ca9c-03c0-4f38-9c35-ef7e10bbe70f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155518 Oct 28 20:19:01.752180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 936/1880] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:01 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:02.675068 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c6b0d41f-6724-4ac8-ac7c-febfa3c884de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:02.677181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c6b0d41f-6724-4ac8-ac7c-febfa3c884de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:02.679578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=58 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:19:02.684196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6b0d41f-6724-4ac8-ac7c-febfa3c884de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:02.685298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6b0d41f-6724-4ac8-ac7c-febfa3c884de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:02.685855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6b0d41f-6724-4ac8-ac7c-febfa3c884de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:02.686555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6b0d41f-6724-4ac8-ac7c-febfa3c884de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:02.687013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6b0d41f-6724-4ac8-ac7c-febfa3c884de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:02.687438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6b0d41f-6724-4ac8-ac7c-febfa3c884de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:02.717622 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c6b0d41f-6724-4ac8-ac7c-febfa3c884de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046641 Oct 28 20:19:02.718183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 945/1881] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:02 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:02.774500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6e15b9d2-6ebf-4650-a295-494677702b51 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:02.775117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6e15b9d2-6ebf-4650-a295-494677702b51 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:02.782013 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e15b9d2-6ebf-4650-a295-494677702b51 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:02.782498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e15b9d2-6ebf-4650-a295-494677702b51 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:02.782937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e15b9d2-6ebf-4650-a295-494677702b51 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:02.783726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e15b9d2-6ebf-4650-a295-494677702b51 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:02.784189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e15b9d2-6ebf-4650-a295-494677702b51 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:02.784617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e15b9d2-6ebf-4650-a295-494677702b51 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:02.914038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6e15b9d2-6ebf-4650-a295-494677702b51 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:02.922125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6e15b9d2-6ebf-4650-a295-494677702b51 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151525 Oct 28 20:19:02.922684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 937/1882] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:02 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:19:03.730071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-12346e0d-395c-48d2-ba9c-8efb1e41f7d7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:03.732340 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-12346e0d-395c-48d2-ba9c-8efb1e41f7d7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:03.738678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12346e0d-395c-48d2-ba9c-8efb1e41f7d7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:03.739157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12346e0d-395c-48d2-ba9c-8efb1e41f7d7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:03.739593 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12346e0d-395c-48d2-ba9c-8efb1e41f7d7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:03.740289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12346e0d-395c-48d2-ba9c-8efb1e41f7d7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:03.740744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12346e0d-395c-48d2-ba9c-8efb1e41f7d7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:03.741169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12346e0d-395c-48d2-ba9c-8efb1e41f7d7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:03.771116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-12346e0d-395c-48d2-ba9c-8efb1e41f7d7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045386 Oct 28 20:19:03.771662 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 946/1883] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:03 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:19:03.945605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e97adf7b-45c9-45df-9ea7-02d11072eaa1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:03.946219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e97adf7b-45c9-45df-9ea7-02d11072eaa1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:03.948583 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=52 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:19:03.953278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e97adf7b-45c9-45df-9ea7-02d11072eaa1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:03.953794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e97adf7b-45c9-45df-9ea7-02d11072eaa1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:03.954236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e97adf7b-45c9-45df-9ea7-02d11072eaa1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:03.954923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e97adf7b-45c9-45df-9ea7-02d11072eaa1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:03.955379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e97adf7b-45c9-45df-9ea7-02d11072eaa1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:03.955805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e97adf7b-45c9-45df-9ea7-02d11072eaa1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:04.085159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e97adf7b-45c9-45df-9ea7-02d11072eaa1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:04.094085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e97adf7b-45c9-45df-9ea7-02d11072eaa1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152214 Oct 28 20:19:04.094871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 938/1884] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:03 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:04.783622 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1f681522-7c64-48b4-ac75-a442ff6548d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:04.785827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1f681522-7c64-48b4-ac75-a442ff6548d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:04.792178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f681522-7c64-48b4-ac75-a442ff6548d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:04.792654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f681522-7c64-48b4-ac75-a442ff6548d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:04.793085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f681522-7c64-48b4-ac75-a442ff6548d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:04.794357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f681522-7c64-48b4-ac75-a442ff6548d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:04.794876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f681522-7c64-48b4-ac75-a442ff6548d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:04.795318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f681522-7c64-48b4-ac75-a442ff6548d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:04.824985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1f681522-7c64-48b4-ac75-a442ff6548d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045350 Oct 28 20:19:04.825838 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 947/1885] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:04 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:19:05.117763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3669f768-a96b-4022-abc8-605759905861 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:05.118375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3669f768-a96b-4022-abc8-605759905861 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:05.124822 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3669f768-a96b-4022-abc8-605759905861 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:05.125305 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3669f768-a96b-4022-abc8-605759905861 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:05.125769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3669f768-a96b-4022-abc8-605759905861 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:05.126452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3669f768-a96b-4022-abc8-605759905861 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:05.126910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3669f768-a96b-4022-abc8-605759905861 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:05.127333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3669f768-a96b-4022-abc8-605759905861 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:05.272931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3669f768-a96b-4022-abc8-605759905861 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:05.282250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3669f768-a96b-4022-abc8-605759905861 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.168180 Oct 28 20:19:05.283032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 939/1886] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:05 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:05.838284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-115a9273-b8e8-4a8a-a580-2f69ba9de7c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:05.840506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-115a9273-b8e8-4a8a-a580-2f69ba9de7c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:05.847015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-115a9273-b8e8-4a8a-a580-2f69ba9de7c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:05.847492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-115a9273-b8e8-4a8a-a580-2f69ba9de7c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:05.847926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-115a9273-b8e8-4a8a-a580-2f69ba9de7c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:05.848614 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-115a9273-b8e8-4a8a-a580-2f69ba9de7c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:05.849062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-115a9273-b8e8-4a8a-a580-2f69ba9de7c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:05.849569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-115a9273-b8e8-4a8a-a580-2f69ba9de7c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:05.879178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-115a9273-b8e8-4a8a-a580-2f69ba9de7c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045122 Oct 28 20:19:05.879743 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 948/1887] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:05 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:06.305208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a8ae94c-23d3-453a-919c-0a14e46f9aca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:06.305872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9a8ae94c-23d3-453a-919c-0a14e46f9aca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:06.312956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8ae94c-23d3-453a-919c-0a14e46f9aca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:06.313470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8ae94c-23d3-453a-919c-0a14e46f9aca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:06.313907 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8ae94c-23d3-453a-919c-0a14e46f9aca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:06.314992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8ae94c-23d3-453a-919c-0a14e46f9aca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:06.315461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8ae94c-23d3-453a-919c-0a14e46f9aca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:06.315915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8ae94c-23d3-453a-919c-0a14e46f9aca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:06.452201 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9a8ae94c-23d3-453a-919c-0a14e46f9aca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:06.455653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:19:06.460535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9a8ae94c-23d3-453a-919c-0a14e46f9aca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.159203 Oct 28 20:19:06.461392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 940/1888] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:06 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:06.892196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-93ac2dbd-5cf3-485b-8b0c-88d9764c6ec9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:06.894424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-93ac2dbd-5cf3-485b-8b0c-88d9764c6ec9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:06.901031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ac2dbd-5cf3-485b-8b0c-88d9764c6ec9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:06.901549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ac2dbd-5cf3-485b-8b0c-88d9764c6ec9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:06.901989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ac2dbd-5cf3-485b-8b0c-88d9764c6ec9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:06.902686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ac2dbd-5cf3-485b-8b0c-88d9764c6ec9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:06.903146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ac2dbd-5cf3-485b-8b0c-88d9764c6ec9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:06.904665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ac2dbd-5cf3-485b-8b0c-88d9764c6ec9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:06.933409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-93ac2dbd-5cf3-485b-8b0c-88d9764c6ec9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045770 Oct 28 20:19:06.933958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 949/1889] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:06 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:07.488157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e5cc326d-f947-40c4-bc0d-3e0ba1d06be8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:07.488786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e5cc326d-f947-40c4-bc0d-3e0ba1d06be8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:07.495656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5cc326d-f947-40c4-bc0d-3e0ba1d06be8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:07.496149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5cc326d-f947-40c4-bc0d-3e0ba1d06be8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:07.496594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5cc326d-f947-40c4-bc0d-3e0ba1d06be8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:07.498420 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5cc326d-f947-40c4-bc0d-3e0ba1d06be8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:07.498884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5cc326d-f947-40c4-bc0d-3e0ba1d06be8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:07.499320 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5cc326d-f947-40c4-bc0d-3e0ba1d06be8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:07.626515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e5cc326d-f947-40c4-bc0d-3e0ba1d06be8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:07.634615 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e5cc326d-f947-40c4-bc0d-3e0ba1d06be8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150439 Oct 28 20:19:07.635183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 941/1890] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:07 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:07.945441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d8982420-5f50-4aa8-9f23-0e117ef5d14e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:07.947594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d8982420-5f50-4aa8-9f23-0e117ef5d14e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:07.954528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8982420-5f50-4aa8-9f23-0e117ef5d14e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:07.955003 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8982420-5f50-4aa8-9f23-0e117ef5d14e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:07.955443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8982420-5f50-4aa8-9f23-0e117ef5d14e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:07.956124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8982420-5f50-4aa8-9f23-0e117ef5d14e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:07.956580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8982420-5f50-4aa8-9f23-0e117ef5d14e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:07.957003 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8982420-5f50-4aa8-9f23-0e117ef5d14e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:07.986415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d8982420-5f50-4aa8-9f23-0e117ef5d14e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044964 Oct 28 20:19:07.986956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 950/1891] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:07 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:08.658453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-089e36d3-3b56-4e2d-94be-2904453e2881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:08.658996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-089e36d3-3b56-4e2d-94be-2904453e2881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:08.665433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-089e36d3-3b56-4e2d-94be-2904453e2881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:08.665910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-089e36d3-3b56-4e2d-94be-2904453e2881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:08.666358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-089e36d3-3b56-4e2d-94be-2904453e2881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:08.667027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-089e36d3-3b56-4e2d-94be-2904453e2881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:08.667477 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-089e36d3-3b56-4e2d-94be-2904453e2881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:08.667897 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-089e36d3-3b56-4e2d-94be-2904453e2881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:08.801772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-089e36d3-3b56-4e2d-94be-2904453e2881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:08.810417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-089e36d3-3b56-4e2d-94be-2904453e2881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155953 Oct 28 20:19:08.810978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 942/1892] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:08 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:08.998933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eb89880d-dd63-41ed-9f3a-e12f07279964 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:09.001220 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eb89880d-dd63-41ed-9f3a-e12f07279964 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:09.007544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb89880d-dd63-41ed-9f3a-e12f07279964 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:09.008028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb89880d-dd63-41ed-9f3a-e12f07279964 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:09.008470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb89880d-dd63-41ed-9f3a-e12f07279964 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:09.009164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb89880d-dd63-41ed-9f3a-e12f07279964 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:09.009653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb89880d-dd63-41ed-9f3a-e12f07279964 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:09.010087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb89880d-dd63-41ed-9f3a-e12f07279964 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:09.040621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eb89880d-dd63-41ed-9f3a-e12f07279964 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046322 Oct 28 20:19:09.041185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 951/1893] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:08 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:09.833889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2d8b0b87-1ccf-486a-9455-d17e6eedf12f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:09.834429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2d8b0b87-1ccf-486a-9455-d17e6eedf12f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:09.842070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d8b0b87-1ccf-486a-9455-d17e6eedf12f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:09.842556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d8b0b87-1ccf-486a-9455-d17e6eedf12f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:09.843001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d8b0b87-1ccf-486a-9455-d17e6eedf12f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:09.843699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d8b0b87-1ccf-486a-9455-d17e6eedf12f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:09.844180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d8b0b87-1ccf-486a-9455-d17e6eedf12f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:09.844609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d8b0b87-1ccf-486a-9455-d17e6eedf12f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:09.973788 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2d8b0b87-1ccf-486a-9455-d17e6eedf12f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:09.982001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2d8b0b87-1ccf-486a-9455-d17e6eedf12f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152030 Oct 28 20:19:09.982575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 943/1894] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:09 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:10.053528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3fda2b81-b8de-4e33-ac9e-5b3b5208b703 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:10.055699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3fda2b81-b8de-4e33-ac9e-5b3b5208b703 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:10.062271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fda2b81-b8de-4e33-ac9e-5b3b5208b703 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:10.062752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fda2b81-b8de-4e33-ac9e-5b3b5208b703 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:10.063185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fda2b81-b8de-4e33-ac9e-5b3b5208b703 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:10.063873 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fda2b81-b8de-4e33-ac9e-5b3b5208b703 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:10.064326 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fda2b81-b8de-4e33-ac9e-5b3b5208b703 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:10.065035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fda2b81-b8de-4e33-ac9e-5b3b5208b703 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:10.079559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:19:10.095865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3fda2b81-b8de-4e33-ac9e-5b3b5208b703 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046364 Oct 28 20:19:10.096357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 952/1895] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:10 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:11.004748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7387aa9e-c08e-4c48-93a9-421e262224bf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:11.005385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7387aa9e-c08e-4c48-93a9-421e262224bf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:11.012024 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7387aa9e-c08e-4c48-93a9-421e262224bf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:11.012594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7387aa9e-c08e-4c48-93a9-421e262224bf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:11.013139 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7387aa9e-c08e-4c48-93a9-421e262224bf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:11.013802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7387aa9e-c08e-4c48-93a9-421e262224bf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:11.014262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7387aa9e-c08e-4c48-93a9-421e262224bf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:11.014691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7387aa9e-c08e-4c48-93a9-421e262224bf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:11.108696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c06387f9-0002-4952-9a85-49443df93603 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:11.110904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c06387f9-0002-4952-9a85-49443df93603 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:11.118071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c06387f9-0002-4952-9a85-49443df93603 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:11.118545 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c06387f9-0002-4952-9a85-49443df93603 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:11.118975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c06387f9-0002-4952-9a85-49443df93603 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:11.119662 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c06387f9-0002-4952-9a85-49443df93603 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:11.120107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c06387f9-0002-4952-9a85-49443df93603 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:11.120531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c06387f9-0002-4952-9a85-49443df93603 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:11.149162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7387aa9e-c08e-4c48-93a9-421e262224bf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:11.150324 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c06387f9-0002-4952-9a85-49443df93603 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046218 Oct 28 20:19:11.150891 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 953/1896] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:11 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:19:11.158249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7387aa9e-c08e-4c48-93a9-421e262224bf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.157313 Oct 28 20:19:11.158814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 944/1897] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:10 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:12.163538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f405c509-0463-4ca2-bd93-f0f0bcf9017a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:12.165770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f405c509-0463-4ca2-bd93-f0f0bcf9017a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:12.172824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f405c509-0463-4ca2-bd93-f0f0bcf9017a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:12.173300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f405c509-0463-4ca2-bd93-f0f0bcf9017a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:12.173774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f405c509-0463-4ca2-bd93-f0f0bcf9017a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:12.174466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f405c509-0463-4ca2-bd93-f0f0bcf9017a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:12.174917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f405c509-0463-4ca2-bd93-f0f0bcf9017a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:12.175344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f405c509-0463-4ca2-bd93-f0f0bcf9017a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:12.181780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5d66f1fa-4fdb-4158-90cb-4119fce29d0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:12.183032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5d66f1fa-4fdb-4158-90cb-4119fce29d0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:12.192930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d66f1fa-4fdb-4158-90cb-4119fce29d0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:12.193830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d66f1fa-4fdb-4158-90cb-4119fce29d0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:12.194587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d66f1fa-4fdb-4158-90cb-4119fce29d0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:12.195769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d66f1fa-4fdb-4158-90cb-4119fce29d0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:12.196438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d66f1fa-4fdb-4158-90cb-4119fce29d0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:12.196874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d66f1fa-4fdb-4158-90cb-4119fce29d0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:12.206973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f405c509-0463-4ca2-bd93-f0f0bcf9017a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047548 Oct 28 20:19:12.207548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 954/1898] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:12 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:12.325243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5d66f1fa-4fdb-4158-90cb-4119fce29d0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:12.333401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5d66f1fa-4fdb-4158-90cb-4119fce29d0d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155378 Oct 28 20:19:12.333960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 945/1899] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:12 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:19:13.219680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9e94a40-e524-47f3-bfc6-c1789b46ef94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:13.222530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f9e94a40-e524-47f3-bfc6-c1789b46ef94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:13.228957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e94a40-e524-47f3-bfc6-c1789b46ef94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:13.229467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e94a40-e524-47f3-bfc6-c1789b46ef94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:13.229909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e94a40-e524-47f3-bfc6-c1789b46ef94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:13.230605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e94a40-e524-47f3-bfc6-c1789b46ef94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:13.231079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e94a40-e524-47f3-bfc6-c1789b46ef94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:13.231656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e94a40-e524-47f3-bfc6-c1789b46ef94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:13.260852 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f9e94a40-e524-47f3-bfc6-c1789b46ef94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045194 Oct 28 20:19:13.261436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 955/1900] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:13 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:13.357273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b58c189c-150a-4817-b3de-a3d22ee0aad8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:13.357916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b58c189c-150a-4817-b3de-a3d22ee0aad8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:13.364866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b58c189c-150a-4817-b3de-a3d22ee0aad8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:13.370766 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b58c189c-150a-4817-b3de-a3d22ee0aad8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:13.370766 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b58c189c-150a-4817-b3de-a3d22ee0aad8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:13.370766 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b58c189c-150a-4817-b3de-a3d22ee0aad8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:13.370766 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b58c189c-150a-4817-b3de-a3d22ee0aad8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:13.371211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b58c189c-150a-4817-b3de-a3d22ee0aad8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:13.499748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b58c189c-150a-4817-b3de-a3d22ee0aad8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:13.508066 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b58c189c-150a-4817-b3de-a3d22ee0aad8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155186 Oct 28 20:19:13.508627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 946/1901] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:13 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:14.274312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6f7ca578-21e2-4e2e-a3d9-b8b66b776b82 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:14.276458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6f7ca578-21e2-4e2e-a3d9-b8b66b776b82 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:14.283562 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f7ca578-21e2-4e2e-a3d9-b8b66b776b82 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:14.283985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f7ca578-21e2-4e2e-a3d9-b8b66b776b82 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:14.284423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f7ca578-21e2-4e2e-a3d9-b8b66b776b82 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:14.285109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f7ca578-21e2-4e2e-a3d9-b8b66b776b82 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:14.285587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f7ca578-21e2-4e2e-a3d9-b8b66b776b82 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:14.286013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f7ca578-21e2-4e2e-a3d9-b8b66b776b82 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:14.315355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6f7ca578-21e2-4e2e-a3d9-b8b66b776b82 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044982 Oct 28 20:19:14.315899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 956/1902] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:14 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:14.531908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b2abd85f-0383-48d8-9a77-e4eed63b7eb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:14.532516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b2abd85f-0383-48d8-9a77-e4eed63b7eb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:14.539187 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2abd85f-0383-48d8-9a77-e4eed63b7eb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:14.539616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2abd85f-0383-48d8-9a77-e4eed63b7eb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:14.540053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2abd85f-0383-48d8-9a77-e4eed63b7eb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:14.540780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2abd85f-0383-48d8-9a77-e4eed63b7eb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:14.541228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2abd85f-0383-48d8-9a77-e4eed63b7eb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:14.541713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2abd85f-0383-48d8-9a77-e4eed63b7eb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:14.671484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b2abd85f-0383-48d8-9a77-e4eed63b7eb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:14.679668 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b2abd85f-0383-48d8-9a77-e4eed63b7eb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152300 Oct 28 20:19:14.680233 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 947/1903] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:14 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:15.328162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e4de6dfa-c15b-4304-ac82-750785ac256c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:15.330385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e4de6dfa-c15b-4304-ac82-750785ac256c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:15.336931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4de6dfa-c15b-4304-ac82-750785ac256c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:15.337434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4de6dfa-c15b-4304-ac82-750785ac256c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:15.337861 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4de6dfa-c15b-4304-ac82-750785ac256c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:15.338538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4de6dfa-c15b-4304-ac82-750785ac256c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:15.338982 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4de6dfa-c15b-4304-ac82-750785ac256c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:15.339396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4de6dfa-c15b-4304-ac82-750785ac256c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:15.369415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e4de6dfa-c15b-4304-ac82-750785ac256c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045803 Oct 28 20:19:15.369968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 957/1904] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:15 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:15.704110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-95c20389-d3e1-4f6e-b6f8-8a02014343b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:15.704808 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-95c20389-d3e1-4f6e-b6f8-8a02014343b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:15.711435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95c20389-d3e1-4f6e-b6f8-8a02014343b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:15.711927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95c20389-d3e1-4f6e-b6f8-8a02014343b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:15.712368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95c20389-d3e1-4f6e-b6f8-8a02014343b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:15.713061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95c20389-d3e1-4f6e-b6f8-8a02014343b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:15.713557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95c20389-d3e1-4f6e-b6f8-8a02014343b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:15.714008 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95c20389-d3e1-4f6e-b6f8-8a02014343b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:15.842610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-95c20389-d3e1-4f6e-b6f8-8a02014343b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:15.850700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-95c20389-d3e1-4f6e-b6f8-8a02014343b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151188 Oct 28 20:19:15.851266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 948/1905] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:15 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:16.382234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bb41a948-ac66-411b-a7a1-48f3514ac7fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:16.384297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bb41a948-ac66-411b-a7a1-48f3514ac7fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:16.390352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb41a948-ac66-411b-a7a1-48f3514ac7fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:16.390826 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb41a948-ac66-411b-a7a1-48f3514ac7fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:16.391257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb41a948-ac66-411b-a7a1-48f3514ac7fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:16.391939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb41a948-ac66-411b-a7a1-48f3514ac7fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:16.392392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb41a948-ac66-411b-a7a1-48f3514ac7fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:16.392814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb41a948-ac66-411b-a7a1-48f3514ac7fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:16.422731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bb41a948-ac66-411b-a7a1-48f3514ac7fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044723 Oct 28 20:19:16.423281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 958/1906] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:16 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:16.874759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4d7fd238-66b6-47de-8dd8-024e575724d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:16.875374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4d7fd238-66b6-47de-8dd8-024e575724d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:16.882377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d7fd238-66b6-47de-8dd8-024e575724d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:16.882858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d7fd238-66b6-47de-8dd8-024e575724d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:16.883294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d7fd238-66b6-47de-8dd8-024e575724d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:16.883979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d7fd238-66b6-47de-8dd8-024e575724d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:16.884433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d7fd238-66b6-47de-8dd8-024e575724d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:16.884860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d7fd238-66b6-47de-8dd8-024e575724d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:17.016593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4d7fd238-66b6-47de-8dd8-024e575724d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:17.024794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4d7fd238-66b6-47de-8dd8-024e575724d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153951 Oct 28 20:19:17.027112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 949/1907] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:16 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:17.435670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c99cd989-b4a3-49d0-959f-33f37fd68fc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:17.437802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c99cd989-b4a3-49d0-959f-33f37fd68fc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:17.444167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c99cd989-b4a3-49d0-959f-33f37fd68fc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:17.444647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c99cd989-b4a3-49d0-959f-33f37fd68fc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:17.445086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c99cd989-b4a3-49d0-959f-33f37fd68fc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:17.445801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c99cd989-b4a3-49d0-959f-33f37fd68fc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:17.446260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c99cd989-b4a3-49d0-959f-33f37fd68fc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:17.446686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c99cd989-b4a3-49d0-959f-33f37fd68fc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:17.478226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c99cd989-b4a3-49d0-959f-33f37fd68fc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046689 Oct 28 20:19:17.478773 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 959/1908] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:17 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:18.050656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5b91fac1-34c2-48f5-9bce-741173b0056d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:18.051304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5b91fac1-34c2-48f5-9bce-741173b0056d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:18.058316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b91fac1-34c2-48f5-9bce-741173b0056d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:18.058810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b91fac1-34c2-48f5-9bce-741173b0056d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:18.059254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b91fac1-34c2-48f5-9bce-741173b0056d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:18.060517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b91fac1-34c2-48f5-9bce-741173b0056d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:18.060983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b91fac1-34c2-48f5-9bce-741173b0056d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:18.061439 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b91fac1-34c2-48f5-9bce-741173b0056d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:18.198226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5b91fac1-34c2-48f5-9bce-741173b0056d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:18.207258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5b91fac1-34c2-48f5-9bce-741173b0056d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.160593 Oct 28 20:19:18.207829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 950/1909] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:18 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:18.490842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1c0d355e-8d42-4e82-bb89-bd60519f74dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:18.493041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1c0d355e-8d42-4e82-bb89-bd60519f74dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:18.499539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c0d355e-8d42-4e82-bb89-bd60519f74dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:18.500010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c0d355e-8d42-4e82-bb89-bd60519f74dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:18.500442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c0d355e-8d42-4e82-bb89-bd60519f74dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:18.501120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c0d355e-8d42-4e82-bb89-bd60519f74dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:18.501609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c0d355e-8d42-4e82-bb89-bd60519f74dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:18.502028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c0d355e-8d42-4e82-bb89-bd60519f74dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:18.530986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1c0d355e-8d42-4e82-bb89-bd60519f74dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044078 Oct 28 20:19:18.531524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 960/1910] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:18 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:19.230012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e41e5b94-8aeb-4420-8f9e-aa4d72990fed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:19.230695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e41e5b94-8aeb-4420-8f9e-aa4d72990fed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:19.237471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e41e5b94-8aeb-4420-8f9e-aa4d72990fed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:19.238220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e41e5b94-8aeb-4420-8f9e-aa4d72990fed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:19.238657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e41e5b94-8aeb-4420-8f9e-aa4d72990fed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:19.239357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e41e5b94-8aeb-4420-8f9e-aa4d72990fed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:19.239810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e41e5b94-8aeb-4420-8f9e-aa4d72990fed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:19.240233 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e41e5b94-8aeb-4420-8f9e-aa4d72990fed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:19.387879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e41e5b94-8aeb-4420-8f9e-aa4d72990fed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:19.397041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e41e5b94-8aeb-4420-8f9e-aa4d72990fed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.170968 Oct 28 20:19:19.397828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 951/1911] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:19 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:19.542786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2ad98cea-1a4f-4008-9866-9ceb5b92b196 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:19.545744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2ad98cea-1a4f-4008-9866-9ceb5b92b196 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:19.552025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ad98cea-1a4f-4008-9866-9ceb5b92b196 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:19.552522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ad98cea-1a4f-4008-9866-9ceb5b92b196 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:19.552942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ad98cea-1a4f-4008-9866-9ceb5b92b196 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:19.553659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ad98cea-1a4f-4008-9866-9ceb5b92b196 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:19.554112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ad98cea-1a4f-4008-9866-9ceb5b92b196 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:19.554535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ad98cea-1a4f-4008-9866-9ceb5b92b196 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:19.583248 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2ad98cea-1a4f-4008-9866-9ceb5b92b196 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Oct 28 20:19:19.583788 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 961/1912] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:19 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:20.421656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5897a8a4-9c10-4c09-9e93-ead348cc20b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:20.422406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5897a8a4-9c10-4c09-9e93-ead348cc20b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:20.429582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5897a8a4-9c10-4c09-9e93-ead348cc20b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:20.429582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5897a8a4-9c10-4c09-9e93-ead348cc20b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:20.429835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5897a8a4-9c10-4c09-9e93-ead348cc20b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:20.430530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5897a8a4-9c10-4c09-9e93-ead348cc20b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:20.430989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5897a8a4-9c10-4c09-9e93-ead348cc20b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:20.431424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5897a8a4-9c10-4c09-9e93-ead348cc20b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:20.562372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5897a8a4-9c10-4c09-9e93-ead348cc20b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:20.570430 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5897a8a4-9c10-4c09-9e93-ead348cc20b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153349 Oct 28 20:19:20.571001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 952/1913] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:20 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:20.596281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ef5508c5-e047-48bb-88ac-de705e6f54dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:20.598483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ef5508c5-e047-48bb-88ac-de705e6f54dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:20.604773 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef5508c5-e047-48bb-88ac-de705e6f54dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:20.605254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef5508c5-e047-48bb-88ac-de705e6f54dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:20.605728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef5508c5-e047-48bb-88ac-de705e6f54dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:20.606417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef5508c5-e047-48bb-88ac-de705e6f54dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:20.607581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef5508c5-e047-48bb-88ac-de705e6f54dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:20.608011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef5508c5-e047-48bb-88ac-de705e6f54dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:20.637189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ef5508c5-e047-48bb-88ac-de705e6f54dd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044880 Oct 28 20:19:20.637823 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 962/1914] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:20 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:19:21.593671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-978fc8f7-85b1-47f2-ab73-c7f9ade40f4d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:21.594231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-978fc8f7-85b1-47f2-ab73-c7f9ade40f4d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:21.600630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-978fc8f7-85b1-47f2-ab73-c7f9ade40f4d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:21.601115 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-978fc8f7-85b1-47f2-ab73-c7f9ade40f4d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:21.601592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-978fc8f7-85b1-47f2-ab73-c7f9ade40f4d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:21.602282 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-978fc8f7-85b1-47f2-ab73-c7f9ade40f4d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:21.602740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-978fc8f7-85b1-47f2-ab73-c7f9ade40f4d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:21.603170 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-978fc8f7-85b1-47f2-ab73-c7f9ade40f4d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:21.649869 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3208f298-b5ee-4c23-886d-3485efaa6dff tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:21.652017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3208f298-b5ee-4c23-886d-3485efaa6dff tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:21.658595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3208f298-b5ee-4c23-886d-3485efaa6dff tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:21.659073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3208f298-b5ee-4c23-886d-3485efaa6dff tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:21.659506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3208f298-b5ee-4c23-886d-3485efaa6dff tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:21.660194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3208f298-b5ee-4c23-886d-3485efaa6dff tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:21.660645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3208f298-b5ee-4c23-886d-3485efaa6dff tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:21.661069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3208f298-b5ee-4c23-886d-3485efaa6dff tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:21.692061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3208f298-b5ee-4c23-886d-3485efaa6dff tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046242 Oct 28 20:19:21.692632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 963/1915] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:21 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:21.731798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-978fc8f7-85b1-47f2-ab73-c7f9ade40f4d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:21.740048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-978fc8f7-85b1-47f2-ab73-c7f9ade40f4d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150660 Oct 28 20:19:21.740607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 953/1916] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:21 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:22.705139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c18136f0-2230-4394-ba6b-886310e254ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:22.707354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c18136f0-2230-4394-ba6b-886310e254ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:22.713978 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c18136f0-2230-4394-ba6b-886310e254ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:22.714451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c18136f0-2230-4394-ba6b-886310e254ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:22.714883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c18136f0-2230-4394-ba6b-886310e254ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:22.715566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c18136f0-2230-4394-ba6b-886310e254ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:22.716738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c18136f0-2230-4394-ba6b-886310e254ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:22.717162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c18136f0-2230-4394-ba6b-886310e254ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:22.746484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c18136f0-2230-4394-ba6b-886310e254ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045987 Oct 28 20:19:22.747042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 964/1917] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:22 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:22.764958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-798f8102-1dd1-43c4-8528-9cc33d280b47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:22.765593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-798f8102-1dd1-43c4-8528-9cc33d280b47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:22.772098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-798f8102-1dd1-43c4-8528-9cc33d280b47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:22.772575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-798f8102-1dd1-43c4-8528-9cc33d280b47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:22.773005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-798f8102-1dd1-43c4-8528-9cc33d280b47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:22.773721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-798f8102-1dd1-43c4-8528-9cc33d280b47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:22.774167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-798f8102-1dd1-43c4-8528-9cc33d280b47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:22.774587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-798f8102-1dd1-43c4-8528-9cc33d280b47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:22.903291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-798f8102-1dd1-43c4-8528-9cc33d280b47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:22.912371 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-798f8102-1dd1-43c4-8528-9cc33d280b47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151685 Oct 28 20:19:22.912937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 954/1918] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:22 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:23.758990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9a7a0804-1d55-4ff3-8d8d-a2b75b48b9e8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:23.761157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9a7a0804-1d55-4ff3-8d8d-a2b75b48b9e8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:23.768175 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a7a0804-1d55-4ff3-8d8d-a2b75b48b9e8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:23.768657 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a7a0804-1d55-4ff3-8d8d-a2b75b48b9e8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:23.769096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a7a0804-1d55-4ff3-8d8d-a2b75b48b9e8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:23.769813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a7a0804-1d55-4ff3-8d8d-a2b75b48b9e8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:23.770268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a7a0804-1d55-4ff3-8d8d-a2b75b48b9e8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:23.770695 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a7a0804-1d55-4ff3-8d8d-a2b75b48b9e8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:23.799237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9a7a0804-1d55-4ff3-8d8d-a2b75b48b9e8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044196 Oct 28 20:19:23.799777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 965/1919] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:23 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:23.935571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-79973c23-c20f-4089-8543-2adc41d7d936 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:23.936237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-79973c23-c20f-4089-8543-2adc41d7d936 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:23.942619 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79973c23-c20f-4089-8543-2adc41d7d936 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:23.943098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79973c23-c20f-4089-8543-2adc41d7d936 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:23.943536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79973c23-c20f-4089-8543-2adc41d7d936 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:23.944223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79973c23-c20f-4089-8543-2adc41d7d936 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:23.944676 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79973c23-c20f-4089-8543-2adc41d7d936 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:23.945100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79973c23-c20f-4089-8543-2adc41d7d936 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:24.077983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-79973c23-c20f-4089-8543-2adc41d7d936 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:24.086030 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-79973c23-c20f-4089-8543-2adc41d7d936 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154968 Oct 28 20:19:24.086862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 955/1920] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:23 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:24.812188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d9aec971-91fd-4e0a-ac9f-79238d4e570f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:24.814300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d9aec971-91fd-4e0a-ac9f-79238d4e570f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:24.820612 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9aec971-91fd-4e0a-ac9f-79238d4e570f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:24.821098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9aec971-91fd-4e0a-ac9f-79238d4e570f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:24.821576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9aec971-91fd-4e0a-ac9f-79238d4e570f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:24.822268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9aec971-91fd-4e0a-ac9f-79238d4e570f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:24.822728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9aec971-91fd-4e0a-ac9f-79238d4e570f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:24.823158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9aec971-91fd-4e0a-ac9f-79238d4e570f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:24.853049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d9aec971-91fd-4e0a-ac9f-79238d4e570f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045438 Oct 28 20:19:24.853646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 966/1921] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:24 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:25.109409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c8681234-1d4d-45b9-983a-e8b0d0e2c120 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:25.109994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c8681234-1d4d-45b9-983a-e8b0d0e2c120 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:25.115875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8681234-1d4d-45b9-983a-e8b0d0e2c120 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:25.116335 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8681234-1d4d-45b9-983a-e8b0d0e2c120 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:25.116772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8681234-1d4d-45b9-983a-e8b0d0e2c120 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:25.117485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8681234-1d4d-45b9-983a-e8b0d0e2c120 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:25.117941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8681234-1d4d-45b9-983a-e8b0d0e2c120 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:25.118371 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8681234-1d4d-45b9-983a-e8b0d0e2c120 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:25.249611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c8681234-1d4d-45b9-983a-e8b0d0e2c120 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:25.257667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c8681234-1d4d-45b9-983a-e8b0d0e2c120 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152474 Oct 28 20:19:25.258224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 956/1922] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:25 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:25.866248 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34dda700-15c6-4415-90c4-068ffec3e0dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:25.868346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-34dda700-15c6-4415-90c4-068ffec3e0dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:25.875261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34dda700-15c6-4415-90c4-068ffec3e0dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:25.875737 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34dda700-15c6-4415-90c4-068ffec3e0dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:25.876167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34dda700-15c6-4415-90c4-068ffec3e0dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:25.876845 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34dda700-15c6-4415-90c4-068ffec3e0dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:25.877297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34dda700-15c6-4415-90c4-068ffec3e0dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:25.877751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34dda700-15c6-4415-90c4-068ffec3e0dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:25.906535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-34dda700-15c6-4415-90c4-068ffec3e0dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044410 Oct 28 20:19:25.907069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 967/1923] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:25 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:26.281073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1e552f5b-beca-4f3a-bce9-19ea3a6e9bf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:26.281736 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1e552f5b-beca-4f3a-bce9-19ea3a6e9bf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:26.288152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e552f5b-beca-4f3a-bce9-19ea3a6e9bf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:26.288639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e552f5b-beca-4f3a-bce9-19ea3a6e9bf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:26.289088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e552f5b-beca-4f3a-bce9-19ea3a6e9bf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:26.289814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e552f5b-beca-4f3a-bce9-19ea3a6e9bf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:26.290274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e552f5b-beca-4f3a-bce9-19ea3a6e9bf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:26.290704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e552f5b-beca-4f3a-bce9-19ea3a6e9bf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:26.308496 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:19:26.417807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1e552f5b-beca-4f3a-bce9-19ea3a6e9bf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:26.426563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1e552f5b-beca-4f3a-bce9-19ea3a6e9bf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150305 Oct 28 20:19:26.427128 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 957/1924] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:26 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:26.919305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-93a3b7ef-f89d-4b89-b6e4-f66a2dd1d427 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:26.921575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-93a3b7ef-f89d-4b89-b6e4-f66a2dd1d427 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:26.928055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93a3b7ef-f89d-4b89-b6e4-f66a2dd1d427 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:26.928540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93a3b7ef-f89d-4b89-b6e4-f66a2dd1d427 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:26.928991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93a3b7ef-f89d-4b89-b6e4-f66a2dd1d427 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:26.929726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93a3b7ef-f89d-4b89-b6e4-f66a2dd1d427 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:26.930188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93a3b7ef-f89d-4b89-b6e4-f66a2dd1d427 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:26.930619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93a3b7ef-f89d-4b89-b6e4-f66a2dd1d427 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:26.960349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-93a3b7ef-f89d-4b89-b6e4-f66a2dd1d427 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045543 Oct 28 20:19:26.960903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 968/1925] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:26 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:27.450730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b14827c1-8b27-4e11-a7c5-f5bf4630baa6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:27.451351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b14827c1-8b27-4e11-a7c5-f5bf4630baa6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:27.457855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b14827c1-8b27-4e11-a7c5-f5bf4630baa6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:27.458342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b14827c1-8b27-4e11-a7c5-f5bf4630baa6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:27.458782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b14827c1-8b27-4e11-a7c5-f5bf4630baa6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:27.459471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b14827c1-8b27-4e11-a7c5-f5bf4630baa6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:27.459928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b14827c1-8b27-4e11-a7c5-f5bf4630baa6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:27.460354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b14827c1-8b27-4e11-a7c5-f5bf4630baa6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:27.598225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b14827c1-8b27-4e11-a7c5-f5bf4630baa6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:27.606810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b14827c1-8b27-4e11-a7c5-f5bf4630baa6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.160034 Oct 28 20:19:27.607374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 958/1926] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:27 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:27.972882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-47539d38-25a9-4ced-af5d-7559b106a774 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:27.975264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-47539d38-25a9-4ced-af5d-7559b106a774 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:27.981601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47539d38-25a9-4ced-af5d-7559b106a774 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:27.982078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47539d38-25a9-4ced-af5d-7559b106a774 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:27.982512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47539d38-25a9-4ced-af5d-7559b106a774 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:27.983195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47539d38-25a9-4ced-af5d-7559b106a774 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:27.983647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47539d38-25a9-4ced-af5d-7559b106a774 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:27.984068 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47539d38-25a9-4ced-af5d-7559b106a774 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:27.987611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:19:28.014605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-47539d38-25a9-4ced-af5d-7559b106a774 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045647 Oct 28 20:19:28.015511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 969/1927] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:27 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:28.630755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c8d61e13-efba-4c08-93f4-d39e5038a6cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:28.631375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c8d61e13-efba-4c08-93f4-d39e5038a6cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:28.638122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8d61e13-efba-4c08-93f4-d39e5038a6cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:28.638609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8d61e13-efba-4c08-93f4-d39e5038a6cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:28.639052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8d61e13-efba-4c08-93f4-d39e5038a6cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:28.639749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8d61e13-efba-4c08-93f4-d39e5038a6cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:28.640207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8d61e13-efba-4c08-93f4-d39e5038a6cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:28.640637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8d61e13-efba-4c08-93f4-d39e5038a6cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:28.772780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c8d61e13-efba-4c08-93f4-d39e5038a6cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:28.781438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c8d61e13-efba-4c08-93f4-d39e5038a6cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154614 Oct 28 20:19:28.781997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 959/1928] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:28 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:29.027348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e47bb08b-e1f4-4863-af72-5e469a5bb61a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:29.030233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e47bb08b-e1f4-4863-af72-5e469a5bb61a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:29.037061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e47bb08b-e1f4-4863-af72-5e469a5bb61a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:29.037585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e47bb08b-e1f4-4863-af72-5e469a5bb61a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:29.038023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e47bb08b-e1f4-4863-af72-5e469a5bb61a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:29.038721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e47bb08b-e1f4-4863-af72-5e469a5bb61a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:29.039206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e47bb08b-e1f4-4863-af72-5e469a5bb61a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:29.039631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e47bb08b-e1f4-4863-af72-5e469a5bb61a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:29.069111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e47bb08b-e1f4-4863-af72-5e469a5bb61a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046070 Oct 28 20:19:29.069695 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 970/1929] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:29 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:29.804725 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40f6410e-0ea7-46a5-bae8-6e17e5162b1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:29.805479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-40f6410e-0ea7-46a5-bae8-6e17e5162b1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:29.812342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40f6410e-0ea7-46a5-bae8-6e17e5162b1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:29.812857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40f6410e-0ea7-46a5-bae8-6e17e5162b1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:29.813298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40f6410e-0ea7-46a5-bae8-6e17e5162b1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:29.814028 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40f6410e-0ea7-46a5-bae8-6e17e5162b1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:29.814486 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40f6410e-0ea7-46a5-bae8-6e17e5162b1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:29.814909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40f6410e-0ea7-46a5-bae8-6e17e5162b1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:29.944029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-40f6410e-0ea7-46a5-bae8-6e17e5162b1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:29.953824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-40f6410e-0ea7-46a5-bae8-6e17e5162b1b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152948 Oct 28 20:19:29.954394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 960/1930] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:29 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:30.082314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-131f3c94-c199-4bd1-872f-85bf1432cb06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:30.084473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-131f3c94-c199-4bd1-872f-85bf1432cb06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:30.091191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131f3c94-c199-4bd1-872f-85bf1432cb06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:30.091735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131f3c94-c199-4bd1-872f-85bf1432cb06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:30.092174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131f3c94-c199-4bd1-872f-85bf1432cb06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:30.092870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131f3c94-c199-4bd1-872f-85bf1432cb06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:30.093341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131f3c94-c199-4bd1-872f-85bf1432cb06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:30.093778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131f3c94-c199-4bd1-872f-85bf1432cb06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:30.123134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-131f3c94-c199-4bd1-872f-85bf1432cb06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044830 Oct 28 20:19:30.123679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 971/1931] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:30 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:30.976225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-47e44970-447e-4f51-82b0-1c3d2c1dc297 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:30.976860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-47e44970-447e-4f51-82b0-1c3d2c1dc297 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:30.984513 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47e44970-447e-4f51-82b0-1c3d2c1dc297 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:30.985080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47e44970-447e-4f51-82b0-1c3d2c1dc297 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:30.985564 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47e44970-447e-4f51-82b0-1c3d2c1dc297 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:30.986266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47e44970-447e-4f51-82b0-1c3d2c1dc297 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:30.986721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47e44970-447e-4f51-82b0-1c3d2c1dc297 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:30.987148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47e44970-447e-4f51-82b0-1c3d2c1dc297 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:31.132255 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-47e44970-447e-4f51-82b0-1c3d2c1dc297 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:31.135207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9123387b-a35a-4a16-8caf-fcc064b39acc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:31.138528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9123387b-a35a-4a16-8caf-fcc064b39acc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:31.141421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-47e44970-447e-4f51-82b0-1c3d2c1dc297 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.169009 Oct 28 20:19:31.147049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 961/1932] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:30 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:31.147219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9123387b-a35a-4a16-8caf-fcc064b39acc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:31.147219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9123387b-a35a-4a16-8caf-fcc064b39acc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:31.147219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9123387b-a35a-4a16-8caf-fcc064b39acc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:31.147219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9123387b-a35a-4a16-8caf-fcc064b39acc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:31.147604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9123387b-a35a-4a16-8caf-fcc064b39acc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:31.147604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9123387b-a35a-4a16-8caf-fcc064b39acc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:31.177016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9123387b-a35a-4a16-8caf-fcc064b39acc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045606 Oct 28 20:19:31.177589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 972/1933] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:31 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:19:32.165453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d2f641a3-b513-4e83-9e15-9ac2b5119646 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:32.166173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d2f641a3-b513-4e83-9e15-9ac2b5119646 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:32.173275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2f641a3-b513-4e83-9e15-9ac2b5119646 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:32.173797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2f641a3-b513-4e83-9e15-9ac2b5119646 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:32.174244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2f641a3-b513-4e83-9e15-9ac2b5119646 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:32.174939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2f641a3-b513-4e83-9e15-9ac2b5119646 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:32.175398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2f641a3-b513-4e83-9e15-9ac2b5119646 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:32.175824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2f641a3-b513-4e83-9e15-9ac2b5119646 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:32.195633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-46d95808-4894-4da5-8d39-de1374400978 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:32.195633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-46d95808-4894-4da5-8d39-de1374400978 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:32.212540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46d95808-4894-4da5-8d39-de1374400978 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:32.218411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46d95808-4894-4da5-8d39-de1374400978 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:32.218942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46d95808-4894-4da5-8d39-de1374400978 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:32.219761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46d95808-4894-4da5-8d39-de1374400978 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:32.220433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46d95808-4894-4da5-8d39-de1374400978 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:32.220937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46d95808-4894-4da5-8d39-de1374400978 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:32.252976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-46d95808-4894-4da5-8d39-de1374400978 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067568 Oct 28 20:19:32.253578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 973/1934] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:32 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:19:32.313192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d2f641a3-b513-4e83-9e15-9ac2b5119646 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:32.321671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d2f641a3-b513-4e83-9e15-9ac2b5119646 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.159986 Oct 28 20:19:32.322399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 962/1935] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:32 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:33.267383 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-67e7fa04-1b92-4fcb-9127-be5bd5437d74 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:33.272122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-67e7fa04-1b92-4fcb-9127-be5bd5437d74 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:33.280077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67e7fa04-1b92-4fcb-9127-be5bd5437d74 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:33.280637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67e7fa04-1b92-4fcb-9127-be5bd5437d74 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:33.281287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67e7fa04-1b92-4fcb-9127-be5bd5437d74 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:33.282087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67e7fa04-1b92-4fcb-9127-be5bd5437d74 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:33.283269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67e7fa04-1b92-4fcb-9127-be5bd5437d74 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:33.283765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67e7fa04-1b92-4fcb-9127-be5bd5437d74 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:33.315097 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-67e7fa04-1b92-4fcb-9127-be5bd5437d74 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053917 Oct 28 20:19:33.319078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 974/1936] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:33 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:33.345420 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-daacb354-64af-48fa-a8d7-31180f3ea881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:33.346087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-daacb354-64af-48fa-a8d7-31180f3ea881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:33.352001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daacb354-64af-48fa-a8d7-31180f3ea881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:33.352480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daacb354-64af-48fa-a8d7-31180f3ea881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:33.359578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daacb354-64af-48fa-a8d7-31180f3ea881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:33.359578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daacb354-64af-48fa-a8d7-31180f3ea881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:33.359578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daacb354-64af-48fa-a8d7-31180f3ea881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:33.359578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daacb354-64af-48fa-a8d7-31180f3ea881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:33.487384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-daacb354-64af-48fa-a8d7-31180f3ea881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:33.495440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-daacb354-64af-48fa-a8d7-31180f3ea881 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155100 Oct 28 20:19:33.496004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 963/1937] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:33 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:34.330035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-99766b07-f9cc-4e88-83d1-011096eed85a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:34.332285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-99766b07-f9cc-4e88-83d1-011096eed85a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:34.334685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=60 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:19:34.339636 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99766b07-f9cc-4e88-83d1-011096eed85a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:34.340128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99766b07-f9cc-4e88-83d1-011096eed85a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:34.341080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99766b07-f9cc-4e88-83d1-011096eed85a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:34.342025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99766b07-f9cc-4e88-83d1-011096eed85a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:34.342488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99766b07-f9cc-4e88-83d1-011096eed85a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:34.343084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99766b07-f9cc-4e88-83d1-011096eed85a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:34.373811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-99766b07-f9cc-4e88-83d1-011096eed85a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047502 Oct 28 20:19:34.374297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 975/1938] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:34 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:34.517855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-127d485a-717c-44c7-9689-56ff067e78a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:34.518482 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-127d485a-717c-44c7-9689-56ff067e78a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:34.520794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=52 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:19:34.525525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-127d485a-717c-44c7-9689-56ff067e78a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:34.526014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-127d485a-717c-44c7-9689-56ff067e78a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:34.526458 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-127d485a-717c-44c7-9689-56ff067e78a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:34.527149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-127d485a-717c-44c7-9689-56ff067e78a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:34.527607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-127d485a-717c-44c7-9689-56ff067e78a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:34.528598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-127d485a-717c-44c7-9689-56ff067e78a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:34.659555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-127d485a-717c-44c7-9689-56ff067e78a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:34.667933 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-127d485a-717c-44c7-9689-56ff067e78a3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153898 Oct 28 20:19:34.668523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 964/1939] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:34 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:35.386410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eff90d64-8317-41e6-8238-93e4d03f74d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:35.391312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eff90d64-8317-41e6-8238-93e4d03f74d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:35.398161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eff90d64-8317-41e6-8238-93e4d03f74d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:35.398647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eff90d64-8317-41e6-8238-93e4d03f74d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:35.399087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eff90d64-8317-41e6-8238-93e4d03f74d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:35.399821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eff90d64-8317-41e6-8238-93e4d03f74d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:35.400281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eff90d64-8317-41e6-8238-93e4d03f74d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:35.400708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eff90d64-8317-41e6-8238-93e4d03f74d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:35.431989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eff90d64-8317-41e6-8238-93e4d03f74d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049909 Oct 28 20:19:35.432565 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 976/1940] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:35 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:35.691733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-48ff79db-29c2-42f2-925c-201e0e865ce4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:35.692363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-48ff79db-29c2-42f2-925c-201e0e865ce4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:35.698800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48ff79db-29c2-42f2-925c-201e0e865ce4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:35.699289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48ff79db-29c2-42f2-925c-201e0e865ce4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:35.700496 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48ff79db-29c2-42f2-925c-201e0e865ce4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:35.701072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48ff79db-29c2-42f2-925c-201e0e865ce4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:35.701572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48ff79db-29c2-42f2-925c-201e0e865ce4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:35.702004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48ff79db-29c2-42f2-925c-201e0e865ce4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:35.830645 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-48ff79db-29c2-42f2-925c-201e0e865ce4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:35.838869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-48ff79db-29c2-42f2-925c-201e0e865ce4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151198 Oct 28 20:19:35.839427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 965/1941] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:35 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:36.445353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-304f960a-347e-4a4f-9669-c0a3cd3acb60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:36.447645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-304f960a-347e-4a4f-9669-c0a3cd3acb60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:36.454909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-304f960a-347e-4a4f-9669-c0a3cd3acb60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:36.455398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-304f960a-347e-4a4f-9669-c0a3cd3acb60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:36.455846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-304f960a-347e-4a4f-9669-c0a3cd3acb60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:36.456547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-304f960a-347e-4a4f-9669-c0a3cd3acb60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:36.457007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-304f960a-347e-4a4f-9669-c0a3cd3acb60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:36.457465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-304f960a-347e-4a4f-9669-c0a3cd3acb60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:36.488028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-304f960a-347e-4a4f-9669-c0a3cd3acb60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046442 Oct 28 20:19:36.492405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 977/1942] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:36 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:36.861894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2cdcf764-62c4-48da-9df0-52f9cbc59c38 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:36.862516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2cdcf764-62c4-48da-9df0-52f9cbc59c38 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:36.869062 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cdcf764-62c4-48da-9df0-52f9cbc59c38 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:36.869586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cdcf764-62c4-48da-9df0-52f9cbc59c38 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:36.870026 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cdcf764-62c4-48da-9df0-52f9cbc59c38 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:36.870718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cdcf764-62c4-48da-9df0-52f9cbc59c38 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:36.871205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cdcf764-62c4-48da-9df0-52f9cbc59c38 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:36.872151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cdcf764-62c4-48da-9df0-52f9cbc59c38 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:37.001894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2cdcf764-62c4-48da-9df0-52f9cbc59c38 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:37.010043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2cdcf764-62c4-48da-9df0-52f9cbc59c38 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152062 Oct 28 20:19:37.017538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 966/1943] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:36 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:37.500994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3352b6eb-7be9-4229-906c-4041c52c78d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:37.504779 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3352b6eb-7be9-4229-906c-4041c52c78d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:37.511088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3352b6eb-7be9-4229-906c-4041c52c78d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:37.514217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3352b6eb-7be9-4229-906c-4041c52c78d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:37.514217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3352b6eb-7be9-4229-906c-4041c52c78d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:37.514217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3352b6eb-7be9-4229-906c-4041c52c78d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:37.514217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3352b6eb-7be9-4229-906c-4041c52c78d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:37.514589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3352b6eb-7be9-4229-906c-4041c52c78d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:37.543792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3352b6eb-7be9-4229-906c-4041c52c78d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047702 Oct 28 20:19:37.544538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 978/1944] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:37 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:38.039642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b160ceb7-1110-48ed-9658-82e66b789363 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:38.040266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b160ceb7-1110-48ed-9658-82e66b789363 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:38.047110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b160ceb7-1110-48ed-9658-82e66b789363 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:38.047637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b160ceb7-1110-48ed-9658-82e66b789363 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:38.048082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b160ceb7-1110-48ed-9658-82e66b789363 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:38.048779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b160ceb7-1110-48ed-9658-82e66b789363 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:38.049241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b160ceb7-1110-48ed-9658-82e66b789363 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:38.049701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b160ceb7-1110-48ed-9658-82e66b789363 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:38.177782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b160ceb7-1110-48ed-9658-82e66b789363 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:38.186292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b160ceb7-1110-48ed-9658-82e66b789363 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150617 Oct 28 20:19:38.186852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 967/1945] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:38 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:38.556332 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-683dc1b7-4b4c-4e65-a727-ace0e4e5886e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:38.559685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-683dc1b7-4b4c-4e65-a727-ace0e4e5886e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:38.566408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683dc1b7-4b4c-4e65-a727-ace0e4e5886e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:38.566910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683dc1b7-4b4c-4e65-a727-ace0e4e5886e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:38.567327 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683dc1b7-4b4c-4e65-a727-ace0e4e5886e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:38.568030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683dc1b7-4b4c-4e65-a727-ace0e4e5886e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:38.568484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683dc1b7-4b4c-4e65-a727-ace0e4e5886e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:38.568908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683dc1b7-4b4c-4e65-a727-ace0e4e5886e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:38.598851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-683dc1b7-4b4c-4e65-a727-ace0e4e5886e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046386 Oct 28 20:19:38.599414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 979/1946] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:38 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:39.209223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cf9018c7-f742-4c26-85c6-2a1e8bf7f578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:39.209905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cf9018c7-f742-4c26-85c6-2a1e8bf7f578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:39.217188 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf9018c7-f742-4c26-85c6-2a1e8bf7f578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:39.217699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf9018c7-f742-4c26-85c6-2a1e8bf7f578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:39.218136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf9018c7-f742-4c26-85c6-2a1e8bf7f578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:39.218820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf9018c7-f742-4c26-85c6-2a1e8bf7f578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:39.219275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf9018c7-f742-4c26-85c6-2a1e8bf7f578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:39.219698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf9018c7-f742-4c26-85c6-2a1e8bf7f578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:39.352839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-cf9018c7-f742-4c26-85c6-2a1e8bf7f578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:39.360918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cf9018c7-f742-4c26-85c6-2a1e8bf7f578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155582 Oct 28 20:19:39.361504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 968/1947] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:39 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:39.611487 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8dd4318e-bfc5-4a40-a18f-84ef340433c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:39.613680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8dd4318e-bfc5-4a40-a18f-84ef340433c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:39.620090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8dd4318e-bfc5-4a40-a18f-84ef340433c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:39.620581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8dd4318e-bfc5-4a40-a18f-84ef340433c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:39.621021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8dd4318e-bfc5-4a40-a18f-84ef340433c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:39.622312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8dd4318e-bfc5-4a40-a18f-84ef340433c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:39.622788 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8dd4318e-bfc5-4a40-a18f-84ef340433c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:39.623256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8dd4318e-bfc5-4a40-a18f-84ef340433c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:39.658079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8dd4318e-bfc5-4a40-a18f-84ef340433c2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050690 Oct 28 20:19:39.658805 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 980/1948] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:39 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:40.383869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ce1a6ae-2e7b-4882-a87f-4aa721e473b9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:40.384393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ce1a6ae-2e7b-4882-a87f-4aa721e473b9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:40.391595 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ce1a6ae-2e7b-4882-a87f-4aa721e473b9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:40.392079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ce1a6ae-2e7b-4882-a87f-4aa721e473b9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:40.392516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ce1a6ae-2e7b-4882-a87f-4aa721e473b9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:40.393232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ce1a6ae-2e7b-4882-a87f-4aa721e473b9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:40.393718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ce1a6ae-2e7b-4882-a87f-4aa721e473b9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:40.394146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ce1a6ae-2e7b-4882-a87f-4aa721e473b9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:40.520396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0ce1a6ae-2e7b-4882-a87f-4aa721e473b9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:40.528542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ce1a6ae-2e7b-4882-a87f-4aa721e473b9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.148647 Oct 28 20:19:40.529098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 969/1949] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:40 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:40.671687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c007f64c-12cd-4448-a80f-8a65a613ac48 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:40.673904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c007f64c-12cd-4448-a80f-8a65a613ac48 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:40.680249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c007f64c-12cd-4448-a80f-8a65a613ac48 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:40.680786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c007f64c-12cd-4448-a80f-8a65a613ac48 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:40.681151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c007f64c-12cd-4448-a80f-8a65a613ac48 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:40.681874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c007f64c-12cd-4448-a80f-8a65a613ac48 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:40.682328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c007f64c-12cd-4448-a80f-8a65a613ac48 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:40.682752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c007f64c-12cd-4448-a80f-8a65a613ac48 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:40.718610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c007f64c-12cd-4448-a80f-8a65a613ac48 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051480 Oct 28 20:19:40.719185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 981/1950] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:40 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:41.551906 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-677d9292-9cd6-42d9-bc15-df3f608e307d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:41.552450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-677d9292-9cd6-42d9-bc15-df3f608e307d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:41.558716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677d9292-9cd6-42d9-bc15-df3f608e307d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:41.559763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677d9292-9cd6-42d9-bc15-df3f608e307d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:41.560200 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677d9292-9cd6-42d9-bc15-df3f608e307d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:41.560883 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677d9292-9cd6-42d9-bc15-df3f608e307d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:41.561348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677d9292-9cd6-42d9-bc15-df3f608e307d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:41.561784 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677d9292-9cd6-42d9-bc15-df3f608e307d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:41.687344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-677d9292-9cd6-42d9-bc15-df3f608e307d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:41.695381 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-677d9292-9cd6-42d9-bc15-df3f608e307d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.147421 Oct 28 20:19:41.695971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 970/1951] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:41 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:41.731376 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-414e3f4d-777c-4576-82f5-68e176e38f1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:41.733591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-414e3f4d-777c-4576-82f5-68e176e38f1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:41.740040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-414e3f4d-777c-4576-82f5-68e176e38f1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:41.740523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-414e3f4d-777c-4576-82f5-68e176e38f1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:41.740965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-414e3f4d-777c-4576-82f5-68e176e38f1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:41.741691 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-414e3f4d-777c-4576-82f5-68e176e38f1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:41.742150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-414e3f4d-777c-4576-82f5-68e176e38f1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:41.742577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-414e3f4d-777c-4576-82f5-68e176e38f1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:41.774023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-414e3f4d-777c-4576-82f5-68e176e38f1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046989 Oct 28 20:19:41.777468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 982/1952] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:41 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:42.720457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aee172df-b02e-45c1-967a-ce597c90806d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:42.721075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aee172df-b02e-45c1-967a-ce597c90806d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:42.727471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aee172df-b02e-45c1-967a-ce597c90806d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:42.727957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aee172df-b02e-45c1-967a-ce597c90806d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:42.728392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aee172df-b02e-45c1-967a-ce597c90806d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:42.729082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aee172df-b02e-45c1-967a-ce597c90806d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:42.729564 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aee172df-b02e-45c1-967a-ce597c90806d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:42.729991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aee172df-b02e-45c1-967a-ce597c90806d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:42.787164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dff7fbf2-928e-4494-ac98-57601ee1aaad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:42.789312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dff7fbf2-928e-4494-ac98-57601ee1aaad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:42.796255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff7fbf2-928e-4494-ac98-57601ee1aaad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:42.796744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff7fbf2-928e-4494-ac98-57601ee1aaad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:42.797180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff7fbf2-928e-4494-ac98-57601ee1aaad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:42.797911 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff7fbf2-928e-4494-ac98-57601ee1aaad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:42.798360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff7fbf2-928e-4494-ac98-57601ee1aaad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:42.798783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff7fbf2-928e-4494-ac98-57601ee1aaad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:42.844434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dff7fbf2-928e-4494-ac98-57601ee1aaad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061058 Oct 28 20:19:42.845014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 983/1953] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:42 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:19:42.870576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-aee172df-b02e-45c1-967a-ce597c90806d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:42.880213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aee172df-b02e-45c1-967a-ce597c90806d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.163587 Oct 28 20:19:42.881254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 971/1954] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:42 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:43.856338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9f26ac1d-a74c-41e3-a7fa-5eecb3bc738e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:43.859082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9f26ac1d-a74c-41e3-a7fa-5eecb3bc738e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:43.865451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f26ac1d-a74c-41e3-a7fa-5eecb3bc738e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:43.865972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f26ac1d-a74c-41e3-a7fa-5eecb3bc738e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:43.866401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f26ac1d-a74c-41e3-a7fa-5eecb3bc738e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:43.867085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f26ac1d-a74c-41e3-a7fa-5eecb3bc738e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:43.867540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f26ac1d-a74c-41e3-a7fa-5eecb3bc738e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:43.867959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f26ac1d-a74c-41e3-a7fa-5eecb3bc738e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:43.898924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9f26ac1d-a74c-41e3-a7fa-5eecb3bc738e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046444 Oct 28 20:19:43.899636 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 984/1955] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:43 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:43.907485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-24319cdb-1921-4ee1-a18c-51aff2335b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:43.908246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-24319cdb-1921-4ee1-a18c-51aff2335b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:43.914949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24319cdb-1921-4ee1-a18c-51aff2335b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:43.915439 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24319cdb-1921-4ee1-a18c-51aff2335b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:43.915878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24319cdb-1921-4ee1-a18c-51aff2335b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:43.916578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24319cdb-1921-4ee1-a18c-51aff2335b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:43.917037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24319cdb-1921-4ee1-a18c-51aff2335b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:43.917495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24319cdb-1921-4ee1-a18c-51aff2335b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:44.051735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-24319cdb-1921-4ee1-a18c-51aff2335b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:44.060577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-24319cdb-1921-4ee1-a18c-51aff2335b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.161144 Oct 28 20:19:44.061135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 972/1956] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:43 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:19:44.911514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e6486da0-5d8c-4ab9-a9a9-d8712d414feb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:44.913681 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e6486da0-5d8c-4ab9-a9a9-d8712d414feb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:44.920038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6486da0-5d8c-4ab9-a9a9-d8712d414feb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:44.920547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6486da0-5d8c-4ab9-a9a9-d8712d414feb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:44.920983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6486da0-5d8c-4ab9-a9a9-d8712d414feb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:44.921697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6486da0-5d8c-4ab9-a9a9-d8712d414feb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:44.922147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6486da0-5d8c-4ab9-a9a9-d8712d414feb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:44.922876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6486da0-5d8c-4ab9-a9a9-d8712d414feb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:44.948449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:19:44.955436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e6486da0-5d8c-4ab9-a9a9-d8712d414feb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047926 Oct 28 20:19:44.961099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 985/1957] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:44 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:45.084106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d97e8c1a-71ec-45ed-a95b-06e72edf5c02 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:45.084764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d97e8c1a-71ec-45ed-a95b-06e72edf5c02 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:45.091887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d97e8c1a-71ec-45ed-a95b-06e72edf5c02 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:45.092412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d97e8c1a-71ec-45ed-a95b-06e72edf5c02 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:45.092856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d97e8c1a-71ec-45ed-a95b-06e72edf5c02 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:45.093586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d97e8c1a-71ec-45ed-a95b-06e72edf5c02 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:45.094054 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d97e8c1a-71ec-45ed-a95b-06e72edf5c02 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:45.094485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d97e8c1a-71ec-45ed-a95b-06e72edf5c02 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:45.224852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d97e8c1a-71ec-45ed-a95b-06e72edf5c02 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:45.232911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d97e8c1a-71ec-45ed-a95b-06e72edf5c02 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152813 Oct 28 20:19:45.233498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 973/1958] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:45 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:45.969011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-57c7ef49-6a4a-40aa-8a90-59176eb2a4e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:45.971300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-57c7ef49-6a4a-40aa-8a90-59176eb2a4e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:45.977880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57c7ef49-6a4a-40aa-8a90-59176eb2a4e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:45.978369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57c7ef49-6a4a-40aa-8a90-59176eb2a4e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:45.978812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57c7ef49-6a4a-40aa-8a90-59176eb2a4e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:45.979505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57c7ef49-6a4a-40aa-8a90-59176eb2a4e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:45.979965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57c7ef49-6a4a-40aa-8a90-59176eb2a4e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:45.980396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57c7ef49-6a4a-40aa-8a90-59176eb2a4e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:46.011329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-57c7ef49-6a4a-40aa-8a90-59176eb2a4e6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047077 Oct 28 20:19:46.011898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 986/1959] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:45 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:46.255629 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f5b91b76-9cc0-4760-8367-c991409725ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:46.256254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f5b91b76-9cc0-4760-8367-c991409725ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:46.262733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5b91b76-9cc0-4760-8367-c991409725ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:46.263388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5b91b76-9cc0-4760-8367-c991409725ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:46.263876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5b91b76-9cc0-4760-8367-c991409725ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:46.264573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5b91b76-9cc0-4760-8367-c991409725ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:46.265033 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5b91b76-9cc0-4760-8367-c991409725ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:46.265498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5b91b76-9cc0-4760-8367-c991409725ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:46.269470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:19:46.396965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f5b91b76-9cc0-4760-8367-c991409725ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:46.405617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f5b91b76-9cc0-4760-8367-c991409725ac tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153817 Oct 28 20:19:46.406183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 974/1960] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:46 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:47.024514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-312e44a2-299d-4aee-8c06-abe17e621b2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:47.026707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-312e44a2-299d-4aee-8c06-abe17e621b2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:47.034130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-312e44a2-299d-4aee-8c06-abe17e621b2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:47.034130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-312e44a2-299d-4aee-8c06-abe17e621b2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:47.034885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-312e44a2-299d-4aee-8c06-abe17e621b2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:47.034998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-312e44a2-299d-4aee-8c06-abe17e621b2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:47.035365 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-312e44a2-299d-4aee-8c06-abe17e621b2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:47.035792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-312e44a2-299d-4aee-8c06-abe17e621b2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:47.065104 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-312e44a2-299d-4aee-8c06-abe17e621b2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044812 Oct 28 20:19:47.071287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 987/1961] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:47 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:47.429643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-926ff75c-92ee-467c-b344-15d3d8dadba9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:47.430610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-926ff75c-92ee-467c-b344-15d3d8dadba9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:47.437499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-926ff75c-92ee-467c-b344-15d3d8dadba9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:47.437984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-926ff75c-92ee-467c-b344-15d3d8dadba9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:47.438422 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-926ff75c-92ee-467c-b344-15d3d8dadba9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:47.439123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-926ff75c-92ee-467c-b344-15d3d8dadba9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:47.439579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-926ff75c-92ee-467c-b344-15d3d8dadba9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:47.440003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-926ff75c-92ee-467c-b344-15d3d8dadba9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:47.591377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-926ff75c-92ee-467c-b344-15d3d8dadba9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:47.601283 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-926ff75c-92ee-467c-b344-15d3d8dadba9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.176116 Oct 28 20:19:47.601910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 975/1962] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:47 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:19:48.077605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-175b3712-b46a-4905-8d23-39ff1f53cae8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:48.079781 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-175b3712-b46a-4905-8d23-39ff1f53cae8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:48.086137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-175b3712-b46a-4905-8d23-39ff1f53cae8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:48.086879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-175b3712-b46a-4905-8d23-39ff1f53cae8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:48.087312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-175b3712-b46a-4905-8d23-39ff1f53cae8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:48.088000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-175b3712-b46a-4905-8d23-39ff1f53cae8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:48.088453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-175b3712-b46a-4905-8d23-39ff1f53cae8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:48.088878 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-175b3712-b46a-4905-8d23-39ff1f53cae8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:48.119713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-175b3712-b46a-4905-8d23-39ff1f53cae8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046091 Oct 28 20:19:48.120269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 988/1963] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:48 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:48.625694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8a418528-1eac-4027-bfc2-697eae784f5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:48.626245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8a418528-1eac-4027-bfc2-697eae784f5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:48.632637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a418528-1eac-4027-bfc2-697eae784f5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:48.633121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a418528-1eac-4027-bfc2-697eae784f5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:48.633596 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a418528-1eac-4027-bfc2-697eae784f5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:48.634286 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a418528-1eac-4027-bfc2-697eae784f5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:48.634768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a418528-1eac-4027-bfc2-697eae784f5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:48.635192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a418528-1eac-4027-bfc2-697eae784f5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:48.767277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8a418528-1eac-4027-bfc2-697eae784f5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:48.775455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8a418528-1eac-4027-bfc2-697eae784f5e tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153828 Oct 28 20:19:48.776026 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 976/1964] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:48 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:49.131519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a6f1471-1d18-4d6d-a696-315c64a5e88f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:49.133699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7a6f1471-1d18-4d6d-a696-315c64a5e88f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:49.140192 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a6f1471-1d18-4d6d-a696-315c64a5e88f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:49.140669 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a6f1471-1d18-4d6d-a696-315c64a5e88f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:49.141101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a6f1471-1d18-4d6d-a696-315c64a5e88f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:49.141818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a6f1471-1d18-4d6d-a696-315c64a5e88f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:49.142269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a6f1471-1d18-4d6d-a696-315c64a5e88f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:49.142691 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a6f1471-1d18-4d6d-a696-315c64a5e88f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:49.171825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7a6f1471-1d18-4d6d-a696-315c64a5e88f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044238 Oct 28 20:19:49.172369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 989/1965] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:49 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:49.798992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-656e8f37-16d5-4316-82f6-220b569d4126 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:49.799606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-656e8f37-16d5-4316-82f6-220b569d4126 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:49.805963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-656e8f37-16d5-4316-82f6-220b569d4126 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:49.806445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-656e8f37-16d5-4316-82f6-220b569d4126 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:49.806892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-656e8f37-16d5-4316-82f6-220b569d4126 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:49.807580 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-656e8f37-16d5-4316-82f6-220b569d4126 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:49.808369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-656e8f37-16d5-4316-82f6-220b569d4126 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:49.808521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-656e8f37-16d5-4316-82f6-220b569d4126 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:49.936549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-656e8f37-16d5-4316-82f6-220b569d4126 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:49.944561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-656e8f37-16d5-4316-82f6-220b569d4126 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149502 Oct 28 20:19:49.945124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 977/1966] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:49 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:50.184035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ac4c8405-3d15-40e8-bbcb-46be15e21d6c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:50.186287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ac4c8405-3d15-40e8-bbcb-46be15e21d6c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:50.192656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac4c8405-3d15-40e8-bbcb-46be15e21d6c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:50.193130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac4c8405-3d15-40e8-bbcb-46be15e21d6c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:50.193594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac4c8405-3d15-40e8-bbcb-46be15e21d6c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:50.194282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac4c8405-3d15-40e8-bbcb-46be15e21d6c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:50.194734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac4c8405-3d15-40e8-bbcb-46be15e21d6c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:50.195156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac4c8405-3d15-40e8-bbcb-46be15e21d6c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:50.224508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ac4c8405-3d15-40e8-bbcb-46be15e21d6c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 Oct 28 20:19:50.225057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 990/1967] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:50 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:50.968196 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-615b37bd-6731-4518-a764-5781113f70c3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:50.968802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-615b37bd-6731-4518-a764-5781113f70c3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:50.975282 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-615b37bd-6731-4518-a764-5781113f70c3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:50.975764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-615b37bd-6731-4518-a764-5781113f70c3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:50.976192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-615b37bd-6731-4518-a764-5781113f70c3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:50.976872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-615b37bd-6731-4518-a764-5781113f70c3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:50.977345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-615b37bd-6731-4518-a764-5781113f70c3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:50.977779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-615b37bd-6731-4518-a764-5781113f70c3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:51.108997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-615b37bd-6731-4518-a764-5781113f70c3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:51.117030 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-615b37bd-6731-4518-a764-5781113f70c3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152701 Oct 28 20:19:51.117614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 978/1968] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:50 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:51.237176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f4cf59a2-fa4d-4bbe-bead-b3e75955308a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:51.239298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f4cf59a2-fa4d-4bbe-bead-b3e75955308a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:51.245590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4cf59a2-fa4d-4bbe-bead-b3e75955308a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:51.246063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4cf59a2-fa4d-4bbe-bead-b3e75955308a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:51.246491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4cf59a2-fa4d-4bbe-bead-b3e75955308a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:51.247272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4cf59a2-fa4d-4bbe-bead-b3e75955308a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:51.247724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4cf59a2-fa4d-4bbe-bead-b3e75955308a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:51.248147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4cf59a2-fa4d-4bbe-bead-b3e75955308a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:51.276983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f4cf59a2-fa4d-4bbe-bead-b3e75955308a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043785 Oct 28 20:19:51.277553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 991/1969] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:51 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:52.140394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-577405b2-35a7-4155-9487-02d66b62e9b0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:52.141044 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-577405b2-35a7-4155-9487-02d66b62e9b0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:52.147485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-577405b2-35a7-4155-9487-02d66b62e9b0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:52.147970 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-577405b2-35a7-4155-9487-02d66b62e9b0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:52.148411 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-577405b2-35a7-4155-9487-02d66b62e9b0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:52.149096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-577405b2-35a7-4155-9487-02d66b62e9b0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:52.149583 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-577405b2-35a7-4155-9487-02d66b62e9b0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:52.150010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-577405b2-35a7-4155-9487-02d66b62e9b0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:52.276532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-577405b2-35a7-4155-9487-02d66b62e9b0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:52.284993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-577405b2-35a7-4155-9487-02d66b62e9b0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149003 Oct 28 20:19:52.285584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 979/1970] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:52 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:52.289798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d5071f0b-e3bb-461d-9a34-4f2ee6d0020d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:52.291958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d5071f0b-e3bb-461d-9a34-4f2ee6d0020d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:52.298358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5071f0b-e3bb-461d-9a34-4f2ee6d0020d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:52.298843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5071f0b-e3bb-461d-9a34-4f2ee6d0020d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:52.299278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5071f0b-e3bb-461d-9a34-4f2ee6d0020d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:52.299988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5071f0b-e3bb-461d-9a34-4f2ee6d0020d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:52.300438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5071f0b-e3bb-461d-9a34-4f2ee6d0020d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:52.300853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5071f0b-e3bb-461d-9a34-4f2ee6d0020d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:52.330953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d5071f0b-e3bb-461d-9a34-4f2ee6d0020d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045077 Oct 28 20:19:52.331506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 992/1971] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:52 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:19:53.308002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-952e4e8a-e484-4d2a-b16a-d191b0037ef9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:53.308668 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-952e4e8a-e484-4d2a-b16a-d191b0037ef9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:53.315602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-952e4e8a-e484-4d2a-b16a-d191b0037ef9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:53.316958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-952e4e8a-e484-4d2a-b16a-d191b0037ef9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:53.316958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-952e4e8a-e484-4d2a-b16a-d191b0037ef9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:53.317296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-952e4e8a-e484-4d2a-b16a-d191b0037ef9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:53.317701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-952e4e8a-e484-4d2a-b16a-d191b0037ef9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:53.318123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-952e4e8a-e484-4d2a-b16a-d191b0037ef9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:53.343895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fb6c7064-a4a2-4228-963e-1c4e2d70c8c5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:53.346730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fb6c7064-a4a2-4228-963e-1c4e2d70c8c5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:53.353105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb6c7064-a4a2-4228-963e-1c4e2d70c8c5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:53.353616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb6c7064-a4a2-4228-963e-1c4e2d70c8c5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:53.354060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb6c7064-a4a2-4228-963e-1c4e2d70c8c5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:53.354768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb6c7064-a4a2-4228-963e-1c4e2d70c8c5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:53.355226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb6c7064-a4a2-4228-963e-1c4e2d70c8c5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:53.355654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb6c7064-a4a2-4228-963e-1c4e2d70c8c5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:53.386470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fb6c7064-a4a2-4228-963e-1c4e2d70c8c5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046910 Oct 28 20:19:53.387103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 993/1972] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:53 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:19:53.451166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-952e4e8a-e484-4d2a-b16a-d191b0037ef9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:53.459331 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-952e4e8a-e484-4d2a-b16a-d191b0037ef9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155252 Oct 28 20:19:53.460092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 980/1973] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:53 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:54.399630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-086326b6-f469-47f1-8ed8-ef2f687fd6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:54.401776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-086326b6-f469-47f1-8ed8-ef2f687fd6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:54.411277 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-086326b6-f469-47f1-8ed8-ef2f687fd6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:54.411853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-086326b6-f469-47f1-8ed8-ef2f687fd6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:54.412296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-086326b6-f469-47f1-8ed8-ef2f687fd6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:54.413005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-086326b6-f469-47f1-8ed8-ef2f687fd6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:54.413506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-086326b6-f469-47f1-8ed8-ef2f687fd6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:54.413940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-086326b6-f469-47f1-8ed8-ef2f687fd6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:54.444457 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-086326b6-f469-47f1-8ed8-ef2f687fd6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048944 Oct 28 20:19:54.444999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 994/1974] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:54 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:54.483866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d00c8030-da57-4460-8623-9c2f9c1e7169 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:54.484484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d00c8030-da57-4460-8623-9c2f9c1e7169 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:54.490557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d00c8030-da57-4460-8623-9c2f9c1e7169 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:54.491034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d00c8030-da57-4460-8623-9c2f9c1e7169 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:54.491474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d00c8030-da57-4460-8623-9c2f9c1e7169 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:54.492160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d00c8030-da57-4460-8623-9c2f9c1e7169 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:54.492613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d00c8030-da57-4460-8623-9c2f9c1e7169 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:54.493036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d00c8030-da57-4460-8623-9c2f9c1e7169 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:54.621646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d00c8030-da57-4460-8623-9c2f9c1e7169 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:54.630322 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d00c8030-da57-4460-8623-9c2f9c1e7169 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151139 Oct 28 20:19:54.630893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 981/1975] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:54 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:55.456818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c8762123-cf98-4f94-a2ec-ba25f4c49cd0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:55.458987 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c8762123-cf98-4f94-a2ec-ba25f4c49cd0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:55.466185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8762123-cf98-4f94-a2ec-ba25f4c49cd0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:55.467197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8762123-cf98-4f94-a2ec-ba25f4c49cd0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:55.467645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8762123-cf98-4f94-a2ec-ba25f4c49cd0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:55.468341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8762123-cf98-4f94-a2ec-ba25f4c49cd0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:55.468835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8762123-cf98-4f94-a2ec-ba25f4c49cd0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:55.469263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8762123-cf98-4f94-a2ec-ba25f4c49cd0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:55.499725 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c8762123-cf98-4f94-a2ec-ba25f4c49cd0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046830 Oct 28 20:19:55.500286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 995/1976] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:55 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:55.654138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-11eb6398-eea0-4a39-b681-739dd70e4bbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:55.654681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-11eb6398-eea0-4a39-b681-739dd70e4bbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:55.661303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11eb6398-eea0-4a39-b681-739dd70e4bbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:55.661804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11eb6398-eea0-4a39-b681-739dd70e4bbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:55.662237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11eb6398-eea0-4a39-b681-739dd70e4bbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:55.662951 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11eb6398-eea0-4a39-b681-739dd70e4bbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:55.663447 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11eb6398-eea0-4a39-b681-739dd70e4bbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:55.663893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11eb6398-eea0-4a39-b681-739dd70e4bbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:55.805273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-11eb6398-eea0-4a39-b681-739dd70e4bbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:55.806485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-11eb6398-eea0-4a39-b681-739dd70e4bbf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.157075 Oct 28 20:19:55.807052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 982/1977] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:55 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:56.520193 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7361b5dc-f542-4b97-bab4-d7f57c7d4c38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:56.522360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7361b5dc-f542-4b97-bab4-d7f57c7d4c38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:56.529431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7361b5dc-f542-4b97-bab4-d7f57c7d4c38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:56.529912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7361b5dc-f542-4b97-bab4-d7f57c7d4c38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:56.530346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7361b5dc-f542-4b97-bab4-d7f57c7d4c38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:56.531029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7361b5dc-f542-4b97-bab4-d7f57c7d4c38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:56.531483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7361b5dc-f542-4b97-bab4-d7f57c7d4c38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:56.531901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7361b5dc-f542-4b97-bab4-d7f57c7d4c38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:56.560715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7361b5dc-f542-4b97-bab4-d7f57c7d4c38 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Oct 28 20:19:56.561256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 996/1978] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:56 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:56.831087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a84c4432-80ec-48b7-8fea-2b05fa056c37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:56.831823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a84c4432-80ec-48b7-8fea-2b05fa056c37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:56.838419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a84c4432-80ec-48b7-8fea-2b05fa056c37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:56.839116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a84c4432-80ec-48b7-8fea-2b05fa056c37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:56.839562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a84c4432-80ec-48b7-8fea-2b05fa056c37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:56.840260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a84c4432-80ec-48b7-8fea-2b05fa056c37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:56.840746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a84c4432-80ec-48b7-8fea-2b05fa056c37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:56.841300 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a84c4432-80ec-48b7-8fea-2b05fa056c37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:56.976810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a84c4432-80ec-48b7-8fea-2b05fa056c37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:56.985273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a84c4432-80ec-48b7-8fea-2b05fa056c37 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.158011 Oct 28 20:19:56.985784 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 983/1979] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:56 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:57.571978 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7060eca9-e621-4bb9-bd89-092a5583eeb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:57.574164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7060eca9-e621-4bb9-bd89-092a5583eeb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:57.580482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7060eca9-e621-4bb9-bd89-092a5583eeb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:57.580955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7060eca9-e621-4bb9-bd89-092a5583eeb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:57.581417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7060eca9-e621-4bb9-bd89-092a5583eeb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:57.582135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7060eca9-e621-4bb9-bd89-092a5583eeb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:57.582584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7060eca9-e621-4bb9-bd89-092a5583eeb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:57.583006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7060eca9-e621-4bb9-bd89-092a5583eeb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:57.613080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7060eca9-e621-4bb9-bd89-092a5583eeb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044980 Oct 28 20:19:57.613614 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 997/1980] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:57 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:58.008003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-51534333-7a25-4bcf-98b8-4e67891d6671 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:58.008764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-51534333-7a25-4bcf-98b8-4e67891d6671 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:58.018079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51534333-7a25-4bcf-98b8-4e67891d6671 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:58.018079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51534333-7a25-4bcf-98b8-4e67891d6671 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:58.018079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51534333-7a25-4bcf-98b8-4e67891d6671 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:58.018079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51534333-7a25-4bcf-98b8-4e67891d6671 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:58.018579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51534333-7a25-4bcf-98b8-4e67891d6671 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:58.018970 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51534333-7a25-4bcf-98b8-4e67891d6671 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:58.167856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-51534333-7a25-4bcf-98b8-4e67891d6671 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:58.176005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-51534333-7a25-4bcf-98b8-4e67891d6671 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.171857 Oct 28 20:19:58.176560 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 984/1981] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:58 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:58.625001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b0ea21dc-7532-4841-a463-6b361753c820 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:58.627191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b0ea21dc-7532-4841-a463-6b361753c820 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:58.633630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0ea21dc-7532-4841-a463-6b361753c820 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:58.634118 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0ea21dc-7532-4841-a463-6b361753c820 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:58.634564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0ea21dc-7532-4841-a463-6b361753c820 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:58.635257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0ea21dc-7532-4841-a463-6b361753c820 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:58.635717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0ea21dc-7532-4841-a463-6b361753c820 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:58.636144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0ea21dc-7532-4841-a463-6b361753c820 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:58.666091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b0ea21dc-7532-4841-a463-6b361753c820 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045347 Oct 28 20:19:58.666642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 998/1982] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:58 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:19:59.198148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b458d53d-82cb-4399-ad25-aa31987fed47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:59.198762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b458d53d-82cb-4399-ad25-aa31987fed47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:59.205850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b458d53d-82cb-4399-ad25-aa31987fed47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:59.206328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b458d53d-82cb-4399-ad25-aa31987fed47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:59.206759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b458d53d-82cb-4399-ad25-aa31987fed47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:59.207483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b458d53d-82cb-4399-ad25-aa31987fed47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:59.207933 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b458d53d-82cb-4399-ad25-aa31987fed47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:59.208352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b458d53d-82cb-4399-ad25-aa31987fed47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:59.335702 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b458d53d-82cb-4399-ad25-aa31987fed47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:19:59.344689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b458d53d-82cb-4399-ad25-aa31987fed47 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150359 Oct 28 20:19:59.345246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 985/1983] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:19:59 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:19:59.678343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-af99ad7d-0b34-4b1f-9c59-65974cbd6518 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:19:59.680560 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-af99ad7d-0b34-4b1f-9c59-65974cbd6518 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:19:59.686974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af99ad7d-0b34-4b1f-9c59-65974cbd6518 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:59.687457 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af99ad7d-0b34-4b1f-9c59-65974cbd6518 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:59.687894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af99ad7d-0b34-4b1f-9c59-65974cbd6518 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:59.688588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af99ad7d-0b34-4b1f-9c59-65974cbd6518 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:19:59.689044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af99ad7d-0b34-4b1f-9c59-65974cbd6518 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:19:59.689509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af99ad7d-0b34-4b1f-9c59-65974cbd6518 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:19:59.719811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-af99ad7d-0b34-4b1f-9c59-65974cbd6518 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045428 Oct 28 20:19:59.720358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 999/1984] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:19:59 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:00.369081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a0b2400-2a02-4f20-be7a-16547c9d1438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:00.369725 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0a0b2400-2a02-4f20-be7a-16547c9d1438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:00.376573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a0b2400-2a02-4f20-be7a-16547c9d1438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:00.377082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a0b2400-2a02-4f20-be7a-16547c9d1438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:00.377555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a0b2400-2a02-4f20-be7a-16547c9d1438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:00.378247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a0b2400-2a02-4f20-be7a-16547c9d1438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:00.378733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a0b2400-2a02-4f20-be7a-16547c9d1438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:00.379157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a0b2400-2a02-4f20-be7a-16547c9d1438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:00.509844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a0b2400-2a02-4f20-be7a-16547c9d1438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:00.516328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0a0b2400-2a02-4f20-be7a-16547c9d1438 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151089 Oct 28 20:20:00.516900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 986/1985] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:00 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:00.733303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6535b0f4-cf27-4779-afaf-c9d649b19339 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:00.735481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6535b0f4-cf27-4779-afaf-c9d649b19339 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:00.741984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6535b0f4-cf27-4779-afaf-c9d649b19339 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:00.742468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6535b0f4-cf27-4779-afaf-c9d649b19339 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:00.742910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6535b0f4-cf27-4779-afaf-c9d649b19339 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:00.743606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6535b0f4-cf27-4779-afaf-c9d649b19339 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:00.744063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6535b0f4-cf27-4779-afaf-c9d649b19339 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:00.744494 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6535b0f4-cf27-4779-afaf-c9d649b19339 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:00.774194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6535b0f4-cf27-4779-afaf-c9d649b19339 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045899 Oct 28 20:20:00.774754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1000/1986] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:00 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:01.539727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-706e9cd7-5c34-4229-ae69-4badc0a6f01d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:01.540468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-706e9cd7-5c34-4229-ae69-4badc0a6f01d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:01.547835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-706e9cd7-5c34-4229-ae69-4badc0a6f01d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:01.548324 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-706e9cd7-5c34-4229-ae69-4badc0a6f01d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:01.548762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-706e9cd7-5c34-4229-ae69-4badc0a6f01d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:01.549494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-706e9cd7-5c34-4229-ae69-4badc0a6f01d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:01.549952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-706e9cd7-5c34-4229-ae69-4badc0a6f01d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:01.550377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-706e9cd7-5c34-4229-ae69-4badc0a6f01d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:01.677480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-706e9cd7-5c34-4229-ae69-4badc0a6f01d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:01.685791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-706e9cd7-5c34-4229-ae69-4badc0a6f01d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149813 Oct 28 20:20:01.686358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 987/1987] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:01 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:01.786553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-45efb9ac-70e3-4836-9559-9bc3bc8e4173 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:01.788766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-45efb9ac-70e3-4836-9559-9bc3bc8e4173 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:01.795524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45efb9ac-70e3-4836-9559-9bc3bc8e4173 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:01.796012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45efb9ac-70e3-4836-9559-9bc3bc8e4173 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:01.796447 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45efb9ac-70e3-4836-9559-9bc3bc8e4173 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:01.797184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45efb9ac-70e3-4836-9559-9bc3bc8e4173 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:01.797662 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45efb9ac-70e3-4836-9559-9bc3bc8e4173 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:01.802009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45efb9ac-70e3-4836-9559-9bc3bc8e4173 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:01.827617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-45efb9ac-70e3-4836-9559-9bc3bc8e4173 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044985 Oct 28 20:20:01.828165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1001/1988] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:01 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:02.707955 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1480b317-969d-4225-a123-4c0b0bc9e909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:02.708575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1480b317-969d-4225-a123-4c0b0bc9e909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:02.715209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1480b317-969d-4225-a123-4c0b0bc9e909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:02.715695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1480b317-969d-4225-a123-4c0b0bc9e909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:02.716140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1480b317-969d-4225-a123-4c0b0bc9e909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:02.716953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1480b317-969d-4225-a123-4c0b0bc9e909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:02.717437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1480b317-969d-4225-a123-4c0b0bc9e909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:02.717869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1480b317-969d-4225-a123-4c0b0bc9e909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:02.840521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-29353960-af32-49d1-b91f-0833f7cd59d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:02.843430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-29353960-af32-49d1-b91f-0833f7cd59d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:02.849851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29353960-af32-49d1-b91f-0833f7cd59d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:02.850297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1480b317-969d-4225-a123-4c0b0bc9e909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:02.850451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29353960-af32-49d1-b91f-0833f7cd59d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:02.851380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29353960-af32-49d1-b91f-0833f7cd59d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:02.852082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29353960-af32-49d1-b91f-0833f7cd59d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:02.852533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29353960-af32-49d1-b91f-0833f7cd59d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:02.852954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29353960-af32-49d1-b91f-0833f7cd59d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:02.859234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1480b317-969d-4225-a123-4c0b0bc9e909 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155119 Oct 28 20:20:02.859797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 988/1989] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:02 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:02.867577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:02.884377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-29353960-af32-49d1-b91f-0833f7cd59d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047999 Oct 28 20:20:02.884935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1002/1990] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:02 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:20:03.881800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bf342d1f-5683-47b8-b8dc-642d78079ea4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:03.882423 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bf342d1f-5683-47b8-b8dc-642d78079ea4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:03.888968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf342d1f-5683-47b8-b8dc-642d78079ea4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:03.892916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf342d1f-5683-47b8-b8dc-642d78079ea4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:03.892916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf342d1f-5683-47b8-b8dc-642d78079ea4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:03.892916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf342d1f-5683-47b8-b8dc-642d78079ea4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:03.892916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf342d1f-5683-47b8-b8dc-642d78079ea4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:03.893428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf342d1f-5683-47b8-b8dc-642d78079ea4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:03.896259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d7910c59-5c47-4d8f-a100-9fb4e58633fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:03.898657 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d7910c59-5c47-4d8f-a100-9fb4e58633fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:03.905854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7910c59-5c47-4d8f-a100-9fb4e58633fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:03.906340 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7910c59-5c47-4d8f-a100-9fb4e58633fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:03.906812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7910c59-5c47-4d8f-a100-9fb4e58633fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:03.907511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7910c59-5c47-4d8f-a100-9fb4e58633fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:03.907975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7910c59-5c47-4d8f-a100-9fb4e58633fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:03.908401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7910c59-5c47-4d8f-a100-9fb4e58633fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:03.940041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d7910c59-5c47-4d8f-a100-9fb4e58633fd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047849 Oct 28 20:20:03.940832 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1003/1991] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:03 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:20:04.019795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bf342d1f-5683-47b8-b8dc-642d78079ea4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:04.028040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bf342d1f-5683-47b8-b8dc-642d78079ea4 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150096 Oct 28 20:20:04.028623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 989/1992] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:03 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:04.434644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe30bdb5-8767-4397-b822-6a14d62fbfc2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:04.435306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fe30bdb5-8767-4397-b822-6a14d62fbfc2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:04.441249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe30bdb5-8767-4397-b822-6a14d62fbfc2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:04.442984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe30bdb5-8767-4397-b822-6a14d62fbfc2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:04.442984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe30bdb5-8767-4397-b822-6a14d62fbfc2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:04.442984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe30bdb5-8767-4397-b822-6a14d62fbfc2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:04.443915 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe30bdb5-8767-4397-b822-6a14d62fbfc2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:04.444366 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe30bdb5-8767-4397-b822-6a14d62fbfc2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:04.470283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fe30bdb5-8767-4397-b822-6a14d62fbfc2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:20:04.751518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fe30bdb5-8767-4397-b822-6a14d62fbfc2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 204 len: 0 microversion: 2.1 time: 0.320338 Oct 28 20:20:04.752108 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1004/1993] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:20:04 2022] DELETE /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:20:04.760297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-73b0449b-a43d-4231-bd1b-fa9c8dffed59 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:04.762583 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-73b0449b-a43d-4231-bd1b-fa9c8dffed59 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:04.762853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=52 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:04.767881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73b0449b-a43d-4231-bd1b-fa9c8dffed59 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:04.768369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73b0449b-a43d-4231-bd1b-fa9c8dffed59 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:04.768813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73b0449b-a43d-4231-bd1b-fa9c8dffed59 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:04.769552 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73b0449b-a43d-4231-bd1b-fa9c8dffed59 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:04.770025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73b0449b-a43d-4231-bd1b-fa9c8dffed59 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:04.770446 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73b0449b-a43d-4231-bd1b-fa9c8dffed59 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:04.953576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b08d1c0c-7147-4f9c-b09f-6d0b2bf508c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:04.955878 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b08d1c0c-7147-4f9c-b09f-6d0b2bf508c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:04.962799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b08d1c0c-7147-4f9c-b09f-6d0b2bf508c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:04.963283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b08d1c0c-7147-4f9c-b09f-6d0b2bf508c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:04.963724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b08d1c0c-7147-4f9c-b09f-6d0b2bf508c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:04.964427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b08d1c0c-7147-4f9c-b09f-6d0b2bf508c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:04.964882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b08d1c0c-7147-4f9c-b09f-6d0b2bf508c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:04.965305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b08d1c0c-7147-4f9c-b09f-6d0b2bf508c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:04.998338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b08d1c0c-7147-4f9c-b09f-6d0b2bf508c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048893 Oct 28 20:20:04.999076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1005/1994] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:04 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:05.051670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ffa9491c-81fe-4d24-b672-5b18264a9c6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:05.052287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ffa9491c-81fe-4d24-b672-5b18264a9c6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:05.058437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffa9491c-81fe-4d24-b672-5b18264a9c6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:05.058933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffa9491c-81fe-4d24-b672-5b18264a9c6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:05.059374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffa9491c-81fe-4d24-b672-5b18264a9c6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:05.060115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffa9491c-81fe-4d24-b672-5b18264a9c6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:05.060744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffa9491c-81fe-4d24-b672-5b18264a9c6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:05.061400 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffa9491c-81fe-4d24-b672-5b18264a9c6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:05.176734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-73b0449b-a43d-4231-bd1b-fa9c8dffed59 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:05.180347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:05.186053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-73b0449b-a43d-4231-bd1b-fa9c8dffed59 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.429563 Oct 28 20:20:05.186718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 990/1995] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:04 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:05.222067 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ffa9491c-81fe-4d24-b672-5b18264a9c6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:05.230040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ffa9491c-81fe-4d24-b672-5b18264a9c6a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.182294 Oct 28 20:20:05.230601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1006/1996] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:05 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:06.010946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-109a4a3c-1e44-46e5-8a70-b69d30fc6675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:06.014053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-109a4a3c-1e44-46e5-8a70-b69d30fc6675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:06.020952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-109a4a3c-1e44-46e5-8a70-b69d30fc6675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:06.021471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-109a4a3c-1e44-46e5-8a70-b69d30fc6675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:06.021917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-109a4a3c-1e44-46e5-8a70-b69d30fc6675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:06.022619 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-109a4a3c-1e44-46e5-8a70-b69d30fc6675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:06.023082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-109a4a3c-1e44-46e5-8a70-b69d30fc6675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:06.023515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-109a4a3c-1e44-46e5-8a70-b69d30fc6675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:06.053029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-109a4a3c-1e44-46e5-8a70-b69d30fc6675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046092 Oct 28 20:20:06.053621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 991/1997] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:06 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:06.210097 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3f25ec38-8155-44b6-8b17-132c452a67f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:06.210736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3f25ec38-8155-44b6-8b17-132c452a67f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:06.213477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:06.218776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f25ec38-8155-44b6-8b17-132c452a67f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:06.219261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f25ec38-8155-44b6-8b17-132c452a67f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:06.219701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f25ec38-8155-44b6-8b17-132c452a67f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:06.220391 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f25ec38-8155-44b6-8b17-132c452a67f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:06.220842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f25ec38-8155-44b6-8b17-132c452a67f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:06.221266 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f25ec38-8155-44b6-8b17-132c452a67f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:06.254270 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bcfa5110-ffc5-4a89-96f9-9b52e7f9accc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:06.254886 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bcfa5110-ffc5-4a89-96f9-9b52e7f9accc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:06.260840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfa5110-ffc5-4a89-96f9-9b52e7f9accc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:06.261268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfa5110-ffc5-4a89-96f9-9b52e7f9accc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:06.261752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfa5110-ffc5-4a89-96f9-9b52e7f9accc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:06.263607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfa5110-ffc5-4a89-96f9-9b52e7f9accc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:06.264421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfa5110-ffc5-4a89-96f9-9b52e7f9accc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:06.264549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfa5110-ffc5-4a89-96f9-9b52e7f9accc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:06.393977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3f25ec38-8155-44b6-8b17-132c452a67f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:06.402161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3f25ec38-8155-44b6-8b17-132c452a67f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.195961 Oct 28 20:20:06.402738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1007/1998] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:06 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:06.428337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bcfa5110-ffc5-4a89-96f9-9b52e7f9accc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:06.437162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bcfa5110-ffc5-4a89-96f9-9b52e7f9accc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.187668 Oct 28 20:20:06.438149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 992/1999] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:06 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:06.779438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9e064ab9-954d-4c3c-ae2e-b765099b1d67 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] Calling method '.version_select at 0x7f1f4d2a3940>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:06.783500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9e064ab9-954d-4c3c-ae2e-b765099b1d67 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [0bc930ec-6817-4a62-847d-456c972b3902] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:20:07.065980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b235f3e-8535-4c5f-995d-239a4618dd67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:07.068175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6b235f3e-8535-4c5f-995d-239a4618dd67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:07.074586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b235f3e-8535-4c5f-995d-239a4618dd67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:07.083296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b235f3e-8535-4c5f-995d-239a4618dd67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:07.083296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b235f3e-8535-4c5f-995d-239a4618dd67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:07.083296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b235f3e-8535-4c5f-995d-239a4618dd67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:07.083296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b235f3e-8535-4c5f-995d-239a4618dd67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:07.083673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b235f3e-8535-4c5f-995d-239a4618dd67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:07.108196 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6b235f3e-8535-4c5f-995d-239a4618dd67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046165 Oct 28 20:20:07.108776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 993/2000] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:07 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:20:07.425352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-80f8b6d6-4cb4-4190-8d88-7a06a7cb6d08 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:07.425953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-80f8b6d6-4cb4-4190-8d88-7a06a7cb6d08 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:07.431737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f8b6d6-4cb4-4190-8d88-7a06a7cb6d08 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:07.432217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f8b6d6-4cb4-4190-8d88-7a06a7cb6d08 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:07.432644 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f8b6d6-4cb4-4190-8d88-7a06a7cb6d08 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:07.433339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f8b6d6-4cb4-4190-8d88-7a06a7cb6d08 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:07.433796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f8b6d6-4cb4-4190-8d88-7a06a7cb6d08 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:07.434216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f8b6d6-4cb4-4190-8d88-7a06a7cb6d08 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:07.601150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-80f8b6d6-4cb4-4190-8d88-7a06a7cb6d08 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:07.610543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-80f8b6d6-4cb4-4190-8d88-7a06a7cb6d08 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.188935 Oct 28 20:20:07.611160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 994/2001] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:07 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:07.615619 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c9d6fd85-a9dd-4bb2-be40-f2e187640cfa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:07.616235 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c9d6fd85-a9dd-4bb2-be40-f2e187640cfa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:07.622139 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d6fd85-a9dd-4bb2-be40-f2e187640cfa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:07.622739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d6fd85-a9dd-4bb2-be40-f2e187640cfa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:07.623124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d6fd85-a9dd-4bb2-be40-f2e187640cfa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:07.623823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d6fd85-a9dd-4bb2-be40-f2e187640cfa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:07.624281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d6fd85-a9dd-4bb2-be40-f2e187640cfa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:07.624714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d6fd85-a9dd-4bb2-be40-f2e187640cfa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:07.795106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [None req-9e064ab9-954d-4c3c-ae2e-b765099b1d67 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] [0bc930ec-6817-4a62-847d-456c972b3902] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 52434. Oct 28 20:20:07.819884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c9d6fd85-a9dd-4bb2-be40-f2e187640cfa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:07.831115 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c9d6fd85-a9dd-4bb2-be40-f2e187640cfa tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.218943 Oct 28 20:20:07.841938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 995/2002] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:07 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:07.889742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9e064ab9-954d-4c3c-ae2e-b765099b1d67 tempest-TestVolumeBootPattern-1970423806 tempest-TestVolumeBootPattern-1970423806-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-630547667" status: 202 len: 0 microversion: 2.1 time: 1.119013 Oct 28 20:20:07.890331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1008/2003] 10.222.0.66 () {58 vars in 1260 bytes} [Fri Oct 28 20:20:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-630547667 => generated 0 bytes in 1121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:20:08.121458 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a92db279-e593-40fe-82a3-442efc8188fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:08.124642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a92db279-e593-40fe-82a3-442efc8188fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:08.131162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a92db279-e593-40fe-82a3-442efc8188fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:08.131656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a92db279-e593-40fe-82a3-442efc8188fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:08.132091 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a92db279-e593-40fe-82a3-442efc8188fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:08.132794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a92db279-e593-40fe-82a3-442efc8188fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:08.133250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a92db279-e593-40fe-82a3-442efc8188fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:08.133707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a92db279-e593-40fe-82a3-442efc8188fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:08.165700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a92db279-e593-40fe-82a3-442efc8188fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048348 Oct 28 20:20:08.166276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 996/2004] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:08 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:08.642743 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d894a3b-c7da-4da2-ba05-3dc3c082d91f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:08.642743 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4d894a3b-c7da-4da2-ba05-3dc3c082d91f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:08.648879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d894a3b-c7da-4da2-ba05-3dc3c082d91f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:08.649464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d894a3b-c7da-4da2-ba05-3dc3c082d91f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:08.649871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d894a3b-c7da-4da2-ba05-3dc3c082d91f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:08.650984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d894a3b-c7da-4da2-ba05-3dc3c082d91f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:08.651719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d894a3b-c7da-4da2-ba05-3dc3c082d91f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:08.652147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d894a3b-c7da-4da2-ba05-3dc3c082d91f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:08.838610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d894a3b-c7da-4da2-ba05-3dc3c082d91f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:08.857947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4d894a3b-c7da-4da2-ba05-3dc3c082d91f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.218479 Oct 28 20:20:08.857947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1009/2005] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:08 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:08.858129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a2ace178-8e92-4850-a6f5-4d9c405903a6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:08.859743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a2ace178-8e92-4850-a6f5-4d9c405903a6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:08.871081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2ace178-8e92-4850-a6f5-4d9c405903a6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:08.876129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2ace178-8e92-4850-a6f5-4d9c405903a6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:08.876585 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2ace178-8e92-4850-a6f5-4d9c405903a6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:08.877315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2ace178-8e92-4850-a6f5-4d9c405903a6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:08.877793 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2ace178-8e92-4850-a6f5-4d9c405903a6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:08.878244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2ace178-8e92-4850-a6f5-4d9c405903a6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:09.054269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a2ace178-8e92-4850-a6f5-4d9c405903a6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:09.063530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a2ace178-8e92-4850-a6f5-4d9c405903a6 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.212245 Oct 28 20:20:09.072819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 997/2006] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:08 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:09.178534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7f99b6a2-adda-429b-a256-881b4ab0d0d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:09.180701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7f99b6a2-adda-429b-a256-881b4ab0d0d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:09.191585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f99b6a2-adda-429b-a256-881b4ab0d0d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:09.192079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f99b6a2-adda-429b-a256-881b4ab0d0d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:09.192829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f99b6a2-adda-429b-a256-881b4ab0d0d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:09.194116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f99b6a2-adda-429b-a256-881b4ab0d0d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:09.194731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f99b6a2-adda-429b-a256-881b4ab0d0d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:09.195497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f99b6a2-adda-429b-a256-881b4ab0d0d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:09.236587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7f99b6a2-adda-429b-a256-881b4ab0d0d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061843 Oct 28 20:20:09.237561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1010/2007] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:09 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:09.884122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b46298b5-e935-4cda-93e0-4e21d250e3cb tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:09.885853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b46298b5-e935-4cda-93e0-4e21d250e3cb tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:09.895306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b46298b5-e935-4cda-93e0-4e21d250e3cb tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:09.896022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b46298b5-e935-4cda-93e0-4e21d250e3cb tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:09.896673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b46298b5-e935-4cda-93e0-4e21d250e3cb tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:09.899464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b46298b5-e935-4cda-93e0-4e21d250e3cb tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:09.900417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b46298b5-e935-4cda-93e0-4e21d250e3cb tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:09.900925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b46298b5-e935-4cda-93e0-4e21d250e3cb tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:10.090696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ba5c2582-cf4d-4904-9470-fb9066e49eb0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:10.091942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ba5c2582-cf4d-4904-9470-fb9066e49eb0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:10.108851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5c2582-cf4d-4904-9470-fb9066e49eb0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:10.109378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5c2582-cf4d-4904-9470-fb9066e49eb0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:10.110021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5c2582-cf4d-4904-9470-fb9066e49eb0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:10.113567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5c2582-cf4d-4904-9470-fb9066e49eb0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:10.113567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5c2582-cf4d-4904-9470-fb9066e49eb0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:10.113567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5c2582-cf4d-4904-9470-fb9066e49eb0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:10.218765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b46298b5-e935-4cda-93e0-4e21d250e3cb tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:10.233675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b46298b5-e935-4cda-93e0-4e21d250e3cb tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.350248 Oct 28 20:20:10.239223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 998/2008] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:09 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:10.266860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2a346de5-d162-45e9-90d1-387ba055248c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:10.266860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2a346de5-d162-45e9-90d1-387ba055248c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:10.275053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a346de5-d162-45e9-90d1-387ba055248c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:10.276189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a346de5-d162-45e9-90d1-387ba055248c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:10.277388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a346de5-d162-45e9-90d1-387ba055248c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:10.278483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a346de5-d162-45e9-90d1-387ba055248c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:10.280009 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a346de5-d162-45e9-90d1-387ba055248c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:10.280712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a346de5-d162-45e9-90d1-387ba055248c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:10.320664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2a346de5-d162-45e9-90d1-387ba055248c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073410 Oct 28 20:20:10.325792 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 999/2009] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:10 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:10.409804 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba5c2582-cf4d-4904-9470-fb9066e49eb0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:10.428911 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ba5c2582-cf4d-4904-9470-fb9066e49eb0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.345329 Oct 28 20:20:10.430649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1011/2010] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:10 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:11.262762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca6616ef-e817-4393-914e-dfd721f9e537 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:11.263609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ca6616ef-e817-4393-914e-dfd721f9e537 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:11.270355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca6616ef-e817-4393-914e-dfd721f9e537 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:11.273118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca6616ef-e817-4393-914e-dfd721f9e537 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:11.273118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca6616ef-e817-4393-914e-dfd721f9e537 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:11.273118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca6616ef-e817-4393-914e-dfd721f9e537 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:11.273118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca6616ef-e817-4393-914e-dfd721f9e537 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:11.273626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca6616ef-e817-4393-914e-dfd721f9e537 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:11.336461 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0961bcfa-93d1-4f3d-9288-f559f5cb7065 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:11.339901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0961bcfa-93d1-4f3d-9288-f559f5cb7065 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:11.358636 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0961bcfa-93d1-4f3d-9288-f559f5cb7065 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:11.366706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0961bcfa-93d1-4f3d-9288-f559f5cb7065 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:11.367322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0961bcfa-93d1-4f3d-9288-f559f5cb7065 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:11.368199 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0961bcfa-93d1-4f3d-9288-f559f5cb7065 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:11.368762 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0961bcfa-93d1-4f3d-9288-f559f5cb7065 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:11.369281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0961bcfa-93d1-4f3d-9288-f559f5cb7065 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:11.439545 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0961bcfa-93d1-4f3d-9288-f559f5cb7065 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110384 Oct 28 20:20:11.444631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1012/2011] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:11 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:11.457634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c878c53f-cd16-4711-bfaf-1fab2c6e3390 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:11.458740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c878c53f-cd16-4711-bfaf-1fab2c6e3390 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:11.468682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c878c53f-cd16-4711-bfaf-1fab2c6e3390 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:11.469459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c878c53f-cd16-4711-bfaf-1fab2c6e3390 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:11.470107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c878c53f-cd16-4711-bfaf-1fab2c6e3390 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:11.471635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c878c53f-cd16-4711-bfaf-1fab2c6e3390 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:11.473082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c878c53f-cd16-4711-bfaf-1fab2c6e3390 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:11.475915 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c878c53f-cd16-4711-bfaf-1fab2c6e3390 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:11.549414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ca6616ef-e817-4393-914e-dfd721f9e537 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:11.568355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ca6616ef-e817-4393-914e-dfd721f9e537 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.309417 Oct 28 20:20:11.569525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1000/2012] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:11 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:11.704309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c878c53f-cd16-4711-bfaf-1fab2c6e3390 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:11.715293 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c878c53f-cd16-4711-bfaf-1fab2c6e3390 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.263137 Oct 28 20:20:11.716887 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1013/2013] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:11 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:12.456608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0a13cfc-fe78-416e-90b8-035165f39675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:12.458859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0a13cfc-fe78-416e-90b8-035165f39675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:12.465525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a13cfc-fe78-416e-90b8-035165f39675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:12.466033 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a13cfc-fe78-416e-90b8-035165f39675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:12.467258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a13cfc-fe78-416e-90b8-035165f39675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:12.467964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a13cfc-fe78-416e-90b8-035165f39675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:12.468524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a13cfc-fe78-416e-90b8-035165f39675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:12.468852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a13cfc-fe78-416e-90b8-035165f39675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:12.501941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0a13cfc-fe78-416e-90b8-035165f39675 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049218 Oct 28 20:20:12.506917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1001/2014] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:12 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:12.593693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-829d81a7-b221-4ae9-acf4-2f3c6d0dd224 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:12.594345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-829d81a7-b221-4ae9-acf4-2f3c6d0dd224 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:12.601214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-829d81a7-b221-4ae9-acf4-2f3c6d0dd224 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:12.601736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-829d81a7-b221-4ae9-acf4-2f3c6d0dd224 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:12.602170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-829d81a7-b221-4ae9-acf4-2f3c6d0dd224 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:12.602865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-829d81a7-b221-4ae9-acf4-2f3c6d0dd224 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:12.603322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-829d81a7-b221-4ae9-acf4-2f3c6d0dd224 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:12.603746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-829d81a7-b221-4ae9-acf4-2f3c6d0dd224 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:12.739074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6038864e-ac23-41ff-87cb-bc68deeabeb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:12.739694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6038864e-ac23-41ff-87cb-bc68deeabeb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:12.748831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6038864e-ac23-41ff-87cb-bc68deeabeb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:12.749346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6038864e-ac23-41ff-87cb-bc68deeabeb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:12.749791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6038864e-ac23-41ff-87cb-bc68deeabeb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:12.750499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6038864e-ac23-41ff-87cb-bc68deeabeb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:12.750962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6038864e-ac23-41ff-87cb-bc68deeabeb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:12.751400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6038864e-ac23-41ff-87cb-bc68deeabeb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:12.930194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-829d81a7-b221-4ae9-acf4-2f3c6d0dd224 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:12.946620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-829d81a7-b221-4ae9-acf4-2f3c6d0dd224 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.358124 Oct 28 20:20:12.962156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1014/2015] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:12 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:13.089028 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6038864e-ac23-41ff-87cb-bc68deeabeb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:13.100684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6038864e-ac23-41ff-87cb-bc68deeabeb7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.365430 Oct 28 20:20:13.113817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1002/2016] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:12 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:13.516046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc0c241c-1252-4761-9eff-368491a6c122 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:13.518356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dc0c241c-1252-4761-9eff-368491a6c122 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:13.524439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0c241c-1252-4761-9eff-368491a6c122 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:13.526119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0c241c-1252-4761-9eff-368491a6c122 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:13.526565 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0c241c-1252-4761-9eff-368491a6c122 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:13.527422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0c241c-1252-4761-9eff-368491a6c122 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:13.527960 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0c241c-1252-4761-9eff-368491a6c122 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:13.528511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0c241c-1252-4761-9eff-368491a6c122 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:13.558572 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc0c241c-1252-4761-9eff-368491a6c122 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047267 Oct 28 20:20:13.559421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1015/2017] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:13 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:13.971866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2f193591-7fbe-4b1d-932f-c3b342aff90a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:13.972487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2f193591-7fbe-4b1d-932f-c3b342aff90a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:13.978917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f193591-7fbe-4b1d-932f-c3b342aff90a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:13.979408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f193591-7fbe-4b1d-932f-c3b342aff90a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:13.980850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f193591-7fbe-4b1d-932f-c3b342aff90a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:13.980850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f193591-7fbe-4b1d-932f-c3b342aff90a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:13.981152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f193591-7fbe-4b1d-932f-c3b342aff90a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:13.981473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f193591-7fbe-4b1d-932f-c3b342aff90a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:14.124957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e3e6a880-b82c-41b4-a5bf-8aaea779c2b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:14.125850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e3e6a880-b82c-41b4-a5bf-8aaea779c2b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:14.134359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3e6a880-b82c-41b4-a5bf-8aaea779c2b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:14.134850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3e6a880-b82c-41b4-a5bf-8aaea779c2b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:14.135806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3e6a880-b82c-41b4-a5bf-8aaea779c2b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:14.136956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3e6a880-b82c-41b4-a5bf-8aaea779c2b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:14.141862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3e6a880-b82c-41b4-a5bf-8aaea779c2b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:14.141862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3e6a880-b82c-41b4-a5bf-8aaea779c2b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:14.326588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2f193591-7fbe-4b1d-932f-c3b342aff90a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:14.335518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2f193591-7fbe-4b1d-932f-c3b342aff90a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.367677 Oct 28 20:20:14.343717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1003/2018] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:13 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:14.457821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e3e6a880-b82c-41b4-a5bf-8aaea779c2b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:14.470468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e3e6a880-b82c-41b4-a5bf-8aaea779c2b2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.349874 Oct 28 20:20:14.471639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1016/2019] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:14 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:14.572494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-face474a-b038-42fe-b7ef-708207feedde tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:14.574960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-face474a-b038-42fe-b7ef-708207feedde tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:14.582192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-face474a-b038-42fe-b7ef-708207feedde tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:14.583106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-face474a-b038-42fe-b7ef-708207feedde tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:14.583547 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-face474a-b038-42fe-b7ef-708207feedde tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:14.584506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-face474a-b038-42fe-b7ef-708207feedde tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:14.585138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-face474a-b038-42fe-b7ef-708207feedde tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:14.585767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-face474a-b038-42fe-b7ef-708207feedde tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:14.621243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-face474a-b038-42fe-b7ef-708207feedde tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053222 Oct 28 20:20:14.622571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1004/2020] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:14 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:15.359976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc2926a4-e8a1-4759-a9c5-1fd9c7cd8886 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:15.360758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dc2926a4-e8a1-4759-a9c5-1fd9c7cd8886 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:15.367949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc2926a4-e8a1-4759-a9c5-1fd9c7cd8886 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:15.368524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc2926a4-e8a1-4759-a9c5-1fd9c7cd8886 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:15.369506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc2926a4-e8a1-4759-a9c5-1fd9c7cd8886 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:15.370529 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc2926a4-e8a1-4759-a9c5-1fd9c7cd8886 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:15.371209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc2926a4-e8a1-4759-a9c5-1fd9c7cd8886 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:15.371992 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc2926a4-e8a1-4759-a9c5-1fd9c7cd8886 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:15.494434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a47d96bf-1662-4e9f-8281-3ec4ef7b1449 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:15.495063 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a47d96bf-1662-4e9f-8281-3ec4ef7b1449 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:15.503210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a47d96bf-1662-4e9f-8281-3ec4ef7b1449 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:15.503702 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a47d96bf-1662-4e9f-8281-3ec4ef7b1449 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:15.504145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a47d96bf-1662-4e9f-8281-3ec4ef7b1449 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:15.504849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a47d96bf-1662-4e9f-8281-3ec4ef7b1449 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:15.505308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a47d96bf-1662-4e9f-8281-3ec4ef7b1449 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:15.506142 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a47d96bf-1662-4e9f-8281-3ec4ef7b1449 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:15.591920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dc2926a4-e8a1-4759-a9c5-1fd9c7cd8886 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:15.600418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc2926a4-e8a1-4759-a9c5-1fd9c7cd8886 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.245760 Oct 28 20:20:15.601156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1017/2021] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:15 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:15.633552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-963eb6e0-a92d-4413-b887-810362e83125 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:15.635854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-963eb6e0-a92d-4413-b887-810362e83125 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:15.642548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-963eb6e0-a92d-4413-b887-810362e83125 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:15.643126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-963eb6e0-a92d-4413-b887-810362e83125 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:15.643629 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-963eb6e0-a92d-4413-b887-810362e83125 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:15.644396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-963eb6e0-a92d-4413-b887-810362e83125 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:15.645110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-963eb6e0-a92d-4413-b887-810362e83125 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:15.645624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-963eb6e0-a92d-4413-b887-810362e83125 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:15.666881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:15.704572 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-963eb6e0-a92d-4413-b887-810362e83125 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074980 Oct 28 20:20:15.710429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1018/2022] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:15 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:20:15.749182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a47d96bf-1662-4e9f-8281-3ec4ef7b1449 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:15.762357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a47d96bf-1662-4e9f-8281-3ec4ef7b1449 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.272496 Oct 28 20:20:15.763083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1005/2023] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:15 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:16.625856 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c942937b-27c3-4799-aa3c-7211331e8c07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:16.626689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c942937b-27c3-4799-aa3c-7211331e8c07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:16.634113 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c942937b-27c3-4799-aa3c-7211331e8c07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:16.634915 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c942937b-27c3-4799-aa3c-7211331e8c07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:16.635428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c942937b-27c3-4799-aa3c-7211331e8c07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:16.636376 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c942937b-27c3-4799-aa3c-7211331e8c07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:16.636909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c942937b-27c3-4799-aa3c-7211331e8c07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:16.637513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c942937b-27c3-4799-aa3c-7211331e8c07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:16.719166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ae9a79ff-98e7-46d4-87e7-8eecf6466a3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:16.721670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ae9a79ff-98e7-46d4-87e7-8eecf6466a3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:16.729128 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae9a79ff-98e7-46d4-87e7-8eecf6466a3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:16.732141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae9a79ff-98e7-46d4-87e7-8eecf6466a3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:16.732141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae9a79ff-98e7-46d4-87e7-8eecf6466a3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:16.732141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae9a79ff-98e7-46d4-87e7-8eecf6466a3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:16.732141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae9a79ff-98e7-46d4-87e7-8eecf6466a3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:16.732510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae9a79ff-98e7-46d4-87e7-8eecf6466a3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:16.769098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ae9a79ff-98e7-46d4-87e7-8eecf6466a3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055387 Oct 28 20:20:16.772302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1006/2024] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:16 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:16.790743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9f922830-3d4e-4ad6-b02a-0c28c3f7c859 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:16.791556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9f922830-3d4e-4ad6-b02a-0c28c3f7c859 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:16.807310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f922830-3d4e-4ad6-b02a-0c28c3f7c859 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:16.807310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f922830-3d4e-4ad6-b02a-0c28c3f7c859 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:16.807310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f922830-3d4e-4ad6-b02a-0c28c3f7c859 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:16.807310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f922830-3d4e-4ad6-b02a-0c28c3f7c859 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:16.807757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f922830-3d4e-4ad6-b02a-0c28c3f7c859 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:16.807757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f922830-3d4e-4ad6-b02a-0c28c3f7c859 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:16.831095 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:16.842858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c942937b-27c3-4799-aa3c-7211331e8c07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:16.852451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c942937b-27c3-4799-aa3c-7211331e8c07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.231992 Oct 28 20:20:16.854054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1019/2025] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:16 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:17.055876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9f922830-3d4e-4ad6-b02a-0c28c3f7c859 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:17.064746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9f922830-3d4e-4ad6-b02a-0c28c3f7c859 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.279980 Oct 28 20:20:17.065534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1007/2026] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:16 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:17.782369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4350b3d6-2a77-4e8c-ab4e-ad24bb08f82e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:17.784648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4350b3d6-2a77-4e8c-ab4e-ad24bb08f82e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:17.791264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4350b3d6-2a77-4e8c-ab4e-ad24bb08f82e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:17.791739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4350b3d6-2a77-4e8c-ab4e-ad24bb08f82e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:17.792169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4350b3d6-2a77-4e8c-ab4e-ad24bb08f82e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:17.792892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4350b3d6-2a77-4e8c-ab4e-ad24bb08f82e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:17.793476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4350b3d6-2a77-4e8c-ab4e-ad24bb08f82e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:17.793928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4350b3d6-2a77-4e8c-ab4e-ad24bb08f82e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:17.824901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4350b3d6-2a77-4e8c-ab4e-ad24bb08f82e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047415 Oct 28 20:20:17.825725 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1020/2027] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:17 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:17.878479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-62c55f71-800b-425b-ba59-c9ade1d28b99 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:17.879099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-62c55f71-800b-425b-ba59-c9ade1d28b99 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:17.885665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62c55f71-800b-425b-ba59-c9ade1d28b99 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:17.886152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62c55f71-800b-425b-ba59-c9ade1d28b99 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:17.886610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62c55f71-800b-425b-ba59-c9ade1d28b99 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:17.887297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62c55f71-800b-425b-ba59-c9ade1d28b99 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:17.888126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62c55f71-800b-425b-ba59-c9ade1d28b99 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:17.888659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62c55f71-800b-425b-ba59-c9ade1d28b99 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:18.021887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-62c55f71-800b-425b-ba59-c9ade1d28b99 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:18.032577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-62c55f71-800b-425b-ba59-c9ade1d28b99 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.157941 Oct 28 20:20:18.033262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1008/2028] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:17 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:18.088780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d937c627-b5d7-43fd-8b91-8e3305b7e611 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:18.089342 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d937c627-b5d7-43fd-8b91-8e3305b7e611 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:18.095879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d937c627-b5d7-43fd-8b91-8e3305b7e611 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:18.097593 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d937c627-b5d7-43fd-8b91-8e3305b7e611 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:18.098206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d937c627-b5d7-43fd-8b91-8e3305b7e611 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:18.098933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d937c627-b5d7-43fd-8b91-8e3305b7e611 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:18.099496 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d937c627-b5d7-43fd-8b91-8e3305b7e611 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:18.100015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d937c627-b5d7-43fd-8b91-8e3305b7e611 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:18.234974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d937c627-b5d7-43fd-8b91-8e3305b7e611 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:18.243222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d937c627-b5d7-43fd-8b91-8e3305b7e611 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.158687 Oct 28 20:20:18.243808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1021/2029] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:18 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:18.837849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d54875a7-2d16-4a23-bd99-9da3e78eb406 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:18.840130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d54875a7-2d16-4a23-bd99-9da3e78eb406 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:18.850708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d54875a7-2d16-4a23-bd99-9da3e78eb406 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:18.850708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d54875a7-2d16-4a23-bd99-9da3e78eb406 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:18.850708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d54875a7-2d16-4a23-bd99-9da3e78eb406 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:18.850708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d54875a7-2d16-4a23-bd99-9da3e78eb406 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:18.851085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d54875a7-2d16-4a23-bd99-9da3e78eb406 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:18.851085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d54875a7-2d16-4a23-bd99-9da3e78eb406 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:18.885269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d54875a7-2d16-4a23-bd99-9da3e78eb406 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051779 Oct 28 20:20:18.890727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1009/2030] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:18 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:19.057976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75262dc0-b33d-48a0-91e8-980d7313d14a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:19.058621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-75262dc0-b33d-48a0-91e8-980d7313d14a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:19.065345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75262dc0-b33d-48a0-91e8-980d7313d14a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:19.065899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75262dc0-b33d-48a0-91e8-980d7313d14a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:19.066340 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75262dc0-b33d-48a0-91e8-980d7313d14a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:19.073798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75262dc0-b33d-48a0-91e8-980d7313d14a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:19.073798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75262dc0-b33d-48a0-91e8-980d7313d14a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:19.073798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75262dc0-b33d-48a0-91e8-980d7313d14a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:19.212568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-75262dc0-b33d-48a0-91e8-980d7313d14a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:19.222931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-75262dc0-b33d-48a0-91e8-980d7313d14a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.168862 Oct 28 20:20:19.223801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1022/2031] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:19 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:19.267980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7d8c80a2-5d0f-4cb5-ab51-5950137c53d7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:19.268579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7d8c80a2-5d0f-4cb5-ab51-5950137c53d7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:19.274764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d8c80a2-5d0f-4cb5-ab51-5950137c53d7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:19.275256 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d8c80a2-5d0f-4cb5-ab51-5950137c53d7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:19.275690 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d8c80a2-5d0f-4cb5-ab51-5950137c53d7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:19.276412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d8c80a2-5d0f-4cb5-ab51-5950137c53d7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:19.276841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d8c80a2-5d0f-4cb5-ab51-5950137c53d7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:19.277260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d8c80a2-5d0f-4cb5-ab51-5950137c53d7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:19.410596 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7d8c80a2-5d0f-4cb5-ab51-5950137c53d7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:19.418646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7d8c80a2-5d0f-4cb5-ab51-5950137c53d7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154730 Oct 28 20:20:19.419235 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1010/2032] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:19 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:19.900872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-973e44dd-41e8-4452-aa81-949d4a55bb75 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:19.903224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-973e44dd-41e8-4452-aa81-949d4a55bb75 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:19.909953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-973e44dd-41e8-4452-aa81-949d4a55bb75 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:19.910440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-973e44dd-41e8-4452-aa81-949d4a55bb75 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:19.913640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-973e44dd-41e8-4452-aa81-949d4a55bb75 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:19.913640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-973e44dd-41e8-4452-aa81-949d4a55bb75 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:19.913640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-973e44dd-41e8-4452-aa81-949d4a55bb75 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:19.913640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-973e44dd-41e8-4452-aa81-949d4a55bb75 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:19.941420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-973e44dd-41e8-4452-aa81-949d4a55bb75 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044491 Oct 28 20:20:19.941970 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1023/2033] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:19 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:20.247451 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d9f5790c-cb6c-4d16-9260-debe1f20cc80 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:20.248050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d9f5790c-cb6c-4d16-9260-debe1f20cc80 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:20.254495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9f5790c-cb6c-4d16-9260-debe1f20cc80 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:20.254983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9f5790c-cb6c-4d16-9260-debe1f20cc80 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:20.255418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9f5790c-cb6c-4d16-9260-debe1f20cc80 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:20.256105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9f5790c-cb6c-4d16-9260-debe1f20cc80 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:20.256557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9f5790c-cb6c-4d16-9260-debe1f20cc80 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:20.256980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9f5790c-cb6c-4d16-9260-debe1f20cc80 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:20.386311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d9f5790c-cb6c-4d16-9260-debe1f20cc80 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:20.395047 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d9f5790c-cb6c-4d16-9260-debe1f20cc80 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151469 Oct 28 20:20:20.395636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1011/2034] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:20 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:20.441620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a46d8a40-2f54-4923-9d71-41f4c36033f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:20.442235 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a46d8a40-2f54-4923-9d71-41f4c36033f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:20.448467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a46d8a40-2f54-4923-9d71-41f4c36033f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:20.448949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a46d8a40-2f54-4923-9d71-41f4c36033f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:20.449417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a46d8a40-2f54-4923-9d71-41f4c36033f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:20.450607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a46d8a40-2f54-4923-9d71-41f4c36033f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:20.451311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a46d8a40-2f54-4923-9d71-41f4c36033f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:20.451498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a46d8a40-2f54-4923-9d71-41f4c36033f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:20.581992 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a46d8a40-2f54-4923-9d71-41f4c36033f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:20.596399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a46d8a40-2f54-4923-9d71-41f4c36033f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.158210 Oct 28 20:20:20.597126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1024/2035] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:20 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:20.953884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37166dff-1696-49cb-a9e4-1072b5f72ca3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:20.956076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-37166dff-1696-49cb-a9e4-1072b5f72ca3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:20.962241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37166dff-1696-49cb-a9e4-1072b5f72ca3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:20.962721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37166dff-1696-49cb-a9e4-1072b5f72ca3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:20.963153 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37166dff-1696-49cb-a9e4-1072b5f72ca3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:20.963835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37166dff-1696-49cb-a9e4-1072b5f72ca3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:20.964281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37166dff-1696-49cb-a9e4-1072b5f72ca3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:20.964700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37166dff-1696-49cb-a9e4-1072b5f72ca3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:20.993879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-37166dff-1696-49cb-a9e4-1072b5f72ca3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Oct 28 20:20:20.994418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1012/2036] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:20 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:20:21.418458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d1a2d926-31b3-4ade-a0ce-f080644df81e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:21.419210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d1a2d926-31b3-4ade-a0ce-f080644df81e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:21.425161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1a2d926-31b3-4ade-a0ce-f080644df81e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:21.425676 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1a2d926-31b3-4ade-a0ce-f080644df81e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:21.426115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1a2d926-31b3-4ade-a0ce-f080644df81e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:21.426801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1a2d926-31b3-4ade-a0ce-f080644df81e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:21.427255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1a2d926-31b3-4ade-a0ce-f080644df81e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:21.427674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1a2d926-31b3-4ade-a0ce-f080644df81e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:21.553381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1a2d926-31b3-4ade-a0ce-f080644df81e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:21.562265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d1a2d926-31b3-4ade-a0ce-f080644df81e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.147737 Oct 28 20:20:21.562826 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1025/2037] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:21 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:21.619924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88b46e56-3e3a-494a-ab10-c5a838d73cca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:21.620493 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-88b46e56-3e3a-494a-ab10-c5a838d73cca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:21.627487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88b46e56-3e3a-494a-ab10-c5a838d73cca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:21.627972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88b46e56-3e3a-494a-ab10-c5a838d73cca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:21.628407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88b46e56-3e3a-494a-ab10-c5a838d73cca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:21.629097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88b46e56-3e3a-494a-ab10-c5a838d73cca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:21.629577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88b46e56-3e3a-494a-ab10-c5a838d73cca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:21.630004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88b46e56-3e3a-494a-ab10-c5a838d73cca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:21.761574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-88b46e56-3e3a-494a-ab10-c5a838d73cca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:21.769893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-88b46e56-3e3a-494a-ab10-c5a838d73cca tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153849 Oct 28 20:20:21.770455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1013/2038] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:21 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:22.005924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9b3d8bb8-4c46-438f-a426-b1cc4687f6c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:22.008072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9b3d8bb8-4c46-438f-a426-b1cc4687f6c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:22.014786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b3d8bb8-4c46-438f-a426-b1cc4687f6c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:22.015273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b3d8bb8-4c46-438f-a426-b1cc4687f6c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:22.015712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b3d8bb8-4c46-438f-a426-b1cc4687f6c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:22.016402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b3d8bb8-4c46-438f-a426-b1cc4687f6c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:22.016859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b3d8bb8-4c46-438f-a426-b1cc4687f6c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:22.017279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b3d8bb8-4c46-438f-a426-b1cc4687f6c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:22.046912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9b3d8bb8-4c46-438f-a426-b1cc4687f6c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044847 Oct 28 20:20:22.047463 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1026/2039] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:22 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:22.585921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a0372cf-93bb-4efa-876a-876e3225d3dd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:22.586467 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3a0372cf-93bb-4efa-876a-876e3225d3dd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:22.595016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0372cf-93bb-4efa-876a-876e3225d3dd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:22.595659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0372cf-93bb-4efa-876a-876e3225d3dd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:22.597755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0372cf-93bb-4efa-876a-876e3225d3dd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:22.598507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0372cf-93bb-4efa-876a-876e3225d3dd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:22.598981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0372cf-93bb-4efa-876a-876e3225d3dd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:22.599421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0372cf-93bb-4efa-876a-876e3225d3dd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:22.740747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a0372cf-93bb-4efa-876a-876e3225d3dd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:22.740747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a0372cf-93bb-4efa-876a-876e3225d3dd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.157868 Oct 28 20:20:22.740747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1014/2040] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:22 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:22.792010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9ce047bd-8d0a-4258-95c3-cb0e481c6191 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:22.792626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9ce047bd-8d0a-4258-95c3-cb0e481c6191 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:22.799620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ce047bd-8d0a-4258-95c3-cb0e481c6191 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:22.800139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ce047bd-8d0a-4258-95c3-cb0e481c6191 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:22.800584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ce047bd-8d0a-4258-95c3-cb0e481c6191 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:22.801278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ce047bd-8d0a-4258-95c3-cb0e481c6191 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:22.801866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ce047bd-8d0a-4258-95c3-cb0e481c6191 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:22.802296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ce047bd-8d0a-4258-95c3-cb0e481c6191 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:22.935858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9ce047bd-8d0a-4258-95c3-cb0e481c6191 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:22.944090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9ce047bd-8d0a-4258-95c3-cb0e481c6191 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155835 Oct 28 20:20:22.944665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1027/2041] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:22 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:23.059285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eca81221-69bf-4fe3-b490-872a44c39e01 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:23.061664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eca81221-69bf-4fe3-b490-872a44c39e01 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:23.067577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eca81221-69bf-4fe3-b490-872a44c39e01 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:23.068063 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eca81221-69bf-4fe3-b490-872a44c39e01 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:23.068506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eca81221-69bf-4fe3-b490-872a44c39e01 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:23.069201 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eca81221-69bf-4fe3-b490-872a44c39e01 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:23.069696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eca81221-69bf-4fe3-b490-872a44c39e01 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:23.070127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eca81221-69bf-4fe3-b490-872a44c39e01 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:23.099290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eca81221-69bf-4fe3-b490-872a44c39e01 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044032 Oct 28 20:20:23.099836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1015/2042] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:23 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:23.764653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ae1d94a9-11e0-408e-ae59-56f8a91fe95a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:23.765281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ae1d94a9-11e0-408e-ae59-56f8a91fe95a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:23.771346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae1d94a9-11e0-408e-ae59-56f8a91fe95a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:23.771831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae1d94a9-11e0-408e-ae59-56f8a91fe95a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:23.772268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae1d94a9-11e0-408e-ae59-56f8a91fe95a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:23.772966 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae1d94a9-11e0-408e-ae59-56f8a91fe95a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:23.773444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae1d94a9-11e0-408e-ae59-56f8a91fe95a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:23.773875 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae1d94a9-11e0-408e-ae59-56f8a91fe95a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:23.904549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ae1d94a9-11e0-408e-ae59-56f8a91fe95a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:23.912770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ae1d94a9-11e0-408e-ae59-56f8a91fe95a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152996 Oct 28 20:20:23.913348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1028/2043] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:23 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:23.967342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f0864269-7df0-41b4-a421-ba10623f8687 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:23.968005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f0864269-7df0-41b4-a421-ba10623f8687 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:23.974395 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0864269-7df0-41b4-a421-ba10623f8687 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:23.974884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0864269-7df0-41b4-a421-ba10623f8687 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:23.975324 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0864269-7df0-41b4-a421-ba10623f8687 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:23.976018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0864269-7df0-41b4-a421-ba10623f8687 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:23.976482 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0864269-7df0-41b4-a421-ba10623f8687 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:23.976912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0864269-7df0-41b4-a421-ba10623f8687 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:24.110647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f0864269-7df0-41b4-a421-ba10623f8687 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:24.112306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6287f581-0b9b-43da-8d47-6450782ddb64 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:24.114496 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6287f581-0b9b-43da-8d47-6450782ddb64 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:24.119010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f0864269-7df0-41b4-a421-ba10623f8687 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155866 Oct 28 20:20:24.119586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1016/2044] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:23 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:24.120468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6287f581-0b9b-43da-8d47-6450782ddb64 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:24.120975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6287f581-0b9b-43da-8d47-6450782ddb64 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:24.121445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6287f581-0b9b-43da-8d47-6450782ddb64 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:24.122151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6287f581-0b9b-43da-8d47-6450782ddb64 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:24.123317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6287f581-0b9b-43da-8d47-6450782ddb64 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:24.123826 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6287f581-0b9b-43da-8d47-6450782ddb64 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:24.152892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6287f581-0b9b-43da-8d47-6450782ddb64 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044619 Oct 28 20:20:24.153479 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1029/2045] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:24 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:20:24.936576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-954325a7-18eb-4b17-b6b3-caa03eaa7ef7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:24.937197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-954325a7-18eb-4b17-b6b3-caa03eaa7ef7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:24.943266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-954325a7-18eb-4b17-b6b3-caa03eaa7ef7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:24.943751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-954325a7-18eb-4b17-b6b3-caa03eaa7ef7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:24.944189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-954325a7-18eb-4b17-b6b3-caa03eaa7ef7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:24.944944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-954325a7-18eb-4b17-b6b3-caa03eaa7ef7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:24.945510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-954325a7-18eb-4b17-b6b3-caa03eaa7ef7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:24.945945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-954325a7-18eb-4b17-b6b3-caa03eaa7ef7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:25.073659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-954325a7-18eb-4b17-b6b3-caa03eaa7ef7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:25.082714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-954325a7-18eb-4b17-b6b3-caa03eaa7ef7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150349 Oct 28 20:20:25.083277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1017/2046] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:24 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:25.142280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc4c32b2-e1d3-4364-87f7-0c6e72f79e40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:25.142884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bc4c32b2-e1d3-4364-87f7-0c6e72f79e40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:25.149116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc4c32b2-e1d3-4364-87f7-0c6e72f79e40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:25.149625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc4c32b2-e1d3-4364-87f7-0c6e72f79e40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:25.150057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc4c32b2-e1d3-4364-87f7-0c6e72f79e40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:25.150737 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc4c32b2-e1d3-4364-87f7-0c6e72f79e40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:25.151184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc4c32b2-e1d3-4364-87f7-0c6e72f79e40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:25.151603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc4c32b2-e1d3-4364-87f7-0c6e72f79e40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:25.165909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f026a393-1f98-489e-b661-5252f9e917c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:25.168153 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f026a393-1f98-489e-b661-5252f9e917c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:25.174996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f026a393-1f98-489e-b661-5252f9e917c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:25.175488 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f026a393-1f98-489e-b661-5252f9e917c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:25.175930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f026a393-1f98-489e-b661-5252f9e917c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:25.176630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f026a393-1f98-489e-b661-5252f9e917c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:25.177085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f026a393-1f98-489e-b661-5252f9e917c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:25.177550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f026a393-1f98-489e-b661-5252f9e917c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:25.208817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f026a393-1f98-489e-b661-5252f9e917c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046747 Oct 28 20:20:25.209718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1018/2047] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:25 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:20:25.478352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bc4c32b2-e1d3-4364-87f7-0c6e72f79e40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:25.487103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bc4c32b2-e1d3-4364-87f7-0c6e72f79e40 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.348598 Oct 28 20:20:25.487666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1030/2048] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:25 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:26.106873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f7a5242b-7d8a-4a9b-9cfd-9282529cd16c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:26.107489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f7a5242b-7d8a-4a9b-9cfd-9282529cd16c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:26.113910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7a5242b-7d8a-4a9b-9cfd-9282529cd16c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:26.114393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7a5242b-7d8a-4a9b-9cfd-9282529cd16c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:26.114834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7a5242b-7d8a-4a9b-9cfd-9282529cd16c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:26.115522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7a5242b-7d8a-4a9b-9cfd-9282529cd16c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:26.115978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7a5242b-7d8a-4a9b-9cfd-9282529cd16c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:26.116454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7a5242b-7d8a-4a9b-9cfd-9282529cd16c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:26.220924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d9e58e3a-4990-4af8-a2af-3d4c843eadd8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:26.223343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d9e58e3a-4990-4af8-a2af-3d4c843eadd8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:26.230174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9e58e3a-4990-4af8-a2af-3d4c843eadd8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:26.230805 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9e58e3a-4990-4af8-a2af-3d4c843eadd8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:26.231247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9e58e3a-4990-4af8-a2af-3d4c843eadd8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:26.231991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9e58e3a-4990-4af8-a2af-3d4c843eadd8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:26.232450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9e58e3a-4990-4af8-a2af-3d4c843eadd8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:26.232870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9e58e3a-4990-4af8-a2af-3d4c843eadd8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:26.266761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d9e58e3a-4990-4af8-a2af-3d4c843eadd8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049833 Oct 28 20:20:26.267550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1031/2049] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:26 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:20:26.492110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f7a5242b-7d8a-4a9b-9cfd-9282529cd16c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:26.500166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f7a5242b-7d8a-4a9b-9cfd-9282529cd16c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.397171 Oct 28 20:20:26.500731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1019/2050] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:26 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:26.509893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-56a4d445-0585-481a-ac15-004161bb09c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:26.510509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-56a4d445-0585-481a-ac15-004161bb09c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:26.516454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56a4d445-0585-481a-ac15-004161bb09c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:26.516940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56a4d445-0585-481a-ac15-004161bb09c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:26.517423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56a4d445-0585-481a-ac15-004161bb09c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:26.518118 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56a4d445-0585-481a-ac15-004161bb09c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:26.518575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56a4d445-0585-481a-ac15-004161bb09c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:26.519002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56a4d445-0585-481a-ac15-004161bb09c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:26.646847 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-56a4d445-0585-481a-ac15-004161bb09c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:26.655771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-56a4d445-0585-481a-ac15-004161bb09c5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149652 Oct 28 20:20:26.656336 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1032/2051] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:26 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:27.279993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-416c0e4a-ccca-40d1-94a5-f48d09386842 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:27.282220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-416c0e4a-ccca-40d1-94a5-f48d09386842 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:27.288534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-416c0e4a-ccca-40d1-94a5-f48d09386842 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:27.289007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-416c0e4a-ccca-40d1-94a5-f48d09386842 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:27.289466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-416c0e4a-ccca-40d1-94a5-f48d09386842 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:27.290146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-416c0e4a-ccca-40d1-94a5-f48d09386842 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:27.290594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-416c0e4a-ccca-40d1-94a5-f48d09386842 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:27.291012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-416c0e4a-ccca-40d1-94a5-f48d09386842 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:27.319397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-416c0e4a-ccca-40d1-94a5-f48d09386842 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044074 Oct 28 20:20:27.319946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1020/2052] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:27 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:27.523940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a34d07c0-d8ac-4acc-91e1-2cb498e53986 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:27.524514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a34d07c0-d8ac-4acc-91e1-2cb498e53986 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:27.530956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a34d07c0-d8ac-4acc-91e1-2cb498e53986 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:27.531434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a34d07c0-d8ac-4acc-91e1-2cb498e53986 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:27.531866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a34d07c0-d8ac-4acc-91e1-2cb498e53986 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:27.532554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a34d07c0-d8ac-4acc-91e1-2cb498e53986 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:27.533005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a34d07c0-d8ac-4acc-91e1-2cb498e53986 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:27.533459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a34d07c0-d8ac-4acc-91e1-2cb498e53986 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:27.661366 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a34d07c0-d8ac-4acc-91e1-2cb498e53986 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:27.669522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a34d07c0-d8ac-4acc-91e1-2cb498e53986 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149494 Oct 28 20:20:27.670076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1033/2053] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:27 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:27.680024 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c606ac30-e9a9-47c9-873a-30b67823fc74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:27.680634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c606ac30-e9a9-47c9-873a-30b67823fc74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:27.687365 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c606ac30-e9a9-47c9-873a-30b67823fc74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:27.687852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c606ac30-e9a9-47c9-873a-30b67823fc74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:27.688296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c606ac30-e9a9-47c9-873a-30b67823fc74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:27.688989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c606ac30-e9a9-47c9-873a-30b67823fc74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:27.689487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c606ac30-e9a9-47c9-873a-30b67823fc74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:27.689918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c606ac30-e9a9-47c9-873a-30b67823fc74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:27.816125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c606ac30-e9a9-47c9-873a-30b67823fc74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:27.824173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c606ac30-e9a9-47c9-873a-30b67823fc74 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.148201 Oct 28 20:20:27.824733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1021/2054] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:27 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:28.331358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-517b1923-3a08-4cc1-882d-4c2e6bbe6062 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:28.333524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-517b1923-3a08-4cc1-882d-4c2e6bbe6062 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:28.339718 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-517b1923-3a08-4cc1-882d-4c2e6bbe6062 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:28.340189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-517b1923-3a08-4cc1-882d-4c2e6bbe6062 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:28.340617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-517b1923-3a08-4cc1-882d-4c2e6bbe6062 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:28.341297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-517b1923-3a08-4cc1-882d-4c2e6bbe6062 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:28.341761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-517b1923-3a08-4cc1-882d-4c2e6bbe6062 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:28.342183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-517b1923-3a08-4cc1-882d-4c2e6bbe6062 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:28.370476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-517b1923-3a08-4cc1-882d-4c2e6bbe6062 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043015 Oct 28 20:20:28.370954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1034/2055] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:28 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:20:28.694387 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-884983aa-c2af-4b2a-98a0-614ae46309f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:28.695039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-884983aa-c2af-4b2a-98a0-614ae46309f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:28.702107 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-884983aa-c2af-4b2a-98a0-614ae46309f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:28.702586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-884983aa-c2af-4b2a-98a0-614ae46309f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:28.703015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-884983aa-c2af-4b2a-98a0-614ae46309f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:28.703706 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-884983aa-c2af-4b2a-98a0-614ae46309f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:28.704162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-884983aa-c2af-4b2a-98a0-614ae46309f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:28.704581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-884983aa-c2af-4b2a-98a0-614ae46309f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:28.847837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7f94f5d3-40e4-4da5-939d-c60859daf08f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:28.848589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7f94f5d3-40e4-4da5-939d-c60859daf08f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:28.855351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f94f5d3-40e4-4da5-939d-c60859daf08f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:28.855934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f94f5d3-40e4-4da5-939d-c60859daf08f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:28.857006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f94f5d3-40e4-4da5-939d-c60859daf08f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:28.857792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f94f5d3-40e4-4da5-939d-c60859daf08f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:28.858249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f94f5d3-40e4-4da5-939d-c60859daf08f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:28.858676 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f94f5d3-40e4-4da5-939d-c60859daf08f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:28.863712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:28.898359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-884983aa-c2af-4b2a-98a0-614ae46309f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:28.906775 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-884983aa-c2af-4b2a-98a0-614ae46309f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.217482 Oct 28 20:20:28.907428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1022/2056] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:28 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:29.000175 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7f94f5d3-40e4-4da5-939d-c60859daf08f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:29.008627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7f94f5d3-40e4-4da5-939d-c60859daf08f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.164742 Oct 28 20:20:29.009190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1035/2057] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:28 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:29.383394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84e5955a-ec07-4760-88a4-14e0d14f91ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:29.385582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-84e5955a-ec07-4760-88a4-14e0d14f91ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:29.391747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84e5955a-ec07-4760-88a4-14e0d14f91ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:29.392232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84e5955a-ec07-4760-88a4-14e0d14f91ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:29.392670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84e5955a-ec07-4760-88a4-14e0d14f91ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:29.393392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84e5955a-ec07-4760-88a4-14e0d14f91ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:29.393849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84e5955a-ec07-4760-88a4-14e0d14f91ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:29.394281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84e5955a-ec07-4760-88a4-14e0d14f91ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:29.423243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-84e5955a-ec07-4760-88a4-14e0d14f91ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043867 Oct 28 20:20:29.423797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1023/2058] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:29 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:29.931559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d3450d13-7ac0-4858-b8d5-dc0a66814742 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:29.932170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d3450d13-7ac0-4858-b8d5-dc0a66814742 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:29.939049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3450d13-7ac0-4858-b8d5-dc0a66814742 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:29.939607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3450d13-7ac0-4858-b8d5-dc0a66814742 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:29.940057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3450d13-7ac0-4858-b8d5-dc0a66814742 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:29.940773 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3450d13-7ac0-4858-b8d5-dc0a66814742 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:29.941228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3450d13-7ac0-4858-b8d5-dc0a66814742 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:29.941686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3450d13-7ac0-4858-b8d5-dc0a66814742 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:30.039084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34482687-af00-4de2-a0f6-27484047197f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:30.039084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-34482687-af00-4de2-a0f6-27484047197f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:30.041389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34482687-af00-4de2-a0f6-27484047197f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:30.041874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34482687-af00-4de2-a0f6-27484047197f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:30.042307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34482687-af00-4de2-a0f6-27484047197f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:30.043051 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34482687-af00-4de2-a0f6-27484047197f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:30.043508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34482687-af00-4de2-a0f6-27484047197f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:30.044546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34482687-af00-4de2-a0f6-27484047197f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:30.048786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:30.080407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d3450d13-7ac0-4858-b8d5-dc0a66814742 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:30.089139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d3450d13-7ac0-4858-b8d5-dc0a66814742 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.161725 Oct 28 20:20:30.091601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1036/2059] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:29 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:30.182053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-34482687-af00-4de2-a0f6-27484047197f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:30.190692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34482687-af00-4de2-a0f6-27484047197f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.160315 Oct 28 20:20:30.191259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1024/2060] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:30 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:30.435763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1587b444-7e1e-4080-a38d-d42a12b8dcbd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:30.437881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1587b444-7e1e-4080-a38d-d42a12b8dcbd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:30.443667 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1587b444-7e1e-4080-a38d-d42a12b8dcbd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:30.444137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1587b444-7e1e-4080-a38d-d42a12b8dcbd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:30.444568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1587b444-7e1e-4080-a38d-d42a12b8dcbd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:30.445239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1587b444-7e1e-4080-a38d-d42a12b8dcbd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:30.445714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1587b444-7e1e-4080-a38d-d42a12b8dcbd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:30.446131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1587b444-7e1e-4080-a38d-d42a12b8dcbd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:30.476273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1587b444-7e1e-4080-a38d-d42a12b8dcbd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Oct 28 20:20:30.476826 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1037/2061] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:30 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:31.112872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cea5204d-dd14-46f7-8dff-4cad828fc40b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:31.113514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cea5204d-dd14-46f7-8dff-4cad828fc40b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:31.120042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cea5204d-dd14-46f7-8dff-4cad828fc40b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:31.120525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cea5204d-dd14-46f7-8dff-4cad828fc40b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:31.120960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cea5204d-dd14-46f7-8dff-4cad828fc40b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:31.121676 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cea5204d-dd14-46f7-8dff-4cad828fc40b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:31.122335 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cea5204d-dd14-46f7-8dff-4cad828fc40b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:31.122811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cea5204d-dd14-46f7-8dff-4cad828fc40b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:31.213828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2f1f9dd1-e180-486f-8491-f664f91b9df9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:31.214998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2f1f9dd1-e180-486f-8491-f664f91b9df9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:31.222579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f1f9dd1-e180-486f-8491-f664f91b9df9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:31.223062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f1f9dd1-e180-486f-8491-f664f91b9df9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:31.223498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f1f9dd1-e180-486f-8491-f664f91b9df9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:31.224645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f1f9dd1-e180-486f-8491-f664f91b9df9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:31.224645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f1f9dd1-e180-486f-8491-f664f91b9df9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:31.225032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f1f9dd1-e180-486f-8491-f664f91b9df9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:31.258079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-cea5204d-dd14-46f7-8dff-4cad828fc40b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:31.266810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cea5204d-dd14-46f7-8dff-4cad828fc40b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.157777 Oct 28 20:20:31.267381 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1025/2062] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:31 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:31.358059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2f1f9dd1-e180-486f-8491-f664f91b9df9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:31.366770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2f1f9dd1-e180-486f-8491-f664f91b9df9 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.156321 Oct 28 20:20:31.373568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1038/2063] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:31 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:31.488040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a9a49af1-f942-4159-9e1e-425f19784c1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:31.490215 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a9a49af1-f942-4159-9e1e-425f19784c1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:31.496248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9a49af1-f942-4159-9e1e-425f19784c1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:31.496732 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9a49af1-f942-4159-9e1e-425f19784c1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:31.497715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9a49af1-f942-4159-9e1e-425f19784c1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:31.498508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9a49af1-f942-4159-9e1e-425f19784c1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:31.498968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9a49af1-f942-4159-9e1e-425f19784c1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:31.499396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9a49af1-f942-4159-9e1e-425f19784c1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:31.528695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a9a49af1-f942-4159-9e1e-425f19784c1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044567 Oct 28 20:20:31.529238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1026/2064] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:31 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:32.289717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-023e8de1-7878-4807-ab83-fde7d26417cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:32.290271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-023e8de1-7878-4807-ab83-fde7d26417cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:32.298011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-023e8de1-7878-4807-ab83-fde7d26417cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:32.298493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-023e8de1-7878-4807-ab83-fde7d26417cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:32.298932 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-023e8de1-7878-4807-ab83-fde7d26417cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:32.299620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-023e8de1-7878-4807-ab83-fde7d26417cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:32.300099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-023e8de1-7878-4807-ab83-fde7d26417cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:32.300522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-023e8de1-7878-4807-ab83-fde7d26417cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:32.390487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9f8ba2ad-5dab-4687-9cbf-c55d5753c578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:32.391442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9f8ba2ad-5dab-4687-9cbf-c55d5753c578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:32.398157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f8ba2ad-5dab-4687-9cbf-c55d5753c578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:32.398737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f8ba2ad-5dab-4687-9cbf-c55d5753c578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:32.399274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f8ba2ad-5dab-4687-9cbf-c55d5753c578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:32.400132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f8ba2ad-5dab-4687-9cbf-c55d5753c578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:32.400717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f8ba2ad-5dab-4687-9cbf-c55d5753c578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:32.401236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f8ba2ad-5dab-4687-9cbf-c55d5753c578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:32.431741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-023e8de1-7878-4807-ab83-fde7d26417cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:32.440082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-023e8de1-7878-4807-ab83-fde7d26417cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.154199 Oct 28 20:20:32.442641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1039/2065] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:32 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:32.535672 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9f8ba2ad-5dab-4687-9cbf-c55d5753c578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:32.541267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-621d9411-147c-41de-8220-1344970622a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:32.543405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-621d9411-147c-41de-8220-1344970622a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:32.544885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9f8ba2ad-5dab-4687-9cbf-c55d5753c578 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.159296 Oct 28 20:20:32.545472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1027/2066] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:32 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:32.550382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-621d9411-147c-41de-8220-1344970622a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:32.550863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-621d9411-147c-41de-8220-1344970622a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:32.551299 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-621d9411-147c-41de-8220-1344970622a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:32.551992 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-621d9411-147c-41de-8220-1344970622a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:32.552545 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-621d9411-147c-41de-8220-1344970622a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:32.552968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-621d9411-147c-41de-8220-1344970622a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:32.581902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-621d9411-147c-41de-8220-1344970622a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044763 Oct 28 20:20:32.582467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1040/2067] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:32 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:20:33.464679 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3ce50301-b361-4b84-832d-2182e617932f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:33.465378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3ce50301-b361-4b84-832d-2182e617932f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:33.472234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ce50301-b361-4b84-832d-2182e617932f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:33.472723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ce50301-b361-4b84-832d-2182e617932f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:33.473249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ce50301-b361-4b84-832d-2182e617932f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:33.474024 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ce50301-b361-4b84-832d-2182e617932f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:33.474638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ce50301-b361-4b84-832d-2182e617932f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:33.475070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ce50301-b361-4b84-832d-2182e617932f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:33.567891 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc9da55c-faed-4d4e-ab5d-a0d3dd416792 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:33.568593 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dc9da55c-faed-4d4e-ab5d-a0d3dd416792 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:33.575079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc9da55c-faed-4d4e-ab5d-a0d3dd416792 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:33.576453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc9da55c-faed-4d4e-ab5d-a0d3dd416792 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:33.577098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc9da55c-faed-4d4e-ab5d-a0d3dd416792 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:33.577824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc9da55c-faed-4d4e-ab5d-a0d3dd416792 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:33.578309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc9da55c-faed-4d4e-ab5d-a0d3dd416792 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:33.578734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc9da55c-faed-4d4e-ab5d-a0d3dd416792 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:33.610249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3ce50301-b361-4b84-832d-2182e617932f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:33.618593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3ce50301-b361-4b84-832d-2182e617932f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.158024 Oct 28 20:20:33.619167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1028/2068] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:33 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:33.624305 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c07580f-3f47-49d3-bef3-5d32e12530d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:33.626500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7c07580f-3f47-49d3-bef3-5d32e12530d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:33.632286 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c07580f-3f47-49d3-bef3-5d32e12530d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:33.632780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c07580f-3f47-49d3-bef3-5d32e12530d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:33.633218 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c07580f-3f47-49d3-bef3-5d32e12530d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:33.633950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c07580f-3f47-49d3-bef3-5d32e12530d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:33.634410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c07580f-3f47-49d3-bef3-5d32e12530d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:33.634840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c07580f-3f47-49d3-bef3-5d32e12530d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:33.664730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c07580f-3f47-49d3-bef3-5d32e12530d6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044457 Oct 28 20:20:33.665294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1029/2069] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:33 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:33.708907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dc9da55c-faed-4d4e-ab5d-a0d3dd416792 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:33.717730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc9da55c-faed-4d4e-ab5d-a0d3dd416792 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153650 Oct 28 20:20:33.718285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1041/2070] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:33 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:34.642336 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e18c4b4a-5bd6-47ac-b262-eec19fd47072 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:34.642941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e18c4b4a-5bd6-47ac-b262-eec19fd47072 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:34.649692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e18c4b4a-5bd6-47ac-b262-eec19fd47072 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:34.650173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e18c4b4a-5bd6-47ac-b262-eec19fd47072 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:34.650608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e18c4b4a-5bd6-47ac-b262-eec19fd47072 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:34.651345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e18c4b4a-5bd6-47ac-b262-eec19fd47072 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:34.651797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e18c4b4a-5bd6-47ac-b262-eec19fd47072 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:34.652214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e18c4b4a-5bd6-47ac-b262-eec19fd47072 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:34.677790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ffc92c4d-cfd1-4277-81e1-cec97cc07f66 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:34.680839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ffc92c4d-cfd1-4277-81e1-cec97cc07f66 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:34.688358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffc92c4d-cfd1-4277-81e1-cec97cc07f66 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:34.688994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffc92c4d-cfd1-4277-81e1-cec97cc07f66 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:34.689469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffc92c4d-cfd1-4277-81e1-cec97cc07f66 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:34.690194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffc92c4d-cfd1-4277-81e1-cec97cc07f66 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:34.690641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffc92c4d-cfd1-4277-81e1-cec97cc07f66 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:34.691064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffc92c4d-cfd1-4277-81e1-cec97cc07f66 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:34.731420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ffc92c4d-cfd1-4277-81e1-cec97cc07f66 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057380 Oct 28 20:20:34.733042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1042/2071] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:34 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:34.741051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14ba52a5-7e87-46fe-a0a2-7225194cdd68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:34.741786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-14ba52a5-7e87-46fe-a0a2-7225194cdd68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:34.748370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14ba52a5-7e87-46fe-a0a2-7225194cdd68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:34.748984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14ba52a5-7e87-46fe-a0a2-7225194cdd68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:34.749449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14ba52a5-7e87-46fe-a0a2-7225194cdd68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:34.750336 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14ba52a5-7e87-46fe-a0a2-7225194cdd68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:34.750929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14ba52a5-7e87-46fe-a0a2-7225194cdd68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:34.751355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14ba52a5-7e87-46fe-a0a2-7225194cdd68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:34.807684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e18c4b4a-5bd6-47ac-b262-eec19fd47072 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:34.816811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e18c4b4a-5bd6-47ac-b262-eec19fd47072 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.178307 Oct 28 20:20:34.817411 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1030/2072] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:34 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:34.894497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-14ba52a5-7e87-46fe-a0a2-7225194cdd68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:34.902880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14ba52a5-7e87-46fe-a0a2-7225194cdd68 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.165960 Oct 28 20:20:34.904077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1043/2073] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:34 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:35.743459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd4c1b61-ad70-4502-a101-28ee5a37e37c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:35.745646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd4c1b61-ad70-4502-a101-28ee5a37e37c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:35.748593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=82 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:35.753249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd4c1b61-ad70-4502-a101-28ee5a37e37c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:35.753761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd4c1b61-ad70-4502-a101-28ee5a37e37c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:35.754203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd4c1b61-ad70-4502-a101-28ee5a37e37c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:35.754890 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd4c1b61-ad70-4502-a101-28ee5a37e37c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:35.755348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd4c1b61-ad70-4502-a101-28ee5a37e37c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:35.755772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd4c1b61-ad70-4502-a101-28ee5a37e37c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:35.786807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd4c1b61-ad70-4502-a101-28ee5a37e37c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047271 Oct 28 20:20:35.787374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1031/2074] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:35 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:35.841064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-571d3f0d-d091-454b-a04b-a4db4e88aae0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:35.841828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-571d3f0d-d091-454b-a04b-a4db4e88aae0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:35.848009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-571d3f0d-d091-454b-a04b-a4db4e88aae0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:35.848484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-571d3f0d-d091-454b-a04b-a4db4e88aae0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:35.848989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-571d3f0d-d091-454b-a04b-a4db4e88aae0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:35.849658 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-571d3f0d-d091-454b-a04b-a4db4e88aae0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:35.850103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-571d3f0d-d091-454b-a04b-a4db4e88aae0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:35.850520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-571d3f0d-d091-454b-a04b-a4db4e88aae0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:35.925943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8743c923-25c5-423e-8cd8-2b644da9d0a5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:35.926715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8743c923-25c5-423e-8cd8-2b644da9d0a5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:35.932832 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8743c923-25c5-423e-8cd8-2b644da9d0a5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:35.933334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8743c923-25c5-423e-8cd8-2b644da9d0a5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:35.933792 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8743c923-25c5-423e-8cd8-2b644da9d0a5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:35.934486 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8743c923-25c5-423e-8cd8-2b644da9d0a5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:35.934941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8743c923-25c5-423e-8cd8-2b644da9d0a5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:35.935367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8743c923-25c5-423e-8cd8-2b644da9d0a5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:35.994490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-571d3f0d-d091-454b-a04b-a4db4e88aae0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:36.002544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-571d3f0d-d091-454b-a04b-a4db4e88aae0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.166089 Oct 28 20:20:36.003112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1044/2075] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:35 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:36.076829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8743c923-25c5-423e-8cd8-2b644da9d0a5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:36.085830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8743c923-25c5-423e-8cd8-2b644da9d0a5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.163779 Oct 28 20:20:36.086388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1032/2076] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:35 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:36.799518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-50ad8b81-060e-41fc-a55f-4ce4fe1d4b99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:36.801754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-50ad8b81-060e-41fc-a55f-4ce4fe1d4b99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:36.803601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:36.808192 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50ad8b81-060e-41fc-a55f-4ce4fe1d4b99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:36.808663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50ad8b81-060e-41fc-a55f-4ce4fe1d4b99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:36.809094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50ad8b81-060e-41fc-a55f-4ce4fe1d4b99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:36.810454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50ad8b81-060e-41fc-a55f-4ce4fe1d4b99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:36.810904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50ad8b81-060e-41fc-a55f-4ce4fe1d4b99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:36.811321 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50ad8b81-060e-41fc-a55f-4ce4fe1d4b99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:36.844406 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-50ad8b81-060e-41fc-a55f-4ce4fe1d4b99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049116 Oct 28 20:20:36.845056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1045/2077] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:36 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:37.025377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c45d718a-3dab-4d83-8aa4-b4c20e63c186 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:37.026035 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c45d718a-3dab-4d83-8aa4-b4c20e63c186 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:37.028657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:20:37.028928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:20:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a (ip 10.222.0.66) !!! Oct 28 20:20:37.035359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c45d718a-3dab-4d83-8aa4-b4c20e63c186 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:37.035492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c45d718a-3dab-4d83-8aa4-b4c20e63c186 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:37.035930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c45d718a-3dab-4d83-8aa4-b4c20e63c186 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:37.036640 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c45d718a-3dab-4d83-8aa4-b4c20e63c186 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:37.037097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c45d718a-3dab-4d83-8aa4-b4c20e63c186 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:37.037554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c45d718a-3dab-4d83-8aa4-b4c20e63c186 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:37.109942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3c3a02e6-8d71-48eb-86c6-f43aac97e545 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:37.110570 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3c3a02e6-8d71-48eb-86c6-f43aac97e545 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:37.117456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c3a02e6-8d71-48eb-86c6-f43aac97e545 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:37.117940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c3a02e6-8d71-48eb-86c6-f43aac97e545 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:37.118405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c3a02e6-8d71-48eb-86c6-f43aac97e545 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:37.119698 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c3a02e6-8d71-48eb-86c6-f43aac97e545 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:37.119698 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c3a02e6-8d71-48eb-86c6-f43aac97e545 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:37.120014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c3a02e6-8d71-48eb-86c6-f43aac97e545 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:37.203638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c45d718a-3dab-4d83-8aa4-b4c20e63c186 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:37.211755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c45d718a-3dab-4d83-8aa4-b4c20e63c186 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.190311 Oct 28 20:20:37.212600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1033/2078] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:37 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:37.265282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3c3a02e6-8d71-48eb-86c6-f43aac97e545 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:37.273420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3c3a02e6-8d71-48eb-86c6-f43aac97e545 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.167980 Oct 28 20:20:37.273983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1046/2079] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:37 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:37.856969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1dc943c0-0541-4145-bc15-a386b08bdf1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:37.859191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1dc943c0-0541-4145-bc15-a386b08bdf1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:37.865281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc943c0-0541-4145-bc15-a386b08bdf1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:37.865797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc943c0-0541-4145-bc15-a386b08bdf1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:37.866240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc943c0-0541-4145-bc15-a386b08bdf1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:37.866928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc943c0-0541-4145-bc15-a386b08bdf1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:37.867386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc943c0-0541-4145-bc15-a386b08bdf1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:37.867818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc943c0-0541-4145-bc15-a386b08bdf1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:37.898967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1dc943c0-0541-4145-bc15-a386b08bdf1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046029 Oct 28 20:20:37.899523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1034/2080] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:37 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:38.234293 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2cb57a3-2622-4777-9de6-719a18d4fdd7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:38.234906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2cb57a3-2622-4777-9de6-719a18d4fdd7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:38.241298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2cb57a3-2622-4777-9de6-719a18d4fdd7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:38.241806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2cb57a3-2622-4777-9de6-719a18d4fdd7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:38.242243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2cb57a3-2622-4777-9de6-719a18d4fdd7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:38.242924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2cb57a3-2622-4777-9de6-719a18d4fdd7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:38.243374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2cb57a3-2622-4777-9de6-719a18d4fdd7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:38.243798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2cb57a3-2622-4777-9de6-719a18d4fdd7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:38.296136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-72717f8a-2dfd-48e2-9a50-4ce121cb6389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:38.296746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-72717f8a-2dfd-48e2-9a50-4ce121cb6389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:38.302994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72717f8a-2dfd-48e2-9a50-4ce121cb6389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:38.303483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72717f8a-2dfd-48e2-9a50-4ce121cb6389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:38.303925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72717f8a-2dfd-48e2-9a50-4ce121cb6389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:38.304626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72717f8a-2dfd-48e2-9a50-4ce121cb6389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:38.305087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72717f8a-2dfd-48e2-9a50-4ce121cb6389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:38.305562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72717f8a-2dfd-48e2-9a50-4ce121cb6389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:38.416988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2cb57a3-2622-4777-9de6-719a18d4fdd7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:38.425873 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2cb57a3-2622-4777-9de6-719a18d4fdd7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.195379 Oct 28 20:20:38.426599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1047/2081] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:38 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:38.463999 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-72717f8a-2dfd-48e2-9a50-4ce121cb6389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:38.472210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-72717f8a-2dfd-48e2-9a50-4ce121cb6389 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.180012 Oct 28 20:20:38.472773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1035/2082] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:38 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:39.031600 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-959f0655-8ffa-4c3f-bf62-351d907e99bc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:39.033879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-959f0655-8ffa-4c3f-bf62-351d907e99bc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:39.039767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-959f0655-8ffa-4c3f-bf62-351d907e99bc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:39.041766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-959f0655-8ffa-4c3f-bf62-351d907e99bc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:39.041766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-959f0655-8ffa-4c3f-bf62-351d907e99bc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:39.041766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-959f0655-8ffa-4c3f-bf62-351d907e99bc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:39.042068 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-959f0655-8ffa-4c3f-bf62-351d907e99bc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:39.042392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-959f0655-8ffa-4c3f-bf62-351d907e99bc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:39.071717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-959f0655-8ffa-4c3f-bf62-351d907e99bc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163782 Oct 28 20:20:39.072264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1048/2083] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:38 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:39.449416 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ee83e811-ed07-4fde-ad04-951825cae4f3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:39.450153 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ee83e811-ed07-4fde-ad04-951825cae4f3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:39.456680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee83e811-ed07-4fde-ad04-951825cae4f3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:39.457168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee83e811-ed07-4fde-ad04-951825cae4f3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:39.457632 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee83e811-ed07-4fde-ad04-951825cae4f3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:39.458322 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee83e811-ed07-4fde-ad04-951825cae4f3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:39.458777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee83e811-ed07-4fde-ad04-951825cae4f3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:39.459203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee83e811-ed07-4fde-ad04-951825cae4f3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:39.495875 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ea0d4b09-1b78-47fd-92c5-d9d77286fbda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:39.496704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ea0d4b09-1b78-47fd-92c5-d9d77286fbda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:39.503827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea0d4b09-1b78-47fd-92c5-d9d77286fbda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:39.504393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea0d4b09-1b78-47fd-92c5-d9d77286fbda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:39.504897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea0d4b09-1b78-47fd-92c5-d9d77286fbda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:39.505699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea0d4b09-1b78-47fd-92c5-d9d77286fbda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:39.506224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea0d4b09-1b78-47fd-92c5-d9d77286fbda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:39.506717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea0d4b09-1b78-47fd-92c5-d9d77286fbda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:39.636607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ee83e811-ed07-4fde-ad04-951825cae4f3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:39.646100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ee83e811-ed07-4fde-ad04-951825cae4f3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.200168 Oct 28 20:20:39.646366 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1036/2084] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:39 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:39.670429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ea0d4b09-1b78-47fd-92c5-d9d77286fbda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:39.678467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ea0d4b09-1b78-47fd-92c5-d9d77286fbda tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.186418 Oct 28 20:20:39.679021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1049/2085] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:39 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:40.084093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a788268a-1c6f-464e-82e0-d3e27f1b097c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:40.086314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a788268a-1c6f-464e-82e0-d3e27f1b097c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:40.093380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a788268a-1c6f-464e-82e0-d3e27f1b097c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:40.093871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a788268a-1c6f-464e-82e0-d3e27f1b097c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:40.094311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a788268a-1c6f-464e-82e0-d3e27f1b097c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:40.095008 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a788268a-1c6f-464e-82e0-d3e27f1b097c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:40.095468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a788268a-1c6f-464e-82e0-d3e27f1b097c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:40.095895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a788268a-1c6f-464e-82e0-d3e27f1b097c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:40.125332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a788268a-1c6f-464e-82e0-d3e27f1b097c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045241 Oct 28 20:20:40.125898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1037/2086] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:40 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:40.669275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-13936d1e-8cdb-47ec-bff8-226bc63b79c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:40.669916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-13936d1e-8cdb-47ec-bff8-226bc63b79c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:40.676435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13936d1e-8cdb-47ec-bff8-226bc63b79c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:40.676915 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13936d1e-8cdb-47ec-bff8-226bc63b79c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:40.677371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13936d1e-8cdb-47ec-bff8-226bc63b79c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:40.678089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13936d1e-8cdb-47ec-bff8-226bc63b79c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:40.678540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13936d1e-8cdb-47ec-bff8-226bc63b79c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:40.678961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13936d1e-8cdb-47ec-bff8-226bc63b79c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:40.702441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ad401452-d7f3-4e5e-a0a5-f9cd384680ad tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:40.703355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ad401452-d7f3-4e5e-a0a5-f9cd384680ad tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:40.710097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad401452-d7f3-4e5e-a0a5-f9cd384680ad tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:40.718654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad401452-d7f3-4e5e-a0a5-f9cd384680ad tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:40.719145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad401452-d7f3-4e5e-a0a5-f9cd384680ad tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:40.719908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad401452-d7f3-4e5e-a0a5-f9cd384680ad tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:40.720367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad401452-d7f3-4e5e-a0a5-f9cd384680ad tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:40.720917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad401452-d7f3-4e5e-a0a5-f9cd384680ad tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:40.866445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-13936d1e-8cdb-47ec-bff8-226bc63b79c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:40.875284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-13936d1e-8cdb-47ec-bff8-226bc63b79c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.209826 Oct 28 20:20:40.885378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1050/2087] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:40 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:40.894591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ad401452-d7f3-4e5e-a0a5-f9cd384680ad tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:40.903839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ad401452-d7f3-4e5e-a0a5-f9cd384680ad tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.205383 Oct 28 20:20:40.904669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1038/2088] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:40 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:41.138750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf685142-60ee-4db5-8ec7-65f15e7a0d15 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:41.141368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cf685142-60ee-4db5-8ec7-65f15e7a0d15 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:41.147274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf685142-60ee-4db5-8ec7-65f15e7a0d15 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:41.147761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf685142-60ee-4db5-8ec7-65f15e7a0d15 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:41.148203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf685142-60ee-4db5-8ec7-65f15e7a0d15 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:41.148929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf685142-60ee-4db5-8ec7-65f15e7a0d15 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:41.149418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf685142-60ee-4db5-8ec7-65f15e7a0d15 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:41.149858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf685142-60ee-4db5-8ec7-65f15e7a0d15 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:41.174874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:41.179572 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cf685142-60ee-4db5-8ec7-65f15e7a0d15 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045670 Oct 28 20:20:41.180143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1051/2089] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:41 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:41.899102 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1d3bf35a-206b-4ff8-9f35-a916109ce3e8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:41.899695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1d3bf35a-206b-4ff8-9f35-a916109ce3e8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:41.906174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d3bf35a-206b-4ff8-9f35-a916109ce3e8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:41.906654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d3bf35a-206b-4ff8-9f35-a916109ce3e8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:41.907085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d3bf35a-206b-4ff8-9f35-a916109ce3e8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:41.907760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d3bf35a-206b-4ff8-9f35-a916109ce3e8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:41.908208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d3bf35a-206b-4ff8-9f35-a916109ce3e8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:41.908628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d3bf35a-206b-4ff8-9f35-a916109ce3e8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:42.047491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dee39663-a09e-4af5-90f2-ba24a0976797 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:42.048015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1d3bf35a-206b-4ff8-9f35-a916109ce3e8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:42.048258 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dee39663-a09e-4af5-90f2-ba24a0976797 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:42.054515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee39663-a09e-4af5-90f2-ba24a0976797 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:42.055076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee39663-a09e-4af5-90f2-ba24a0976797 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:42.055525 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee39663-a09e-4af5-90f2-ba24a0976797 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:42.056076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1d3bf35a-206b-4ff8-9f35-a916109ce3e8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.160821 Oct 28 20:20:42.056214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee39663-a09e-4af5-90f2-ba24a0976797 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:42.056635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1039/2090] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:41 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:42.056757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee39663-a09e-4af5-90f2-ba24a0976797 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:42.057086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee39663-a09e-4af5-90f2-ba24a0976797 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:42.191955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dee39663-a09e-4af5-90f2-ba24a0976797 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:42.194992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-490b2356-23fa-4e76-8c54-e9dcfad7340b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:42.197347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-490b2356-23fa-4e76-8c54-e9dcfad7340b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:42.201555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dee39663-a09e-4af5-90f2-ba24a0976797 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.279620 Oct 28 20:20:42.202371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1052/2091] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:41 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:42.204348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490b2356-23fa-4e76-8c54-e9dcfad7340b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:42.204922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490b2356-23fa-4e76-8c54-e9dcfad7340b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:42.205452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490b2356-23fa-4e76-8c54-e9dcfad7340b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:42.206288 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490b2356-23fa-4e76-8c54-e9dcfad7340b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:42.206820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490b2356-23fa-4e76-8c54-e9dcfad7340b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:42.207303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490b2356-23fa-4e76-8c54-e9dcfad7340b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:42.234536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:42.239243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-490b2356-23fa-4e76-8c54-e9dcfad7340b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049368 Oct 28 20:20:42.240493 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1040/2092] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:42 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:20:43.080636 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4932983c-806d-4cbc-9525-7702e3f89d94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:43.081252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4932983c-806d-4cbc-9525-7702e3f89d94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:43.088021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4932983c-806d-4cbc-9525-7702e3f89d94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:43.088502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4932983c-806d-4cbc-9525-7702e3f89d94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:43.088940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4932983c-806d-4cbc-9525-7702e3f89d94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:43.089662 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4932983c-806d-4cbc-9525-7702e3f89d94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:43.090117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4932983c-806d-4cbc-9525-7702e3f89d94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:43.090603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4932983c-806d-4cbc-9525-7702e3f89d94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:43.225427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c056c95e-a367-45f5-a0c1-063b34db9f9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:43.226714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c056c95e-a367-45f5-a0c1-063b34db9f9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:43.228148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4932983c-806d-4cbc-9525-7702e3f89d94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:43.234369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c056c95e-a367-45f5-a0c1-063b34db9f9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:43.234854 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c056c95e-a367-45f5-a0c1-063b34db9f9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:43.235285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c056c95e-a367-45f5-a0c1-063b34db9f9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:43.235975 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c056c95e-a367-45f5-a0c1-063b34db9f9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:43.236421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c056c95e-a367-45f5-a0c1-063b34db9f9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:43.237052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c056c95e-a367-45f5-a0c1-063b34db9f9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:43.237190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4932983c-806d-4cbc-9525-7702e3f89d94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.160312 Oct 28 20:20:43.237715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1053/2093] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:43 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:43.255822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3f684b3c-9eaf-4a25-b80b-9658562d9835 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:43.258261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3f684b3c-9eaf-4a25-b80b-9658562d9835 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:43.265115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f684b3c-9eaf-4a25-b80b-9658562d9835 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:43.265767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f684b3c-9eaf-4a25-b80b-9658562d9835 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:43.266306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f684b3c-9eaf-4a25-b80b-9658562d9835 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:43.267109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f684b3c-9eaf-4a25-b80b-9658562d9835 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:43.267685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f684b3c-9eaf-4a25-b80b-9658562d9835 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:43.268115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f684b3c-9eaf-4a25-b80b-9658562d9835 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:43.299091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3f684b3c-9eaf-4a25-b80b-9658562d9835 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047061 Oct 28 20:20:43.299583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1054/2094] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:43 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:20:43.371427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c056c95e-a367-45f5-a0c1-063b34db9f9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:43.380182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c056c95e-a367-45f5-a0c1-063b34db9f9b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.158533 Oct 28 20:20:43.380751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1041/2095] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:43 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:44.264862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ce119584-daca-4aab-b4a0-d922e5ead086 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:44.265685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ce119584-daca-4aab-b4a0-d922e5ead086 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:44.272435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce119584-daca-4aab-b4a0-d922e5ead086 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:44.272975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce119584-daca-4aab-b4a0-d922e5ead086 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:44.273582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce119584-daca-4aab-b4a0-d922e5ead086 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:44.274289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce119584-daca-4aab-b4a0-d922e5ead086 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:44.274748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce119584-daca-4aab-b4a0-d922e5ead086 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:44.275177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce119584-daca-4aab-b4a0-d922e5ead086 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:44.312082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-59dffdf6-18a5-4044-8a06-28723555b024 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:44.314280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-59dffdf6-18a5-4044-8a06-28723555b024 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:44.320619 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59dffdf6-18a5-4044-8a06-28723555b024 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:44.321100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59dffdf6-18a5-4044-8a06-28723555b024 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:44.321571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59dffdf6-18a5-4044-8a06-28723555b024 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:44.322268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59dffdf6-18a5-4044-8a06-28723555b024 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:44.322720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59dffdf6-18a5-4044-8a06-28723555b024 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:44.323140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59dffdf6-18a5-4044-8a06-28723555b024 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:44.353830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-59dffdf6-18a5-4044-8a06-28723555b024 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046205 Oct 28 20:20:44.354407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1042/2096] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:44 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:20:44.403859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9d5873b0-ec97-42bd-bdbe-84f3feee8fcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:44.404462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9d5873b0-ec97-42bd-bdbe-84f3feee8fcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:44.407928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ce119584-daca-4aab-b4a0-d922e5ead086 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:44.410337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d5873b0-ec97-42bd-bdbe-84f3feee8fcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:44.410815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d5873b0-ec97-42bd-bdbe-84f3feee8fcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:44.411247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d5873b0-ec97-42bd-bdbe-84f3feee8fcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:44.411928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d5873b0-ec97-42bd-bdbe-84f3feee8fcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:44.412376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d5873b0-ec97-42bd-bdbe-84f3feee8fcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:44.412797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d5873b0-ec97-42bd-bdbe-84f3feee8fcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:44.416117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ce119584-daca-4aab-b4a0-d922e5ead086 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.156075 Oct 28 20:20:44.417527 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1055/2097] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:44 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:44.539893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9d5873b0-ec97-42bd-bdbe-84f3feee8fcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:44.548694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9d5873b0-ec97-42bd-bdbe-84f3feee8fcb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.148789 Oct 28 20:20:44.549253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1043/2098] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:44 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:45.366922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-592ea90f-d331-4e11-aa45-62f4c5cc5326 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:45.369135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-592ea90f-d331-4e11-aa45-62f4c5cc5326 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:45.376843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-592ea90f-d331-4e11-aa45-62f4c5cc5326 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:45.377365 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-592ea90f-d331-4e11-aa45-62f4c5cc5326 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:45.377811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-592ea90f-d331-4e11-aa45-62f4c5cc5326 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:45.378510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-592ea90f-d331-4e11-aa45-62f4c5cc5326 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:45.378967 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-592ea90f-d331-4e11-aa45-62f4c5cc5326 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:45.379393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-592ea90f-d331-4e11-aa45-62f4c5cc5326 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:45.408290 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-592ea90f-d331-4e11-aa45-62f4c5cc5326 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045443 Oct 28 20:20:45.408837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1056/2099] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:45 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:45.440758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6419edc7-0bfb-40b1-aa03-41d391b674b9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:45.441386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6419edc7-0bfb-40b1-aa03-41d391b674b9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:45.447677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6419edc7-0bfb-40b1-aa03-41d391b674b9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:45.448151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6419edc7-0bfb-40b1-aa03-41d391b674b9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:45.448583 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6419edc7-0bfb-40b1-aa03-41d391b674b9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:45.449254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6419edc7-0bfb-40b1-aa03-41d391b674b9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:45.449768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6419edc7-0bfb-40b1-aa03-41d391b674b9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:45.450317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6419edc7-0bfb-40b1-aa03-41d391b674b9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:45.571918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a32f029f-d3b5-4595-aac3-0eecb938762c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:45.572449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a32f029f-d3b5-4595-aac3-0eecb938762c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:45.576582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6419edc7-0bfb-40b1-aa03-41d391b674b9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:45.578519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a32f029f-d3b5-4595-aac3-0eecb938762c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:45.579009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a32f029f-d3b5-4595-aac3-0eecb938762c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:45.579444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a32f029f-d3b5-4595-aac3-0eecb938762c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:45.580137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a32f029f-d3b5-4595-aac3-0eecb938762c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:45.580870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a32f029f-d3b5-4595-aac3-0eecb938762c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:45.581299 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a32f029f-d3b5-4595-aac3-0eecb938762c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:45.584860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6419edc7-0bfb-40b1-aa03-41d391b674b9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.147951 Oct 28 20:20:45.585448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1044/2100] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:45 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:45.714345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a32f029f-d3b5-4595-aac3-0eecb938762c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:45.722928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a32f029f-d3b5-4595-aac3-0eecb938762c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154926 Oct 28 20:20:45.723487 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1057/2101] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:45 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:46.420913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0e00c702-6eb6-41ab-8748-f8062f630f23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:46.423120 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0e00c702-6eb6-41ab-8748-f8062f630f23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:46.429079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e00c702-6eb6-41ab-8748-f8062f630f23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:46.429605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e00c702-6eb6-41ab-8748-f8062f630f23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:46.430065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e00c702-6eb6-41ab-8748-f8062f630f23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:46.430748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e00c702-6eb6-41ab-8748-f8062f630f23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:46.431205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e00c702-6eb6-41ab-8748-f8062f630f23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:46.431638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e00c702-6eb6-41ab-8748-f8062f630f23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:46.460781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0e00c702-6eb6-41ab-8748-f8062f630f23 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Oct 28 20:20:46.461479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1045/2102] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:46 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:46.608859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5217985d-5d2a-4c80-816c-1850c52e8db5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:46.609443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5217985d-5d2a-4c80-816c-1850c52e8db5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:46.615711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5217985d-5d2a-4c80-816c-1850c52e8db5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:46.616184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5217985d-5d2a-4c80-816c-1850c52e8db5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:46.616633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5217985d-5d2a-4c80-816c-1850c52e8db5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:46.617288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5217985d-5d2a-4c80-816c-1850c52e8db5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:46.617752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5217985d-5d2a-4c80-816c-1850c52e8db5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:46.618168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5217985d-5d2a-4c80-816c-1850c52e8db5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:46.746414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2974a55c-e65b-4057-b0f4-7bc6f065bd3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:46.746605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5217985d-5d2a-4c80-816c-1850c52e8db5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:46.747057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2974a55c-e65b-4057-b0f4-7bc6f065bd3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:46.752900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2974a55c-e65b-4057-b0f4-7bc6f065bd3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:46.753414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2974a55c-e65b-4057-b0f4-7bc6f065bd3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:46.753859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2974a55c-e65b-4057-b0f4-7bc6f065bd3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:46.754548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2974a55c-e65b-4057-b0f4-7bc6f065bd3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:46.755001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2974a55c-e65b-4057-b0f4-7bc6f065bd3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:46.755152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5217985d-5d2a-4c80-816c-1850c52e8db5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151114 Oct 28 20:20:46.755426 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2974a55c-e65b-4057-b0f4-7bc6f065bd3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:46.755727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1058/2103] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:46 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:46.895545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2974a55c-e65b-4057-b0f4-7bc6f065bd3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:46.904378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2974a55c-e65b-4057-b0f4-7bc6f065bd3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.161810 Oct 28 20:20:46.904936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1046/2104] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:46 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:47.474047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e679c6ed-bac4-4af8-af06-7b75b2a16e84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:47.476249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e679c6ed-bac4-4af8-af06-7b75b2a16e84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:47.482664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e679c6ed-bac4-4af8-af06-7b75b2a16e84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:47.483145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e679c6ed-bac4-4af8-af06-7b75b2a16e84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:47.483583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e679c6ed-bac4-4af8-af06-7b75b2a16e84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:47.484266 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e679c6ed-bac4-4af8-af06-7b75b2a16e84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:47.484717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e679c6ed-bac4-4af8-af06-7b75b2a16e84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:47.485138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e679c6ed-bac4-4af8-af06-7b75b2a16e84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:47.515147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e679c6ed-bac4-4af8-af06-7b75b2a16e84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045011 Oct 28 20:20:47.515691 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1059/2105] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:47 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:47.779019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-490d898a-2162-4175-a421-ca195dbd492c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:47.779727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-490d898a-2162-4175-a421-ca195dbd492c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:47.786144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490d898a-2162-4175-a421-ca195dbd492c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:47.786631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490d898a-2162-4175-a421-ca195dbd492c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:47.787075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490d898a-2162-4175-a421-ca195dbd492c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:47.787765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490d898a-2162-4175-a421-ca195dbd492c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:47.788222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490d898a-2162-4175-a421-ca195dbd492c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:47.788646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490d898a-2162-4175-a421-ca195dbd492c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:47.921024 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-490d898a-2162-4175-a421-ca195dbd492c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:47.927314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ea028332-afd7-4303-bbcb-ba51725813b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:47.927936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ea028332-afd7-4303-bbcb-ba51725813b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:47.929344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-490d898a-2162-4175-a421-ca195dbd492c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.154680 Oct 28 20:20:47.929915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1047/2106] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:47 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:47.935376 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea028332-afd7-4303-bbcb-ba51725813b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:47.935869 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea028332-afd7-4303-bbcb-ba51725813b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:47.936314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea028332-afd7-4303-bbcb-ba51725813b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:47.937015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea028332-afd7-4303-bbcb-ba51725813b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:47.937501 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea028332-afd7-4303-bbcb-ba51725813b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:47.937930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea028332-afd7-4303-bbcb-ba51725813b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:48.069768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ea028332-afd7-4303-bbcb-ba51725813b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:48.078703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ea028332-afd7-4303-bbcb-ba51725813b3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154990 Oct 28 20:20:48.079325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1060/2107] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:47 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:48.527442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a1f7864-5325-4fb2-8f1e-053b1ab57926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:48.530220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a1f7864-5325-4fb2-8f1e-053b1ab57926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:48.536067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a1f7864-5325-4fb2-8f1e-053b1ab57926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:48.536554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a1f7864-5325-4fb2-8f1e-053b1ab57926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:48.536990 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a1f7864-5325-4fb2-8f1e-053b1ab57926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:48.537707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a1f7864-5325-4fb2-8f1e-053b1ab57926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:48.538168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a1f7864-5325-4fb2-8f1e-053b1ab57926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:48.538605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a1f7864-5325-4fb2-8f1e-053b1ab57926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:48.568388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a1f7864-5325-4fb2-8f1e-053b1ab57926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044900 Oct 28 20:20:48.568941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1048/2108] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:48 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:48.953842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3fc40aa5-e25a-46d8-8f03-6720d0eabb35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:48.954454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3fc40aa5-e25a-46d8-8f03-6720d0eabb35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:48.960834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fc40aa5-e25a-46d8-8f03-6720d0eabb35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:48.961306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fc40aa5-e25a-46d8-8f03-6720d0eabb35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:48.961764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fc40aa5-e25a-46d8-8f03-6720d0eabb35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:48.962700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fc40aa5-e25a-46d8-8f03-6720d0eabb35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:48.963145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fc40aa5-e25a-46d8-8f03-6720d0eabb35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:48.963557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fc40aa5-e25a-46d8-8f03-6720d0eabb35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:49.099063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3fc40aa5-e25a-46d8-8f03-6720d0eabb35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:49.105052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-50fe5b79-5253-445b-a81e-ed98a1a1be03 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:49.105776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-50fe5b79-5253-445b-a81e-ed98a1a1be03 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:49.109197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3fc40aa5-e25a-46d8-8f03-6720d0eabb35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.159699 Oct 28 20:20:49.110210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1061/2109] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:48 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:49.113534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50fe5b79-5253-445b-a81e-ed98a1a1be03 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:49.114297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50fe5b79-5253-445b-a81e-ed98a1a1be03 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:49.115247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50fe5b79-5253-445b-a81e-ed98a1a1be03 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:49.115954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50fe5b79-5253-445b-a81e-ed98a1a1be03 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:49.116409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50fe5b79-5253-445b-a81e-ed98a1a1be03 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:49.116831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50fe5b79-5253-445b-a81e-ed98a1a1be03 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:49.265445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-50fe5b79-5253-445b-a81e-ed98a1a1be03 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:49.273939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-50fe5b79-5253-445b-a81e-ed98a1a1be03 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.173278 Oct 28 20:20:49.274522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1049/2110] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:49 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:49.582286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5a0fcc2-742c-4463-ae9e-edfc87b8bdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:49.584704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f5a0fcc2-742c-4463-ae9e-edfc87b8bdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:49.594002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a0fcc2-742c-4463-ae9e-edfc87b8bdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:49.594490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a0fcc2-742c-4463-ae9e-edfc87b8bdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:49.594928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a0fcc2-742c-4463-ae9e-edfc87b8bdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:49.596321 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a0fcc2-742c-4463-ae9e-edfc87b8bdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:49.596778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a0fcc2-742c-4463-ae9e-edfc87b8bdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:49.597590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a0fcc2-742c-4463-ae9e-edfc87b8bdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:49.630807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5a0fcc2-742c-4463-ae9e-edfc87b8bdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052715 Oct 28 20:20:49.631374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1062/2111] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:49 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:20:50.135995 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4d18ccd8-a622-45e8-b50a-acf46cdbbfd2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:50.136639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4d18ccd8-a622-45e8-b50a-acf46cdbbfd2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:50.144046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d18ccd8-a622-45e8-b50a-acf46cdbbfd2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:50.144532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d18ccd8-a622-45e8-b50a-acf46cdbbfd2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:50.144973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d18ccd8-a622-45e8-b50a-acf46cdbbfd2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:50.146010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d18ccd8-a622-45e8-b50a-acf46cdbbfd2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:50.146140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d18ccd8-a622-45e8-b50a-acf46cdbbfd2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:50.146570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d18ccd8-a622-45e8-b50a-acf46cdbbfd2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:50.283398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4d18ccd8-a622-45e8-b50a-acf46cdbbfd2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:50.291362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4d18ccd8-a622-45e8-b50a-acf46cdbbfd2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.159801 Oct 28 20:20:50.291924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1050/2112] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:50 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:50.297398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d7bc8870-da99-46a4-aeb7-2fad589d7f81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:50.298018 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d7bc8870-da99-46a4-aeb7-2fad589d7f81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:50.304337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7bc8870-da99-46a4-aeb7-2fad589d7f81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:50.304887 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7bc8870-da99-46a4-aeb7-2fad589d7f81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:50.311317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7bc8870-da99-46a4-aeb7-2fad589d7f81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:50.311317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7bc8870-da99-46a4-aeb7-2fad589d7f81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:50.311317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7bc8870-da99-46a4-aeb7-2fad589d7f81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:50.311317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7bc8870-da99-46a4-aeb7-2fad589d7f81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:50.433456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d7bc8870-da99-46a4-aeb7-2fad589d7f81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:50.442231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d7bc8870-da99-46a4-aeb7-2fad589d7f81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.148779 Oct 28 20:20:50.442826 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1063/2113] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:50 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:50.645773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ff67df39-4b12-41c6-81d2-83fad4b00315 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:50.647969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ff67df39-4b12-41c6-81d2-83fad4b00315 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:50.654167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff67df39-4b12-41c6-81d2-83fad4b00315 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:50.654653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff67df39-4b12-41c6-81d2-83fad4b00315 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:50.655092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff67df39-4b12-41c6-81d2-83fad4b00315 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:50.655779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff67df39-4b12-41c6-81d2-83fad4b00315 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:50.656234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff67df39-4b12-41c6-81d2-83fad4b00315 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:50.656660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff67df39-4b12-41c6-81d2-83fad4b00315 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:50.686696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ff67df39-4b12-41c6-81d2-83fad4b00315 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044986 Oct 28 20:20:50.687248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1051/2114] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:50 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:51.315244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-70c32c09-c9d8-4259-aa7f-821490ecdea5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:51.315779 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-70c32c09-c9d8-4259-aa7f-821490ecdea5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:51.317771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:20:51.317914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:20:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a (ip 10.222.0.66) !!! Oct 28 20:20:51.325877 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70c32c09-c9d8-4259-aa7f-821490ecdea5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:51.326347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70c32c09-c9d8-4259-aa7f-821490ecdea5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:51.326776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70c32c09-c9d8-4259-aa7f-821490ecdea5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:51.327454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70c32c09-c9d8-4259-aa7f-821490ecdea5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:51.327901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70c32c09-c9d8-4259-aa7f-821490ecdea5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:51.328318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70c32c09-c9d8-4259-aa7f-821490ecdea5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:51.457999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-70c32c09-c9d8-4259-aa7f-821490ecdea5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:51.465912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8210a639-5d16-4a7d-a1a6-06c75e34ebe1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:51.466673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8210a639-5d16-4a7d-a1a6-06c75e34ebe1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:51.467113 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-70c32c09-c9d8-4259-aa7f-821490ecdea5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.155976 Oct 28 20:20:51.468287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1064/2115] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:51 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:51.469104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:20:51.469300 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:20:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 (ip 10.222.0.66) !!! Oct 28 20:20:51.474859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8210a639-5d16-4a7d-a1a6-06c75e34ebe1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:51.475312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8210a639-5d16-4a7d-a1a6-06c75e34ebe1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:51.475742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8210a639-5d16-4a7d-a1a6-06c75e34ebe1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:51.476430 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8210a639-5d16-4a7d-a1a6-06c75e34ebe1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:51.476876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8210a639-5d16-4a7d-a1a6-06c75e34ebe1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:51.477444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8210a639-5d16-4a7d-a1a6-06c75e34ebe1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:51.607401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8210a639-5d16-4a7d-a1a6-06c75e34ebe1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:51.615448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8210a639-5d16-4a7d-a1a6-06c75e34ebe1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154322 Oct 28 20:20:51.616014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1052/2116] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:51 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:51.699176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9e21ff9c-e7b2-4be1-bf17-c7a39dcb2eea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:51.701598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9e21ff9c-e7b2-4be1-bf17-c7a39dcb2eea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:51.707443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e21ff9c-e7b2-4be1-bf17-c7a39dcb2eea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:51.707931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e21ff9c-e7b2-4be1-bf17-c7a39dcb2eea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:51.708372 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e21ff9c-e7b2-4be1-bf17-c7a39dcb2eea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:51.709066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e21ff9c-e7b2-4be1-bf17-c7a39dcb2eea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:51.709552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e21ff9c-e7b2-4be1-bf17-c7a39dcb2eea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:51.709981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e21ff9c-e7b2-4be1-bf17-c7a39dcb2eea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:51.740110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9e21ff9c-e7b2-4be1-bf17-c7a39dcb2eea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045028 Oct 28 20:20:51.740661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1065/2117] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:51 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:52.490481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-22941e19-9ab3-4094-97e3-9d7ef105dc39 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:52.491096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22941e19-9ab3-4094-97e3-9d7ef105dc39 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:52.498519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22941e19-9ab3-4094-97e3-9d7ef105dc39 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:52.499043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22941e19-9ab3-4094-97e3-9d7ef105dc39 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:52.499484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22941e19-9ab3-4094-97e3-9d7ef105dc39 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:52.500179 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22941e19-9ab3-4094-97e3-9d7ef105dc39 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:52.500635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22941e19-9ab3-4094-97e3-9d7ef105dc39 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:52.501060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22941e19-9ab3-4094-97e3-9d7ef105dc39 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:52.629865 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-22941e19-9ab3-4094-97e3-9d7ef105dc39 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:52.638359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e17a8698-1641-4030-935e-f34497275ad5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:52.638941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-22941e19-9ab3-4094-97e3-9d7ef105dc39 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152323 Oct 28 20:20:52.639108 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e17a8698-1641-4030-935e-f34497275ad5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:52.639523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1053/2118] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:52 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:52.645528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e17a8698-1641-4030-935e-f34497275ad5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:52.646010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e17a8698-1641-4030-935e-f34497275ad5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:52.646444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e17a8698-1641-4030-935e-f34497275ad5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:52.647135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e17a8698-1641-4030-935e-f34497275ad5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:52.647586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e17a8698-1641-4030-935e-f34497275ad5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:52.648011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e17a8698-1641-4030-935e-f34497275ad5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:52.753314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b0a7fc1c-9783-484b-a6f7-c74ae0adf98e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:52.755966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b0a7fc1c-9783-484b-a6f7-c74ae0adf98e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:52.762759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0a7fc1c-9783-484b-a6f7-c74ae0adf98e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:52.763435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0a7fc1c-9783-484b-a6f7-c74ae0adf98e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:52.763879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0a7fc1c-9783-484b-a6f7-c74ae0adf98e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:52.764640 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0a7fc1c-9783-484b-a6f7-c74ae0adf98e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:52.777344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0a7fc1c-9783-484b-a6f7-c74ae0adf98e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:52.777344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0a7fc1c-9783-484b-a6f7-c74ae0adf98e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:52.786239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e17a8698-1641-4030-935e-f34497275ad5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:52.794347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e17a8698-1641-4030-935e-f34497275ad5 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.160670 Oct 28 20:20:52.795093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1066/2119] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:52 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:52.795811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b0a7fc1c-9783-484b-a6f7-c74ae0adf98e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047396 Oct 28 20:20:52.796488 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1054/2120] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:52 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:20:53.662800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-297bd6f2-616b-4fa3-a655-32af87927e15 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:53.663418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-297bd6f2-616b-4fa3-a655-32af87927e15 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:53.670640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-297bd6f2-616b-4fa3-a655-32af87927e15 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:53.671127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-297bd6f2-616b-4fa3-a655-32af87927e15 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:53.671569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-297bd6f2-616b-4fa3-a655-32af87927e15 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:53.672260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-297bd6f2-616b-4fa3-a655-32af87927e15 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:53.672719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-297bd6f2-616b-4fa3-a655-32af87927e15 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:53.673144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-297bd6f2-616b-4fa3-a655-32af87927e15 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:53.802883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-297bd6f2-616b-4fa3-a655-32af87927e15 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:53.808155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f3c66c2f-7b64-45e1-bab5-b969e948bf94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:53.812195 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f3c66c2f-7b64-45e1-bab5-b969e948bf94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:53.812369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-297bd6f2-616b-4fa3-a655-32af87927e15 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152978 Oct 28 20:20:53.813452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1067/2121] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:53 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:53.817799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6401be50-6e07-40db-8f93-61d3e2f2e2cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:53.817938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3c66c2f-7b64-45e1-bab5-b969e948bf94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:53.818391 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6401be50-6e07-40db-8f93-61d3e2f2e2cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:53.818523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3c66c2f-7b64-45e1-bab5-b969e948bf94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:53.818836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3c66c2f-7b64-45e1-bab5-b969e948bf94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:53.819532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3c66c2f-7b64-45e1-bab5-b969e948bf94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:53.819988 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3c66c2f-7b64-45e1-bab5-b969e948bf94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:53.820414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3c66c2f-7b64-45e1-bab5-b969e948bf94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:53.826586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6401be50-6e07-40db-8f93-61d3e2f2e2cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:53.827767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6401be50-6e07-40db-8f93-61d3e2f2e2cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:53.828734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6401be50-6e07-40db-8f93-61d3e2f2e2cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:53.829717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6401be50-6e07-40db-8f93-61d3e2f2e2cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:53.830423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6401be50-6e07-40db-8f93-61d3e2f2e2cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:53.831086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6401be50-6e07-40db-8f93-61d3e2f2e2cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:53.850919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f3c66c2f-7b64-45e1-bab5-b969e948bf94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046637 Oct 28 20:20:53.851478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1055/2122] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:53 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:53.851638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:53.969608 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6401be50-6e07-40db-8f93-61d3e2f2e2cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:53.977554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6401be50-6e07-40db-8f93-61d3e2f2e2cc tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.163350 Oct 28 20:20:53.978113 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1068/2123] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:53 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:54.836089 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-985979d7-8de2-4047-a9f3-aaf52d8f51c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:54.836734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-985979d7-8de2-4047-a9f3-aaf52d8f51c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:54.843934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-985979d7-8de2-4047-a9f3-aaf52d8f51c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:54.844463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-985979d7-8de2-4047-a9f3-aaf52d8f51c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:54.844890 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-985979d7-8de2-4047-a9f3-aaf52d8f51c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:54.845628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-985979d7-8de2-4047-a9f3-aaf52d8f51c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:54.846086 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-985979d7-8de2-4047-a9f3-aaf52d8f51c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:54.846509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-985979d7-8de2-4047-a9f3-aaf52d8f51c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:54.863536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-53aa4437-51f3-4d8f-a020-d99e7dc733bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:54.865751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-53aa4437-51f3-4d8f-a020-d99e7dc733bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:54.872271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53aa4437-51f3-4d8f-a020-d99e7dc733bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:54.872753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53aa4437-51f3-4d8f-a020-d99e7dc733bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:54.873473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53aa4437-51f3-4d8f-a020-d99e7dc733bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:54.874222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53aa4437-51f3-4d8f-a020-d99e7dc733bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:54.874718 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53aa4437-51f3-4d8f-a020-d99e7dc733bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:54.875128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53aa4437-51f3-4d8f-a020-d99e7dc733bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:54.917541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-53aa4437-51f3-4d8f-a020-d99e7dc733bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057923 Oct 28 20:20:54.918134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1069/2124] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:54 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:54.989544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-985979d7-8de2-4047-a9f3-aaf52d8f51c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:54.998352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-985979d7-8de2-4047-a9f3-aaf52d8f51c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.166132 Oct 28 20:20:54.998926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1056/2125] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:54 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:55.007851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ce17963-406e-4039-b913-efe674b104cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:55.007851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ce17963-406e-4039-b913-efe674b104cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:55.007851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ce17963-406e-4039-b913-efe674b104cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:55.007851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ce17963-406e-4039-b913-efe674b104cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:55.008284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ce17963-406e-4039-b913-efe674b104cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:55.008666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ce17963-406e-4039-b913-efe674b104cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:55.009187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ce17963-406e-4039-b913-efe674b104cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:55.010630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ce17963-406e-4039-b913-efe674b104cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:55.138551 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ce17963-406e-4039-b913-efe674b104cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:55.146815 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ce17963-406e-4039-b913-efe674b104cf tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150743 Oct 28 20:20:55.147410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1070/2126] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:54 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:55.930563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d4af7e1-48e9-4daa-b8fd-572e4ad20999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:55.932700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6d4af7e1-48e9-4daa-b8fd-572e4ad20999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:55.939433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d4af7e1-48e9-4daa-b8fd-572e4ad20999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:55.939946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d4af7e1-48e9-4daa-b8fd-572e4ad20999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:55.940377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d4af7e1-48e9-4daa-b8fd-572e4ad20999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:55.941065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d4af7e1-48e9-4daa-b8fd-572e4ad20999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:55.941540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d4af7e1-48e9-4daa-b8fd-572e4ad20999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:55.941964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d4af7e1-48e9-4daa-b8fd-572e4ad20999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:55.958985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:55.975381 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6d4af7e1-48e9-4daa-b8fd-572e4ad20999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046045 Oct 28 20:20:55.975381 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1057/2127] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:55 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:56.022373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b3337e4c-b36c-426f-b551-5c1111a7bca4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:56.022994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b3337e4c-b36c-426f-b551-5c1111a7bca4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:56.030478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3337e4c-b36c-426f-b551-5c1111a7bca4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:56.030964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3337e4c-b36c-426f-b551-5c1111a7bca4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:56.031402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3337e4c-b36c-426f-b551-5c1111a7bca4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:56.032096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3337e4c-b36c-426f-b551-5c1111a7bca4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:56.032558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3337e4c-b36c-426f-b551-5c1111a7bca4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:56.032987 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3337e4c-b36c-426f-b551-5c1111a7bca4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:56.161703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b3337e4c-b36c-426f-b551-5c1111a7bca4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:56.170204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be6d373f-4fa0-43cc-8f96-7315e708ab8c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:56.170453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b3337e4c-b36c-426f-b551-5c1111a7bca4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151925 Oct 28 20:20:56.170811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-be6d373f-4fa0-43cc-8f96-7315e708ab8c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:56.171018 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1071/2128] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:56 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:56.177129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be6d373f-4fa0-43cc-8f96-7315e708ab8c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:56.177635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be6d373f-4fa0-43cc-8f96-7315e708ab8c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:56.178067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be6d373f-4fa0-43cc-8f96-7315e708ab8c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:56.178743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be6d373f-4fa0-43cc-8f96-7315e708ab8c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:56.179192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be6d373f-4fa0-43cc-8f96-7315e708ab8c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:56.179649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be6d373f-4fa0-43cc-8f96-7315e708ab8c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:56.306995 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-be6d373f-4fa0-43cc-8f96-7315e708ab8c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:56.315199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-be6d373f-4fa0-43cc-8f96-7315e708ab8c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149349 Oct 28 20:20:56.315763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1058/2129] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:56 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:56.985418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2d1659e2-cf3b-40e2-add9-a3fef27d8c63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:56.987563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2d1659e2-cf3b-40e2-add9-a3fef27d8c63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:56.993581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d1659e2-cf3b-40e2-add9-a3fef27d8c63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:56.994067 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d1659e2-cf3b-40e2-add9-a3fef27d8c63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:56.994507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d1659e2-cf3b-40e2-add9-a3fef27d8c63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:56.995202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d1659e2-cf3b-40e2-add9-a3fef27d8c63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:56.995654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d1659e2-cf3b-40e2-add9-a3fef27d8c63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:56.996079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d1659e2-cf3b-40e2-add9-a3fef27d8c63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:57.027672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2d1659e2-cf3b-40e2-add9-a3fef27d8c63 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046482 Oct 28 20:20:57.028916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1072/2130] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:56 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:57.193787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-771a826c-5e89-4c6a-a2bc-8fb3395116cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:57.194406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-771a826c-5e89-4c6a-a2bc-8fb3395116cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:57.201053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-771a826c-5e89-4c6a-a2bc-8fb3395116cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:57.201581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-771a826c-5e89-4c6a-a2bc-8fb3395116cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:57.202024 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-771a826c-5e89-4c6a-a2bc-8fb3395116cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:57.202717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-771a826c-5e89-4c6a-a2bc-8fb3395116cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:57.203176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-771a826c-5e89-4c6a-a2bc-8fb3395116cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:57.203600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-771a826c-5e89-4c6a-a2bc-8fb3395116cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:57.336385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-771a826c-5e89-4c6a-a2bc-8fb3395116cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:57.338575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-15f8c89a-5177-40f5-bf0a-38b60d6f3cf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:57.339196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-15f8c89a-5177-40f5-bf0a-38b60d6f3cf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:57.344964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-771a826c-5e89-4c6a-a2bc-8fb3395116cd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.155082 Oct 28 20:20:57.345338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15f8c89a-5177-40f5-bf0a-38b60d6f3cf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:57.345565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1059/2131] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:57 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:57.345841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15f8c89a-5177-40f5-bf0a-38b60d6f3cf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:57.346278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15f8c89a-5177-40f5-bf0a-38b60d6f3cf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:57.346980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15f8c89a-5177-40f5-bf0a-38b60d6f3cf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:57.347439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15f8c89a-5177-40f5-bf0a-38b60d6f3cf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:57.347864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15f8c89a-5177-40f5-bf0a-38b60d6f3cf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:57.474221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-15f8c89a-5177-40f5-bf0a-38b60d6f3cf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:57.482910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-15f8c89a-5177-40f5-bf0a-38b60d6f3cf0 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.148434 Oct 28 20:20:57.483481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1073/2132] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:57 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:58.040082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f61799a-b1a7-40c2-8e80-849dfa33aecc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:58.042305 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0f61799a-b1a7-40c2-8e80-849dfa33aecc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:58.048245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f61799a-b1a7-40c2-8e80-849dfa33aecc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:58.048731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f61799a-b1a7-40c2-8e80-849dfa33aecc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:58.058246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f61799a-b1a7-40c2-8e80-849dfa33aecc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:58.058246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f61799a-b1a7-40c2-8e80-849dfa33aecc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:58.058246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f61799a-b1a7-40c2-8e80-849dfa33aecc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:58.058246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f61799a-b1a7-40c2-8e80-849dfa33aecc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:58.080336 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0f61799a-b1a7-40c2-8e80-849dfa33aecc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044172 Oct 28 20:20:58.080894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1060/2133] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:58 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:58.368402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0e61cbb-be73-4636-bb16-68b7b1dad16a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:58.368951 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0e61cbb-be73-4636-bb16-68b7b1dad16a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:58.376057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e61cbb-be73-4636-bb16-68b7b1dad16a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:58.376538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e61cbb-be73-4636-bb16-68b7b1dad16a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:58.376971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e61cbb-be73-4636-bb16-68b7b1dad16a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:58.377671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e61cbb-be73-4636-bb16-68b7b1dad16a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:58.378122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e61cbb-be73-4636-bb16-68b7b1dad16a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:58.378542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e61cbb-be73-4636-bb16-68b7b1dad16a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:58.506513 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6684456c-618f-4e0e-ad31-4c61c160f9f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:58.507262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6684456c-618f-4e0e-ad31-4c61c160f9f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:58.508071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0e61cbb-be73-4636-bb16-68b7b1dad16a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:58.513837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6684456c-618f-4e0e-ad31-4c61c160f9f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:58.514320 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6684456c-618f-4e0e-ad31-4c61c160f9f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:58.514753 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6684456c-618f-4e0e-ad31-4c61c160f9f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:58.515444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6684456c-618f-4e0e-ad31-4c61c160f9f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:58.515896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6684456c-618f-4e0e-ad31-4c61c160f9f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:58.516318 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6684456c-618f-4e0e-ad31-4c61c160f9f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:58.516792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0e61cbb-be73-4636-bb16-68b7b1dad16a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152318 Oct 28 20:20:58.517391 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1074/2134] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:58 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:58.646072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6684456c-618f-4e0e-ad31-4c61c160f9f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:58.654943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6684456c-618f-4e0e-ad31-4c61c160f9f1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152258 Oct 28 20:20:58.655498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1061/2135] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:58 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:59.093284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32c0b469-e597-49d6-bfdb-48fedb28d770 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:59.095541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-32c0b469-e597-49d6-bfdb-48fedb28d770 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:59.101684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32c0b469-e597-49d6-bfdb-48fedb28d770 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:59.102170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32c0b469-e597-49d6-bfdb-48fedb28d770 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:59.102610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32c0b469-e597-49d6-bfdb-48fedb28d770 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:59.103301 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32c0b469-e597-49d6-bfdb-48fedb28d770 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:59.103759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32c0b469-e597-49d6-bfdb-48fedb28d770 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:59.104189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32c0b469-e597-49d6-bfdb-48fedb28d770 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:59.135135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-32c0b469-e597-49d6-bfdb-48fedb28d770 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045978 Oct 28 20:20:59.135700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1075/2136] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:59 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:59.540290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-987aa224-63a3-44b4-9974-258355fac3c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:59.540944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-987aa224-63a3-44b4-9974-258355fac3c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:59.548244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-987aa224-63a3-44b4-9974-258355fac3c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:59.548731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-987aa224-63a3-44b4-9974-258355fac3c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:59.549174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-987aa224-63a3-44b4-9974-258355fac3c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:59.549889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-987aa224-63a3-44b4-9974-258355fac3c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:59.550344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-987aa224-63a3-44b4-9974-258355fac3c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:59.550770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-987aa224-63a3-44b4-9974-258355fac3c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:59.677775 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-93e7f1a2-3131-4855-8d09-2c007fedba8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:59.678882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-93e7f1a2-3131-4855-8d09-2c007fedba8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:59.683775 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-987aa224-63a3-44b4-9974-258355fac3c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:59.685630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93e7f1a2-3131-4855-8d09-2c007fedba8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:59.687952 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93e7f1a2-3131-4855-8d09-2c007fedba8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:59.687952 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93e7f1a2-3131-4855-8d09-2c007fedba8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:59.688546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93e7f1a2-3131-4855-8d09-2c007fedba8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:59.689206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93e7f1a2-3131-4855-8d09-2c007fedba8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:59.689569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93e7f1a2-3131-4855-8d09-2c007fedba8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:59.695761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-987aa224-63a3-44b4-9974-258355fac3c1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.159197 Oct 28 20:20:59.696659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1062/2137] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:59 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:59.833485 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-93e7f1a2-3131-4855-8d09-2c007fedba8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:59.841698 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-93e7f1a2-3131-4855-8d09-2c007fedba8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.167841 Oct 28 20:20:59.842267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1076/2138] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:59 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:00.148530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e5fa221c-ac40-41f3-a352-232c33064b21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:00.150782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e5fa221c-ac40-41f3-a352-232c33064b21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:00.157060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5fa221c-ac40-41f3-a352-232c33064b21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:00.157584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5fa221c-ac40-41f3-a352-232c33064b21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:00.158030 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5fa221c-ac40-41f3-a352-232c33064b21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:00.158719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5fa221c-ac40-41f3-a352-232c33064b21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:00.159178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5fa221c-ac40-41f3-a352-232c33064b21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:00.159606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5fa221c-ac40-41f3-a352-232c33064b21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:00.189620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e5fa221c-ac40-41f3-a352-232c33064b21 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044973 Oct 28 20:21:00.190187 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1063/2139] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:00 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:00.726492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-badd438c-4d9f-47cb-8e83-55006a6987d8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:00.727123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-badd438c-4d9f-47cb-8e83-55006a6987d8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:00.733994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-badd438c-4d9f-47cb-8e83-55006a6987d8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:00.734412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-badd438c-4d9f-47cb-8e83-55006a6987d8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:00.734849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-badd438c-4d9f-47cb-8e83-55006a6987d8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:00.735542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-badd438c-4d9f-47cb-8e83-55006a6987d8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:00.736000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-badd438c-4d9f-47cb-8e83-55006a6987d8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:00.736427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-badd438c-4d9f-47cb-8e83-55006a6987d8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:00.865760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-badd438c-4d9f-47cb-8e83-55006a6987d8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:00.866001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0eaf76b-f29f-4489-a8f0-4b3600e8f3da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:00.866461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0eaf76b-f29f-4489-a8f0-4b3600e8f3da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:00.873762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0eaf76b-f29f-4489-a8f0-4b3600e8f3da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:00.874244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0eaf76b-f29f-4489-a8f0-4b3600e8f3da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:00.875032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0eaf76b-f29f-4489-a8f0-4b3600e8f3da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:00.875157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-badd438c-4d9f-47cb-8e83-55006a6987d8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152413 Oct 28 20:21:00.875711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1077/2140] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:00 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:00.875884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0eaf76b-f29f-4489-a8f0-4b3600e8f3da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:00.876180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0eaf76b-f29f-4489-a8f0-4b3600e8f3da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:00.876604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0eaf76b-f29f-4489-a8f0-4b3600e8f3da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:01.006471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c0eaf76b-f29f-4489-a8f0-4b3600e8f3da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:01.014812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c0eaf76b-f29f-4489-a8f0-4b3600e8f3da tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154224 Oct 28 20:21:01.015385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1064/2141] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:00 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:01.202366 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-79c6caaa-7aae-4208-a9f9-70ebd446c232 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:01.204497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-79c6caaa-7aae-4208-a9f9-70ebd446c232 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:01.210393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c6caaa-7aae-4208-a9f9-70ebd446c232 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:01.210876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c6caaa-7aae-4208-a9f9-70ebd446c232 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:01.211315 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c6caaa-7aae-4208-a9f9-70ebd446c232 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:01.212002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c6caaa-7aae-4208-a9f9-70ebd446c232 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:01.212726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c6caaa-7aae-4208-a9f9-70ebd446c232 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:01.213158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c6caaa-7aae-4208-a9f9-70ebd446c232 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:01.242691 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-79c6caaa-7aae-4208-a9f9-70ebd446c232 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044551 Oct 28 20:21:01.243256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1078/2142] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:01 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:01.899016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-594b84be-2f56-4532-aef1-ff922c0c10b8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:01.899653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-594b84be-2f56-4532-aef1-ff922c0c10b8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:01.906933 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-594b84be-2f56-4532-aef1-ff922c0c10b8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:01.907419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-594b84be-2f56-4532-aef1-ff922c0c10b8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:01.907861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-594b84be-2f56-4532-aef1-ff922c0c10b8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:01.908544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-594b84be-2f56-4532-aef1-ff922c0c10b8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:01.908999 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-594b84be-2f56-4532-aef1-ff922c0c10b8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:01.909528 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-594b84be-2f56-4532-aef1-ff922c0c10b8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:02.037682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf4a3f36-e606-4818-92bd-19dfe4dbd59c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:02.038380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cf4a3f36-e606-4818-92bd-19dfe4dbd59c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:02.038992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-594b84be-2f56-4532-aef1-ff922c0c10b8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:02.045590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf4a3f36-e606-4818-92bd-19dfe4dbd59c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:02.046139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf4a3f36-e606-4818-92bd-19dfe4dbd59c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:02.046650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf4a3f36-e606-4818-92bd-19dfe4dbd59c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:02.047414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf4a3f36-e606-4818-92bd-19dfe4dbd59c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:02.047527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-594b84be-2f56-4532-aef1-ff922c0c10b8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152204 Oct 28 20:21:02.047991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1065/2143] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:01 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:02.048113 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf4a3f36-e606-4818-92bd-19dfe4dbd59c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:02.048483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf4a3f36-e606-4818-92bd-19dfe4dbd59c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:02.174767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cf4a3f36-e606-4818-92bd-19dfe4dbd59c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:02.182863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cf4a3f36-e606-4818-92bd-19dfe4dbd59c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149115 Oct 28 20:21:02.183430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1079/2144] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:02 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:02.255704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d32e8d1a-09e8-48fb-a5c2-10a9fd44ae47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:02.258862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d32e8d1a-09e8-48fb-a5c2-10a9fd44ae47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:02.266250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d32e8d1a-09e8-48fb-a5c2-10a9fd44ae47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:02.266742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d32e8d1a-09e8-48fb-a5c2-10a9fd44ae47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:02.267185 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d32e8d1a-09e8-48fb-a5c2-10a9fd44ae47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:02.267888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d32e8d1a-09e8-48fb-a5c2-10a9fd44ae47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:02.268350 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d32e8d1a-09e8-48fb-a5c2-10a9fd44ae47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:02.268782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d32e8d1a-09e8-48fb-a5c2-10a9fd44ae47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:02.298648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d32e8d1a-09e8-48fb-a5c2-10a9fd44ae47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046945 Oct 28 20:21:02.299218 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1066/2145] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:02 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:03.070806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-704f056f-bd52-4509-8a5d-467e82ff4dc7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:03.071419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-704f056f-bd52-4509-8a5d-467e82ff4dc7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:03.077849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-704f056f-bd52-4509-8a5d-467e82ff4dc7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:03.078322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-704f056f-bd52-4509-8a5d-467e82ff4dc7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:03.078754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-704f056f-bd52-4509-8a5d-467e82ff4dc7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:03.079432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-704f056f-bd52-4509-8a5d-467e82ff4dc7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:03.079913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-704f056f-bd52-4509-8a5d-467e82ff4dc7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:03.080349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-704f056f-bd52-4509-8a5d-467e82ff4dc7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:03.206610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-54be2d8e-16d6-4e92-947e-59a48787b286 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:03.207228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-54be2d8e-16d6-4e92-947e-59a48787b286 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:03.209286 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:21:03.209453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:21:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 (ip 10.222.0.66) !!! Oct 28 20:21:03.217406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54be2d8e-16d6-4e92-947e-59a48787b286 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:03.217551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54be2d8e-16d6-4e92-947e-59a48787b286 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:03.218080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54be2d8e-16d6-4e92-947e-59a48787b286 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:03.218595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-704f056f-bd52-4509-8a5d-467e82ff4dc7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:03.218785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54be2d8e-16d6-4e92-947e-59a48787b286 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:03.219449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54be2d8e-16d6-4e92-947e-59a48787b286 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:03.219884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54be2d8e-16d6-4e92-947e-59a48787b286 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:03.226775 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-704f056f-bd52-4509-8a5d-467e82ff4dc7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.159773 Oct 28 20:21:03.227680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1080/2146] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:03 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:03.311449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-37b14d8c-5e8c-4179-8ca8-60f4d8b12fea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:03.313792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-37b14d8c-5e8c-4179-8ca8-60f4d8b12fea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:03.319724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37b14d8c-5e8c-4179-8ca8-60f4d8b12fea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:03.320214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37b14d8c-5e8c-4179-8ca8-60f4d8b12fea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:03.320661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37b14d8c-5e8c-4179-8ca8-60f4d8b12fea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:03.326329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37b14d8c-5e8c-4179-8ca8-60f4d8b12fea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:03.326329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37b14d8c-5e8c-4179-8ca8-60f4d8b12fea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:03.326329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37b14d8c-5e8c-4179-8ca8-60f4d8b12fea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:03.353786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-37b14d8c-5e8c-4179-8ca8-60f4d8b12fea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046539 Oct 28 20:21:03.355112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1081/2147] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:03 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:21:03.359774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-54be2d8e-16d6-4e92-947e-59a48787b286 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:03.369610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-54be2d8e-16d6-4e92-947e-59a48787b286 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.166847 Oct 28 20:21:03.370362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1067/2148] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:03 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:04.250233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-08813d28-ab31-43b8-a309-62f533bb4805 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:04.250862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-08813d28-ab31-43b8-a309-62f533bb4805 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:04.257301 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08813d28-ab31-43b8-a309-62f533bb4805 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:04.257818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08813d28-ab31-43b8-a309-62f533bb4805 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:04.258261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08813d28-ab31-43b8-a309-62f533bb4805 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:04.258952 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08813d28-ab31-43b8-a309-62f533bb4805 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:04.259441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08813d28-ab31-43b8-a309-62f533bb4805 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:04.259871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08813d28-ab31-43b8-a309-62f533bb4805 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:04.365862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e5b74a1b-be40-4be0-a583-341f839a8f8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:04.368334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e5b74a1b-be40-4be0-a583-341f839a8f8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:04.375347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5b74a1b-be40-4be0-a583-341f839a8f8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:04.375840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5b74a1b-be40-4be0-a583-341f839a8f8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:04.376280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5b74a1b-be40-4be0-a583-341f839a8f8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:04.376983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5b74a1b-be40-4be0-a583-341f839a8f8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:04.377473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5b74a1b-be40-4be0-a583-341f839a8f8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:04.377913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5b74a1b-be40-4be0-a583-341f839a8f8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:04.395087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-08813d28-ab31-43b8-a309-62f533bb4805 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:04.403814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-08813d28-ab31-43b8-a309-62f533bb4805 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.157680 Oct 28 20:21:04.404389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1082/2149] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:04 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:04.407560 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e5b74a1b-be40-4be0-a583-341f839a8f8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045600 Oct 28 20:21:04.408118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1068/2150] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:04 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:21:04.408817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-316fc9ed-65f5-4500-af71-397c2f9c7139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:04.409640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-316fc9ed-65f5-4500-af71-397c2f9c7139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:04.415543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-316fc9ed-65f5-4500-af71-397c2f9c7139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:04.416025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-316fc9ed-65f5-4500-af71-397c2f9c7139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:04.416583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-316fc9ed-65f5-4500-af71-397c2f9c7139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:04.417183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-316fc9ed-65f5-4500-af71-397c2f9c7139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:04.417665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-316fc9ed-65f5-4500-af71-397c2f9c7139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:04.418437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-316fc9ed-65f5-4500-af71-397c2f9c7139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:04.548055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-316fc9ed-65f5-4500-af71-397c2f9c7139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:04.556040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-316fc9ed-65f5-4500-af71-397c2f9c7139 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150729 Oct 28 20:21:04.556607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1083/2151] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:04 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:05.419982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-912fb08a-980f-4dca-aa31-6f02c4092f7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:05.422266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-912fb08a-980f-4dca-aa31-6f02c4092f7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:05.426831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8d38f2a9-e4d7-40fb-8570-09fd0c0509d6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:05.427574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8d38f2a9-e4d7-40fb-8570-09fd0c0509d6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:05.430150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-912fb08a-980f-4dca-aa31-6f02c4092f7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:05.430649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-912fb08a-980f-4dca-aa31-6f02c4092f7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:05.431085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-912fb08a-980f-4dca-aa31-6f02c4092f7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:05.431790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-912fb08a-980f-4dca-aa31-6f02c4092f7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:05.432250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-912fb08a-980f-4dca-aa31-6f02c4092f7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:05.432688 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-912fb08a-980f-4dca-aa31-6f02c4092f7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:05.434420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d38f2a9-e4d7-40fb-8570-09fd0c0509d6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:05.434952 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d38f2a9-e4d7-40fb-8570-09fd0c0509d6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:05.435401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d38f2a9-e4d7-40fb-8570-09fd0c0509d6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:05.436106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d38f2a9-e4d7-40fb-8570-09fd0c0509d6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:05.436558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d38f2a9-e4d7-40fb-8570-09fd0c0509d6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:05.436980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d38f2a9-e4d7-40fb-8570-09fd0c0509d6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:05.463509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-912fb08a-980f-4dca-aa31-6f02c4092f7b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047548 Oct 28 20:21:05.464275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1069/2152] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:05 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:05.568956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8d38f2a9-e4d7-40fb-8570-09fd0c0509d6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:05.577896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8d38f2a9-e4d7-40fb-8570-09fd0c0509d6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.154791 Oct 28 20:21:05.578456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1084/2153] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:05 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:05.580084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3aff4cee-d6cd-49ab-9dac-bdc1c7db3635 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:05.580699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3aff4cee-d6cd-49ab-9dac-bdc1c7db3635 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:05.586689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aff4cee-d6cd-49ab-9dac-bdc1c7db3635 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:05.587179 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aff4cee-d6cd-49ab-9dac-bdc1c7db3635 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:05.587888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aff4cee-d6cd-49ab-9dac-bdc1c7db3635 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:05.588576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aff4cee-d6cd-49ab-9dac-bdc1c7db3635 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:05.589034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aff4cee-d6cd-49ab-9dac-bdc1c7db3635 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:05.589495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aff4cee-d6cd-49ab-9dac-bdc1c7db3635 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:05.717755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3aff4cee-d6cd-49ab-9dac-bdc1c7db3635 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:05.725843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3aff4cee-d6cd-49ab-9dac-bdc1c7db3635 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149562 Oct 28 20:21:05.726412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1070/2154] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:05 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:06.476141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cb305800-387d-4e7b-89f5-e4ce34bfd852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:06.478348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cb305800-387d-4e7b-89f5-e4ce34bfd852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:06.485441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb305800-387d-4e7b-89f5-e4ce34bfd852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:06.485916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb305800-387d-4e7b-89f5-e4ce34bfd852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:06.486375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb305800-387d-4e7b-89f5-e4ce34bfd852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:06.487052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb305800-387d-4e7b-89f5-e4ce34bfd852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:06.487758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb305800-387d-4e7b-89f5-e4ce34bfd852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:06.488189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb305800-387d-4e7b-89f5-e4ce34bfd852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:06.490508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:06.517831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cb305800-387d-4e7b-89f5-e4ce34bfd852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045527 Oct 28 20:21:06.518386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1085/2155] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:06 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:06.601106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-072a6e1c-1a87-422c-84a9-8cc99428baea tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:06.601742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-072a6e1c-1a87-422c-84a9-8cc99428baea tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:06.604017 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=80 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:06.609429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-072a6e1c-1a87-422c-84a9-8cc99428baea tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:06.609912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-072a6e1c-1a87-422c-84a9-8cc99428baea tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:06.610345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-072a6e1c-1a87-422c-84a9-8cc99428baea tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:06.611103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-072a6e1c-1a87-422c-84a9-8cc99428baea tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:06.611548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-072a6e1c-1a87-422c-84a9-8cc99428baea tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:06.611966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-072a6e1c-1a87-422c-84a9-8cc99428baea tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:06.741274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-072a6e1c-1a87-422c-84a9-8cc99428baea tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:06.748374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5ad0dd21-786e-41d4-8576-2c5a4e31e4c8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:06.748991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5ad0dd21-786e-41d4-8576-2c5a4e31e4c8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:06.749602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-072a6e1c-1a87-422c-84a9-8cc99428baea tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152215 Oct 28 20:21:06.750165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1071/2156] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:06 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:06.754971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ad0dd21-786e-41d4-8576-2c5a4e31e4c8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:06.755476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ad0dd21-786e-41d4-8576-2c5a4e31e4c8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:06.755900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ad0dd21-786e-41d4-8576-2c5a4e31e4c8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:06.756593 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ad0dd21-786e-41d4-8576-2c5a4e31e4c8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:06.757050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ad0dd21-786e-41d4-8576-2c5a4e31e4c8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:06.757506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ad0dd21-786e-41d4-8576-2c5a4e31e4c8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:06.894087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5ad0dd21-786e-41d4-8576-2c5a4e31e4c8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:06.902253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5ad0dd21-786e-41d4-8576-2c5a4e31e4c8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.158104 Oct 28 20:21:06.903363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1086/2157] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:06 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:07.530324 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ee61eed3-4e95-41d7-bc65-da34967de60d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:07.533220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ee61eed3-4e95-41d7-bc65-da34967de60d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:07.539153 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee61eed3-4e95-41d7-bc65-da34967de60d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:07.539631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee61eed3-4e95-41d7-bc65-da34967de60d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:07.540059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee61eed3-4e95-41d7-bc65-da34967de60d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:07.540739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee61eed3-4e95-41d7-bc65-da34967de60d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:07.541193 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee61eed3-4e95-41d7-bc65-da34967de60d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:07.541638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee61eed3-4e95-41d7-bc65-da34967de60d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:07.570407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ee61eed3-4e95-41d7-bc65-da34967de60d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044082 Oct 28 20:21:07.570946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1072/2158] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:07 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:07.772199 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bcb336d9-3337-4478-8757-a2a507029cdc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:07.772848 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bcb336d9-3337-4478-8757-a2a507029cdc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:07.775287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=84 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:07.779936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb336d9-3337-4478-8757-a2a507029cdc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:07.780411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb336d9-3337-4478-8757-a2a507029cdc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:07.780843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb336d9-3337-4478-8757-a2a507029cdc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:07.781557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb336d9-3337-4478-8757-a2a507029cdc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:07.782010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb336d9-3337-4478-8757-a2a507029cdc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:07.782433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb336d9-3337-4478-8757-a2a507029cdc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:07.913083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bcb336d9-3337-4478-8757-a2a507029cdc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:07.919589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bcb336d9-3337-4478-8757-a2a507029cdc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151140 Oct 28 20:21:07.920128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1087/2159] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:07 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:07.925574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8649b2b1-7d2a-426b-8210-c71abbb58b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:07.926268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8649b2b1-7d2a-426b-8210-c71abbb58b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:07.932614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8649b2b1-7d2a-426b-8210-c71abbb58b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:07.933168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8649b2b1-7d2a-426b-8210-c71abbb58b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:07.934301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8649b2b1-7d2a-426b-8210-c71abbb58b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:07.935153 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8649b2b1-7d2a-426b-8210-c71abbb58b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:07.935623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8649b2b1-7d2a-426b-8210-c71abbb58b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:07.936048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8649b2b1-7d2a-426b-8210-c71abbb58b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:08.066514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8649b2b1-7d2a-426b-8210-c71abbb58b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:08.075496 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8649b2b1-7d2a-426b-8210-c71abbb58b49 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153734 Oct 28 20:21:08.076155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1073/2160] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:07 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:08.583470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a28116bd-580f-4ed4-b695-ccfc5e8d6535 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:08.585683 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a28116bd-580f-4ed4-b695-ccfc5e8d6535 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:08.592087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a28116bd-580f-4ed4-b695-ccfc5e8d6535 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:08.592570 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a28116bd-580f-4ed4-b695-ccfc5e8d6535 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:08.593007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a28116bd-580f-4ed4-b695-ccfc5e8d6535 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:08.593721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a28116bd-580f-4ed4-b695-ccfc5e8d6535 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:08.594177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a28116bd-580f-4ed4-b695-ccfc5e8d6535 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:08.594599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a28116bd-580f-4ed4-b695-ccfc5e8d6535 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:08.624088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a28116bd-580f-4ed4-b695-ccfc5e8d6535 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Oct 28 20:21:08.624633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1088/2161] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:08 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:08.942829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c2dc0a35-51a0-46e3-b72b-9cca66dd160f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:08.943452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c2dc0a35-51a0-46e3-b72b-9cca66dd160f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:08.950055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2dc0a35-51a0-46e3-b72b-9cca66dd160f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:08.950546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2dc0a35-51a0-46e3-b72b-9cca66dd160f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:08.950982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2dc0a35-51a0-46e3-b72b-9cca66dd160f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:08.951669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2dc0a35-51a0-46e3-b72b-9cca66dd160f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:08.952123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2dc0a35-51a0-46e3-b72b-9cca66dd160f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:08.952547 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2dc0a35-51a0-46e3-b72b-9cca66dd160f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:08.956557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:09.082159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c2dc0a35-51a0-46e3-b72b-9cca66dd160f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:09.090650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c2dc0a35-51a0-46e3-b72b-9cca66dd160f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151750 Oct 28 20:21:09.091208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1074/2162] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:08 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:09.098798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b258aca-867b-45f9-b2b7-b35b82c3264a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:09.099409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0b258aca-867b-45f9-b2b7-b35b82c3264a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:09.106467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b258aca-867b-45f9-b2b7-b35b82c3264a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:09.106957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b258aca-867b-45f9-b2b7-b35b82c3264a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:09.107401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b258aca-867b-45f9-b2b7-b35b82c3264a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:09.108108 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b258aca-867b-45f9-b2b7-b35b82c3264a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:09.108558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b258aca-867b-45f9-b2b7-b35b82c3264a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:09.108980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b258aca-867b-45f9-b2b7-b35b82c3264a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:09.241046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0b258aca-867b-45f9-b2b7-b35b82c3264a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:09.249236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0b258aca-867b-45f9-b2b7-b35b82c3264a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154298 Oct 28 20:21:09.249822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1089/2163] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:09 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:09.636373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-748536d0-5081-4916-a605-017b38b1f1be tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:09.639076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-748536d0-5081-4916-a605-017b38b1f1be tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:09.645003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-748536d0-5081-4916-a605-017b38b1f1be tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:09.645522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-748536d0-5081-4916-a605-017b38b1f1be tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:09.645960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-748536d0-5081-4916-a605-017b38b1f1be tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:09.646645 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-748536d0-5081-4916-a605-017b38b1f1be tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:09.647101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-748536d0-5081-4916-a605-017b38b1f1be tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:09.647528 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-748536d0-5081-4916-a605-017b38b1f1be tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:09.678103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-748536d0-5081-4916-a605-017b38b1f1be tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045653 Oct 28 20:21:09.678655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1075/2164] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:09 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:10.115142 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-17221347-abd9-4688-a31b-b46866924b56 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:10.115791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-17221347-abd9-4688-a31b-b46866924b56 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:10.122790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17221347-abd9-4688-a31b-b46866924b56 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:10.123275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17221347-abd9-4688-a31b-b46866924b56 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:10.123713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17221347-abd9-4688-a31b-b46866924b56 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:10.124398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17221347-abd9-4688-a31b-b46866924b56 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:10.124850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17221347-abd9-4688-a31b-b46866924b56 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:10.125272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17221347-abd9-4688-a31b-b46866924b56 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:10.258708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-17221347-abd9-4688-a31b-b46866924b56 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:10.268021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-17221347-abd9-4688-a31b-b46866924b56 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.156718 Oct 28 20:21:10.268744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1090/2165] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:10 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:10.272975 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-67a49d85-748a-4d40-9ab8-399119fe46f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:10.273685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-67a49d85-748a-4d40-9ab8-399119fe46f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:10.280263 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67a49d85-748a-4d40-9ab8-399119fe46f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:10.280818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67a49d85-748a-4d40-9ab8-399119fe46f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:10.281366 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67a49d85-748a-4d40-9ab8-399119fe46f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:10.282176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67a49d85-748a-4d40-9ab8-399119fe46f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:10.282652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67a49d85-748a-4d40-9ab8-399119fe46f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:10.283166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67a49d85-748a-4d40-9ab8-399119fe46f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:10.413519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-67a49d85-748a-4d40-9ab8-399119fe46f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:10.422157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-67a49d85-748a-4d40-9ab8-399119fe46f8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154126 Oct 28 20:21:10.422728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1076/2166] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:10 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:10.690390 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6da75cdb-fee7-4f2a-9a3e-d000f990dd95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:10.692429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6da75cdb-fee7-4f2a-9a3e-d000f990dd95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:10.698276 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6da75cdb-fee7-4f2a-9a3e-d000f990dd95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:10.698779 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6da75cdb-fee7-4f2a-9a3e-d000f990dd95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:10.699232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6da75cdb-fee7-4f2a-9a3e-d000f990dd95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:10.699996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6da75cdb-fee7-4f2a-9a3e-d000f990dd95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:10.700443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6da75cdb-fee7-4f2a-9a3e-d000f990dd95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:10.700859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6da75cdb-fee7-4f2a-9a3e-d000f990dd95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:10.729777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6da75cdb-fee7-4f2a-9a3e-d000f990dd95 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043356 Oct 28 20:21:10.730312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1091/2167] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:10 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:11.290290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2814480f-8fdc-48d3-bc94-25e5aa6a0910 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:11.290912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2814480f-8fdc-48d3-bc94-25e5aa6a0910 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:11.298051 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2814480f-8fdc-48d3-bc94-25e5aa6a0910 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:11.298536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2814480f-8fdc-48d3-bc94-25e5aa6a0910 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:11.298973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2814480f-8fdc-48d3-bc94-25e5aa6a0910 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:11.299702 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2814480f-8fdc-48d3-bc94-25e5aa6a0910 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:11.300155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2814480f-8fdc-48d3-bc94-25e5aa6a0910 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:11.300582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2814480f-8fdc-48d3-bc94-25e5aa6a0910 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:11.432936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2814480f-8fdc-48d3-bc94-25e5aa6a0910 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:11.441802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2814480f-8fdc-48d3-bc94-25e5aa6a0910 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.156008 Oct 28 20:21:11.442369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1077/2168] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:11 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:11.445552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e3a976ad-5170-47f2-b471-140d96ddf4ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:11.446173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e3a976ad-5170-47f2-b471-140d96ddf4ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:11.452940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3a976ad-5170-47f2-b471-140d96ddf4ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:11.453450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3a976ad-5170-47f2-b471-140d96ddf4ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:11.453892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3a976ad-5170-47f2-b471-140d96ddf4ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:11.454580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3a976ad-5170-47f2-b471-140d96ddf4ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:11.455036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3a976ad-5170-47f2-b471-140d96ddf4ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:11.455458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3a976ad-5170-47f2-b471-140d96ddf4ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:11.583336 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e3a976ad-5170-47f2-b471-140d96ddf4ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:11.591766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e3a976ad-5170-47f2-b471-140d96ddf4ed tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150162 Oct 28 20:21:11.592322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1092/2169] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:11 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:11.742679 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f63e2cec-680f-4114-b849-ca9dc40607c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:11.744807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f63e2cec-680f-4114-b849-ca9dc40607c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:11.751212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f63e2cec-680f-4114-b849-ca9dc40607c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:11.751687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f63e2cec-680f-4114-b849-ca9dc40607c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:11.752118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f63e2cec-680f-4114-b849-ca9dc40607c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:11.752788 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f63e2cec-680f-4114-b849-ca9dc40607c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:11.753237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f63e2cec-680f-4114-b849-ca9dc40607c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:11.753681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f63e2cec-680f-4114-b849-ca9dc40607c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:11.782068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f63e2cec-680f-4114-b849-ca9dc40607c8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043340 Oct 28 20:21:11.782608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1078/2170] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:11 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:12.464558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-41997f9d-c0f6-49c6-9d85-c1e07f44bacc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:12.465791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-41997f9d-c0f6-49c6-9d85-c1e07f44bacc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:12.472032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41997f9d-c0f6-49c6-9d85-c1e07f44bacc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:12.472508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41997f9d-c0f6-49c6-9d85-c1e07f44bacc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:12.472983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41997f9d-c0f6-49c6-9d85-c1e07f44bacc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:12.473687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41997f9d-c0f6-49c6-9d85-c1e07f44bacc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:12.474133 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41997f9d-c0f6-49c6-9d85-c1e07f44bacc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:12.474548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41997f9d-c0f6-49c6-9d85-c1e07f44bacc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:12.606130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-41997f9d-c0f6-49c6-9d85-c1e07f44bacc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:12.613509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e1c255ea-5692-409c-a5b8-b735d2972660 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:12.614159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e1c255ea-5692-409c-a5b8-b735d2972660 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:12.614285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-41997f9d-c0f6-49c6-9d85-c1e07f44bacc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.153870 Oct 28 20:21:12.614861 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1093/2171] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:12 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:12.620597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1c255ea-5692-409c-a5b8-b735d2972660 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:12.621202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1c255ea-5692-409c-a5b8-b735d2972660 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:12.621782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1c255ea-5692-409c-a5b8-b735d2972660 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:12.622484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1c255ea-5692-409c-a5b8-b735d2972660 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:12.622946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1c255ea-5692-409c-a5b8-b735d2972660 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:12.623379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1c255ea-5692-409c-a5b8-b735d2972660 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:12.748486 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e1c255ea-5692-409c-a5b8-b735d2972660 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:12.756550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e1c255ea-5692-409c-a5b8-b735d2972660 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.146888 Oct 28 20:21:12.757116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1079/2172] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:12 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:12.794945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9d64eb56-a896-4806-ba5f-568de3ac355d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:12.797098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9d64eb56-a896-4806-ba5f-568de3ac355d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:12.803246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d64eb56-a896-4806-ba5f-568de3ac355d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:12.803673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d64eb56-a896-4806-ba5f-568de3ac355d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:12.804110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d64eb56-a896-4806-ba5f-568de3ac355d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:12.804795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d64eb56-a896-4806-ba5f-568de3ac355d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:12.805250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d64eb56-a896-4806-ba5f-568de3ac355d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:12.805704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d64eb56-a896-4806-ba5f-568de3ac355d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:12.837852 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9d64eb56-a896-4806-ba5f-568de3ac355d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047123 Oct 28 20:21:12.838460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1094/2173] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:12 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:13.638319 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7804514-0dc6-46fe-a154-15bda20af924 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:13.638849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7804514-0dc6-46fe-a154-15bda20af924 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:13.645273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7804514-0dc6-46fe-a154-15bda20af924 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:13.645790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7804514-0dc6-46fe-a154-15bda20af924 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:13.646226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7804514-0dc6-46fe-a154-15bda20af924 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:13.646910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7804514-0dc6-46fe-a154-15bda20af924 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:13.647360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7804514-0dc6-46fe-a154-15bda20af924 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:13.647782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7804514-0dc6-46fe-a154-15bda20af924 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:13.773002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7804514-0dc6-46fe-a154-15bda20af924 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:13.780777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5b3816bc-387b-41b3-a284-f3982684a90c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:13.781451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5b3816bc-387b-41b3-a284-f3982684a90c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:13.781847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7804514-0dc6-46fe-a154-15bda20af924 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.147971 Oct 28 20:21:13.782421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1080/2174] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:13 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:13.787929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b3816bc-387b-41b3-a284-f3982684a90c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:13.788421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b3816bc-387b-41b3-a284-f3982684a90c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:13.788862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b3816bc-387b-41b3-a284-f3982684a90c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:13.789582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b3816bc-387b-41b3-a284-f3982684a90c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:13.790042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b3816bc-387b-41b3-a284-f3982684a90c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:13.790465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b3816bc-387b-41b3-a284-f3982684a90c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:13.850966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6e6d4389-00fa-40a7-ae2f-1f127f461be1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:13.853117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6e6d4389-00fa-40a7-ae2f-1f127f461be1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:13.859596 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e6d4389-00fa-40a7-ae2f-1f127f461be1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:13.860079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e6d4389-00fa-40a7-ae2f-1f127f461be1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:13.860520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e6d4389-00fa-40a7-ae2f-1f127f461be1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:13.861208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e6d4389-00fa-40a7-ae2f-1f127f461be1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:13.861687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e6d4389-00fa-40a7-ae2f-1f127f461be1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:13.862111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e6d4389-00fa-40a7-ae2f-1f127f461be1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:13.891817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6e6d4389-00fa-40a7-ae2f-1f127f461be1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044704 Oct 28 20:21:13.896355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1081/2175] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:13 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:21:13.923275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5b3816bc-387b-41b3-a284-f3982684a90c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:13.931443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5b3816bc-387b-41b3-a284-f3982684a90c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155370 Oct 28 20:21:13.934063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1095/2176] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:13 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:14.805091 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-51975af0-7687-4d05-8ffc-ce3fbd4f5ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:14.805739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-51975af0-7687-4d05-8ffc-ce3fbd4f5ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:14.812321 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51975af0-7687-4d05-8ffc-ce3fbd4f5ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:14.812812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51975af0-7687-4d05-8ffc-ce3fbd4f5ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:14.813313 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51975af0-7687-4d05-8ffc-ce3fbd4f5ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:14.813974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51975af0-7687-4d05-8ffc-ce3fbd4f5ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:14.814433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51975af0-7687-4d05-8ffc-ce3fbd4f5ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:14.814905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51975af0-7687-4d05-8ffc-ce3fbd4f5ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:14.904938 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6543e4c9-511a-41b3-8de4-dfff9d41e3cb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:14.907079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6543e4c9-511a-41b3-8de4-dfff9d41e3cb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:14.913613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6543e4c9-511a-41b3-8de4-dfff9d41e3cb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:14.914099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6543e4c9-511a-41b3-8de4-dfff9d41e3cb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:14.914542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6543e4c9-511a-41b3-8de4-dfff9d41e3cb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:14.915238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6543e4c9-511a-41b3-8de4-dfff9d41e3cb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:14.915692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6543e4c9-511a-41b3-8de4-dfff9d41e3cb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:14.916116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6543e4c9-511a-41b3-8de4-dfff9d41e3cb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:14.949123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6543e4c9-511a-41b3-8de4-dfff9d41e3cb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048558 Oct 28 20:21:14.954268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1096/2177] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:14 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:21:14.954442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-51975af0-7687-4d05-8ffc-ce3fbd4f5ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:14.958397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3f12bba3-610a-4039-90d0-aed2e4756fd2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:14.959016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3f12bba3-610a-4039-90d0-aed2e4756fd2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:14.961823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-51975af0-7687-4d05-8ffc-ce3fbd4f5ac7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.160474 Oct 28 20:21:14.962421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1082/2178] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:14 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:14.965692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f12bba3-610a-4039-90d0-aed2e4756fd2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:14.966186 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f12bba3-610a-4039-90d0-aed2e4756fd2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:14.966628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f12bba3-610a-4039-90d0-aed2e4756fd2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:14.967354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f12bba3-610a-4039-90d0-aed2e4756fd2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:14.967813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f12bba3-610a-4039-90d0-aed2e4756fd2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:14.968263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f12bba3-610a-4039-90d0-aed2e4756fd2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:15.109616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3f12bba3-610a-4039-90d0-aed2e4756fd2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:15.117767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3f12bba3-610a-4039-90d0-aed2e4756fd2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.165830 Oct 28 20:21:15.118335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1097/2179] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:14 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:15.961847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-261561f0-1116-4599-bd6c-378887c64c41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:15.964276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-261561f0-1116-4599-bd6c-378887c64c41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:15.971204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261561f0-1116-4599-bd6c-378887c64c41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:15.971687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261561f0-1116-4599-bd6c-378887c64c41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:15.972123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261561f0-1116-4599-bd6c-378887c64c41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:15.972810 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261561f0-1116-4599-bd6c-378887c64c41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:15.973260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261561f0-1116-4599-bd6c-378887c64c41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:15.973740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261561f0-1116-4599-bd6c-378887c64c41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:15.984417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1af4537-395c-497a-8118-6d3f0fbc748a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:15.985061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f1af4537-395c-497a-8118-6d3f0fbc748a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:15.991660 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1af4537-395c-497a-8118-6d3f0fbc748a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:15.992141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1af4537-395c-497a-8118-6d3f0fbc748a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:15.992572 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1af4537-395c-497a-8118-6d3f0fbc748a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:15.993259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1af4537-395c-497a-8118-6d3f0fbc748a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:15.993742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1af4537-395c-497a-8118-6d3f0fbc748a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:15.994165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1af4537-395c-497a-8118-6d3f0fbc748a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:16.005150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-261561f0-1116-4599-bd6c-378887c64c41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047227 Oct 28 20:21:16.005764 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1083/2180] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:15 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:16.128205 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1af4537-395c-497a-8118-6d3f0fbc748a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:16.136441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1af4537-395c-497a-8118-6d3f0fbc748a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.156003 Oct 28 20:21:16.137690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1098/2181] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:15 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:16.141829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ae7082cb-69a8-4fcc-96b3-22b001af7e70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:16.142444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ae7082cb-69a8-4fcc-96b3-22b001af7e70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:16.148363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae7082cb-69a8-4fcc-96b3-22b001af7e70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:16.148841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae7082cb-69a8-4fcc-96b3-22b001af7e70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:16.149277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae7082cb-69a8-4fcc-96b3-22b001af7e70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:16.149980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae7082cb-69a8-4fcc-96b3-22b001af7e70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:16.150438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae7082cb-69a8-4fcc-96b3-22b001af7e70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:16.150862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae7082cb-69a8-4fcc-96b3-22b001af7e70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:16.278180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ae7082cb-69a8-4fcc-96b3-22b001af7e70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:16.286430 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ae7082cb-69a8-4fcc-96b3-22b001af7e70 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.148522 Oct 28 20:21:16.287017 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1084/2182] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:16 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:17.018222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5555e739-b444-4969-96d0-75a21b995d92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:17.020348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5555e739-b444-4969-96d0-75a21b995d92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:17.026576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5555e739-b444-4969-96d0-75a21b995d92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:17.027058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5555e739-b444-4969-96d0-75a21b995d92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:17.027497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5555e739-b444-4969-96d0-75a21b995d92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:17.028198 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5555e739-b444-4969-96d0-75a21b995d92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:17.028642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5555e739-b444-4969-96d0-75a21b995d92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:17.029066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5555e739-b444-4969-96d0-75a21b995d92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:17.058101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5555e739-b444-4969-96d0-75a21b995d92 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043779 Oct 28 20:21:17.058642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1099/2183] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:17 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:17.159796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-415f0504-9bc7-4c1f-8bdb-745a54144853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:17.160405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-415f0504-9bc7-4c1f-8bdb-745a54144853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:17.166778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-415f0504-9bc7-4c1f-8bdb-745a54144853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:17.167262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-415f0504-9bc7-4c1f-8bdb-745a54144853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:17.167700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-415f0504-9bc7-4c1f-8bdb-745a54144853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:17.169030 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-415f0504-9bc7-4c1f-8bdb-745a54144853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:17.169639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-415f0504-9bc7-4c1f-8bdb-745a54144853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:17.170076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-415f0504-9bc7-4c1f-8bdb-745a54144853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:17.301099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-415f0504-9bc7-4c1f-8bdb-745a54144853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:17.310311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-415f0504-9bc7-4c1f-8bdb-745a54144853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.154292 Oct 28 20:21:17.310513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-46c62e5b-7c30-4b1a-8994-7c9d25ca0904 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:17.310875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1085/2184] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:17 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:17.310998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-46c62e5b-7c30-4b1a-8994-7c9d25ca0904 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:17.316938 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46c62e5b-7c30-4b1a-8994-7c9d25ca0904 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:17.317453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46c62e5b-7c30-4b1a-8994-7c9d25ca0904 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:17.317895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46c62e5b-7c30-4b1a-8994-7c9d25ca0904 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:17.318587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46c62e5b-7c30-4b1a-8994-7c9d25ca0904 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:17.319042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46c62e5b-7c30-4b1a-8994-7c9d25ca0904 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:17.319504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46c62e5b-7c30-4b1a-8994-7c9d25ca0904 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:17.444078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-46c62e5b-7c30-4b1a-8994-7c9d25ca0904 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:17.452343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-46c62e5b-7c30-4b1a-8994-7c9d25ca0904 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.146407 Oct 28 20:21:17.452906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1100/2185] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:17 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:18.071060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-62cf019d-17f9-4180-af87-cb51c4eeecc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:18.073198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-62cf019d-17f9-4180-af87-cb51c4eeecc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:18.079905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62cf019d-17f9-4180-af87-cb51c4eeecc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:18.080388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62cf019d-17f9-4180-af87-cb51c4eeecc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:18.080827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62cf019d-17f9-4180-af87-cb51c4eeecc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:18.081551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62cf019d-17f9-4180-af87-cb51c4eeecc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:18.082007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62cf019d-17f9-4180-af87-cb51c4eeecc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:18.082434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62cf019d-17f9-4180-af87-cb51c4eeecc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:18.111433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-62cf019d-17f9-4180-af87-cb51c4eeecc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044342 Oct 28 20:21:18.111974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1086/2186] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:18 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:18.333082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3a1b7e3d-e55d-48e8-b42b-da0a62f6658c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:18.333641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3a1b7e3d-e55d-48e8-b42b-da0a62f6658c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:18.340916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a1b7e3d-e55d-48e8-b42b-da0a62f6658c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:18.341419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a1b7e3d-e55d-48e8-b42b-da0a62f6658c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:18.341863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a1b7e3d-e55d-48e8-b42b-da0a62f6658c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:18.342544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a1b7e3d-e55d-48e8-b42b-da0a62f6658c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:18.342997 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a1b7e3d-e55d-48e8-b42b-da0a62f6658c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:18.343420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a1b7e3d-e55d-48e8-b42b-da0a62f6658c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:18.472458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3a1b7e3d-e55d-48e8-b42b-da0a62f6658c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:18.474714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:18.475878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dc59fd65-b019-4d45-906b-c184d0c7a376 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:18.476487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dc59fd65-b019-4d45-906b-c184d0c7a376 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:18.482735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3a1b7e3d-e55d-48e8-b42b-da0a62f6658c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.153490 Oct 28 20:21:18.483318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1101/2187] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:18 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:18.483794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc59fd65-b019-4d45-906b-c184d0c7a376 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:18.484348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc59fd65-b019-4d45-906b-c184d0c7a376 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:18.484786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc59fd65-b019-4d45-906b-c184d0c7a376 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:18.485754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc59fd65-b019-4d45-906b-c184d0c7a376 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:18.486207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc59fd65-b019-4d45-906b-c184d0c7a376 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:18.495745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc59fd65-b019-4d45-906b-c184d0c7a376 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:18.614916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-dc59fd65-b019-4d45-906b-c184d0c7a376 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:18.623165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dc59fd65-b019-4d45-906b-c184d0c7a376 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151063 Oct 28 20:21:18.623918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1087/2188] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:18 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:19.124865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3c5bc10e-1fa0-4bee-92f3-af5f64549620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:19.127017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3c5bc10e-1fa0-4bee-92f3-af5f64549620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:19.132919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c5bc10e-1fa0-4bee-92f3-af5f64549620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:19.133422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c5bc10e-1fa0-4bee-92f3-af5f64549620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:19.133858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c5bc10e-1fa0-4bee-92f3-af5f64549620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:19.134528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c5bc10e-1fa0-4bee-92f3-af5f64549620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:19.134977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c5bc10e-1fa0-4bee-92f3-af5f64549620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:19.135397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c5bc10e-1fa0-4bee-92f3-af5f64549620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:19.164255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3c5bc10e-1fa0-4bee-92f3-af5f64549620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Oct 28 20:21:19.164792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1102/2189] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:19 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:19.505530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-69336fe5-231b-4d50-a2f2-cf5e919d6082 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:19.506149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-69336fe5-231b-4d50-a2f2-cf5e919d6082 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:19.512990 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69336fe5-231b-4d50-a2f2-cf5e919d6082 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:19.513510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69336fe5-231b-4d50-a2f2-cf5e919d6082 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:19.513953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69336fe5-231b-4d50-a2f2-cf5e919d6082 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:19.514640 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69336fe5-231b-4d50-a2f2-cf5e919d6082 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:19.515098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69336fe5-231b-4d50-a2f2-cf5e919d6082 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:19.515533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69336fe5-231b-4d50-a2f2-cf5e919d6082 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:19.645311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-69336fe5-231b-4d50-a2f2-cf5e919d6082 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:19.646836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dd60e495-b611-4d56-84ee-407c24d0cdd8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:19.647677 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dd60e495-b611-4d56-84ee-407c24d0cdd8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:19.654559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd60e495-b611-4d56-84ee-407c24d0cdd8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:19.654747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-69336fe5-231b-4d50-a2f2-cf5e919d6082 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152836 Oct 28 20:21:19.655028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd60e495-b611-4d56-84ee-407c24d0cdd8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:19.655468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd60e495-b611-4d56-84ee-407c24d0cdd8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:19.655993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1088/2190] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:19 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:19.656174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd60e495-b611-4d56-84ee-407c24d0cdd8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:19.656646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd60e495-b611-4d56-84ee-407c24d0cdd8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:19.657073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd60e495-b611-4d56-84ee-407c24d0cdd8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:19.789693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd60e495-b611-4d56-84ee-407c24d0cdd8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:19.798770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dd60e495-b611-4d56-84ee-407c24d0cdd8 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155732 Oct 28 20:21:19.799534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1103/2191] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:19 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:20.176840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a701e56-130f-4cff-8f31-9955ce0f1926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:20.179084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a701e56-130f-4cff-8f31-9955ce0f1926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:20.184976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a701e56-130f-4cff-8f31-9955ce0f1926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:20.185485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a701e56-130f-4cff-8f31-9955ce0f1926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:20.185923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a701e56-130f-4cff-8f31-9955ce0f1926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:20.186604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a701e56-130f-4cff-8f31-9955ce0f1926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:20.187193 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a701e56-130f-4cff-8f31-9955ce0f1926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:20.187557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a701e56-130f-4cff-8f31-9955ce0f1926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:20.217241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a701e56-130f-4cff-8f31-9955ce0f1926 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044396 Oct 28 20:21:20.217809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1089/2192] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:20 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:20.678609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1e9736d6-defd-4189-99ba-1ee4879c06e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:20.679251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1e9736d6-defd-4189-99ba-1ee4879c06e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:20.685818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e9736d6-defd-4189-99ba-1ee4879c06e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:20.686300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e9736d6-defd-4189-99ba-1ee4879c06e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:20.686733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e9736d6-defd-4189-99ba-1ee4879c06e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:20.687410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e9736d6-defd-4189-99ba-1ee4879c06e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:20.687855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e9736d6-defd-4189-99ba-1ee4879c06e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:20.688271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e9736d6-defd-4189-99ba-1ee4879c06e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:20.816618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1e9736d6-defd-4189-99ba-1ee4879c06e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:20.821973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-99f1704e-5d02-40e7-8008-fc8e367e9b77 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:20.822592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-99f1704e-5d02-40e7-8008-fc8e367e9b77 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:20.825601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1e9736d6-defd-4189-99ba-1ee4879c06e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150568 Oct 28 20:21:20.826182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1104/2193] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:20 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:20.830216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99f1704e-5d02-40e7-8008-fc8e367e9b77 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:20.830708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99f1704e-5d02-40e7-8008-fc8e367e9b77 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:20.831147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99f1704e-5d02-40e7-8008-fc8e367e9b77 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:20.831841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99f1704e-5d02-40e7-8008-fc8e367e9b77 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:20.832301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99f1704e-5d02-40e7-8008-fc8e367e9b77 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:20.832730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99f1704e-5d02-40e7-8008-fc8e367e9b77 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:20.966279 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-99f1704e-5d02-40e7-8008-fc8e367e9b77 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:20.970736 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:20.977590 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-99f1704e-5d02-40e7-8008-fc8e367e9b77 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.159004 Oct 28 20:21:20.978631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1090/2194] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:20 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:21.229879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fb8dcf50-c589-4992-be99-1809c8fd3298 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:21.232533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fb8dcf50-c589-4992-be99-1809c8fd3298 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:21.238564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb8dcf50-c589-4992-be99-1809c8fd3298 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:21.239048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb8dcf50-c589-4992-be99-1809c8fd3298 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:21.239483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb8dcf50-c589-4992-be99-1809c8fd3298 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:21.240164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb8dcf50-c589-4992-be99-1809c8fd3298 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:21.240619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb8dcf50-c589-4992-be99-1809c8fd3298 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:21.241044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb8dcf50-c589-4992-be99-1809c8fd3298 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:21.269690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fb8dcf50-c589-4992-be99-1809c8fd3298 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043865 Oct 28 20:21:21.270239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1105/2195] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:21 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:21.849227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-23369171-88f6-4d50-a477-9d081a5ca8f6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:21.849877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-23369171-88f6-4d50-a477-9d081a5ca8f6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:21.857135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23369171-88f6-4d50-a477-9d081a5ca8f6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:21.857638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23369171-88f6-4d50-a477-9d081a5ca8f6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:21.858070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23369171-88f6-4d50-a477-9d081a5ca8f6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:21.858741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23369171-88f6-4d50-a477-9d081a5ca8f6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:21.859190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23369171-88f6-4d50-a477-9d081a5ca8f6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:21.859607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23369171-88f6-4d50-a477-9d081a5ca8f6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:21.989519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-23369171-88f6-4d50-a477-9d081a5ca8f6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:21.997829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-23369171-88f6-4d50-a477-9d081a5ca8f6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152438 Oct 28 20:21:21.998504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1091/2196] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:21 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:22.002080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9c922266-72dc-4185-9c79-2df40eac2811 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:22.002697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9c922266-72dc-4185-9c79-2df40eac2811 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:22.009023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c922266-72dc-4185-9c79-2df40eac2811 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:22.009546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c922266-72dc-4185-9c79-2df40eac2811 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:22.009981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c922266-72dc-4185-9c79-2df40eac2811 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:22.010662 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c922266-72dc-4185-9c79-2df40eac2811 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:22.011113 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c922266-72dc-4185-9c79-2df40eac2811 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:22.011534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c922266-72dc-4185-9c79-2df40eac2811 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:22.141504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9c922266-72dc-4185-9c79-2df40eac2811 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:22.149594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9c922266-72dc-4185-9c79-2df40eac2811 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151412 Oct 28 20:21:22.150157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1106/2197] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:21 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:22.282195 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c46aba50-19fd-40df-a188-b567f7f24d0f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:22.284236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c46aba50-19fd-40df-a188-b567f7f24d0f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:22.290159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c46aba50-19fd-40df-a188-b567f7f24d0f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:22.290644 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c46aba50-19fd-40df-a188-b567f7f24d0f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:22.291081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c46aba50-19fd-40df-a188-b567f7f24d0f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:22.291776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c46aba50-19fd-40df-a188-b567f7f24d0f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:22.292231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c46aba50-19fd-40df-a188-b567f7f24d0f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:22.292737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c46aba50-19fd-40df-a188-b567f7f24d0f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:22.322705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c46aba50-19fd-40df-a188-b567f7f24d0f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 Oct 28 20:21:22.323251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1092/2198] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:22 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:23.022311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7800ccf3-f21f-475e-aaf3-575faebfb243 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:23.022989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7800ccf3-f21f-475e-aaf3-575faebfb243 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:23.030351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7800ccf3-f21f-475e-aaf3-575faebfb243 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:23.030840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7800ccf3-f21f-475e-aaf3-575faebfb243 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:23.031280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7800ccf3-f21f-475e-aaf3-575faebfb243 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:23.031975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7800ccf3-f21f-475e-aaf3-575faebfb243 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:23.032433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7800ccf3-f21f-475e-aaf3-575faebfb243 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:23.033135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7800ccf3-f21f-475e-aaf3-575faebfb243 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:23.160011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7800ccf3-f21f-475e-aaf3-575faebfb243 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:23.168508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7800ccf3-f21f-475e-aaf3-575faebfb243 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149853 Oct 28 20:21:23.169084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1107/2199] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:23 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:23.172277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2a0a91c5-16b8-408e-8179-f88ac592cf5b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:23.172892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2a0a91c5-16b8-408e-8179-f88ac592cf5b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:23.179228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a0a91c5-16b8-408e-8179-f88ac592cf5b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:23.179703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a0a91c5-16b8-408e-8179-f88ac592cf5b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:23.180144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a0a91c5-16b8-408e-8179-f88ac592cf5b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:23.180822 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a0a91c5-16b8-408e-8179-f88ac592cf5b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:23.181274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a0a91c5-16b8-408e-8179-f88ac592cf5b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:23.181727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a0a91c5-16b8-408e-8179-f88ac592cf5b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:23.307631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2a0a91c5-16b8-408e-8179-f88ac592cf5b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:23.315880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2a0a91c5-16b8-408e-8179-f88ac592cf5b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.147846 Oct 28 20:21:23.316445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1093/2200] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:23 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:23.334802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2b33404f-3c1e-4616-a4f3-a0b8131cde2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:23.336987 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2b33404f-3c1e-4616-a4f3-a0b8131cde2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:23.343883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b33404f-3c1e-4616-a4f3-a0b8131cde2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:23.344359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b33404f-3c1e-4616-a4f3-a0b8131cde2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:23.344793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b33404f-3c1e-4616-a4f3-a0b8131cde2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:23.345489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b33404f-3c1e-4616-a4f3-a0b8131cde2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:23.345953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b33404f-3c1e-4616-a4f3-a0b8131cde2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:23.346381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b33404f-3c1e-4616-a4f3-a0b8131cde2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:23.376661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2b33404f-3c1e-4616-a4f3-a0b8131cde2a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045638 Oct 28 20:21:23.377172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1108/2201] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:23 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:24.190834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-700a8c96-7554-482a-8bc5-8449fc0896f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:24.191387 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-700a8c96-7554-482a-8bc5-8449fc0896f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:24.197831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-700a8c96-7554-482a-8bc5-8449fc0896f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:24.198314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-700a8c96-7554-482a-8bc5-8449fc0896f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:24.198752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-700a8c96-7554-482a-8bc5-8449fc0896f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:24.199491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-700a8c96-7554-482a-8bc5-8449fc0896f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:24.199941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-700a8c96-7554-482a-8bc5-8449fc0896f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:24.200364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-700a8c96-7554-482a-8bc5-8449fc0896f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:24.328651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-700a8c96-7554-482a-8bc5-8449fc0896f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:24.337072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-700a8c96-7554-482a-8bc5-8449fc0896f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150291 Oct 28 20:21:24.337671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1094/2202] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:24 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:24.340783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e05100f-c0f2-4cce-bf75-f81f3f84aa8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:24.341463 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4e05100f-c0f2-4cce-bf75-f81f3f84aa8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:24.347839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e05100f-c0f2-4cce-bf75-f81f3f84aa8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:24.348330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e05100f-c0f2-4cce-bf75-f81f3f84aa8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:24.348773 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e05100f-c0f2-4cce-bf75-f81f3f84aa8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:24.349491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e05100f-c0f2-4cce-bf75-f81f3f84aa8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:24.349951 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e05100f-c0f2-4cce-bf75-f81f3f84aa8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:24.350413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e05100f-c0f2-4cce-bf75-f81f3f84aa8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:24.389707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bc227729-0b4f-4344-bba0-505fa062ce91 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:24.392033 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bc227729-0b4f-4344-bba0-505fa062ce91 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:24.398244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc227729-0b4f-4344-bba0-505fa062ce91 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:24.398733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc227729-0b4f-4344-bba0-505fa062ce91 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:24.399171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc227729-0b4f-4344-bba0-505fa062ce91 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:24.400850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc227729-0b4f-4344-bba0-505fa062ce91 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:24.401312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc227729-0b4f-4344-bba0-505fa062ce91 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:24.401769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc227729-0b4f-4344-bba0-505fa062ce91 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:24.431718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bc227729-0b4f-4344-bba0-505fa062ce91 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047081 Oct 28 20:21:24.437009 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1095/2203] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:24 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:21:24.478923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e05100f-c0f2-4cce-bf75-f81f3f84aa8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:24.487165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4e05100f-c0f2-4cce-bf75-f81f3f84aa8b tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151479 Oct 28 20:21:24.487724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1109/2204] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:24 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:25.361412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-62107808-3d89-44f4-8f0e-391900fdfeec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:25.362056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-62107808-3d89-44f4-8f0e-391900fdfeec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:25.368142 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62107808-3d89-44f4-8f0e-391900fdfeec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:25.368628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62107808-3d89-44f4-8f0e-391900fdfeec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:25.369067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62107808-3d89-44f4-8f0e-391900fdfeec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:25.369779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62107808-3d89-44f4-8f0e-391900fdfeec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:25.370236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62107808-3d89-44f4-8f0e-391900fdfeec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:25.370660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62107808-3d89-44f4-8f0e-391900fdfeec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:25.444339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c7a86a50-6a39-4303-b44e-0ec5892b6fb8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:25.446585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c7a86a50-6a39-4303-b44e-0ec5892b6fb8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:25.453107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7a86a50-6a39-4303-b44e-0ec5892b6fb8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:25.453627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7a86a50-6a39-4303-b44e-0ec5892b6fb8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:25.454073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7a86a50-6a39-4303-b44e-0ec5892b6fb8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:25.454769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7a86a50-6a39-4303-b44e-0ec5892b6fb8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:25.455227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7a86a50-6a39-4303-b44e-0ec5892b6fb8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:25.455660 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7a86a50-6a39-4303-b44e-0ec5892b6fb8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:25.486226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c7a86a50-6a39-4303-b44e-0ec5892b6fb8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045932 Oct 28 20:21:25.487017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1110/2205] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:25 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:25.500777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-62107808-3d89-44f4-8f0e-391900fdfeec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:25.508897 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-62107808-3d89-44f4-8f0e-391900fdfeec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151357 Oct 28 20:21:25.509518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1096/2206] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:25 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:25.510584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7ae71f56-2d71-47fb-af7f-eeade438a0e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:25.511204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7ae71f56-2d71-47fb-af7f-eeade438a0e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:25.517074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae71f56-2d71-47fb-af7f-eeade438a0e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:25.517597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae71f56-2d71-47fb-af7f-eeade438a0e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:25.518032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae71f56-2d71-47fb-af7f-eeade438a0e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:25.518728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae71f56-2d71-47fb-af7f-eeade438a0e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:25.519182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae71f56-2d71-47fb-af7f-eeade438a0e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:25.519610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae71f56-2d71-47fb-af7f-eeade438a0e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:25.646033 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7ae71f56-2d71-47fb-af7f-eeade438a0e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:25.654821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7ae71f56-2d71-47fb-af7f-eeade438a0e3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.148160 Oct 28 20:21:25.655388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1111/2207] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:25 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:26.499442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5123adc6-ac20-4ae2-9cb8-bc1d77f5902d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:26.501652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5123adc6-ac20-4ae2-9cb8-bc1d77f5902d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:26.508046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5123adc6-ac20-4ae2-9cb8-bc1d77f5902d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:26.508533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5123adc6-ac20-4ae2-9cb8-bc1d77f5902d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:26.508970 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5123adc6-ac20-4ae2-9cb8-bc1d77f5902d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:26.509697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5123adc6-ac20-4ae2-9cb8-bc1d77f5902d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:26.510156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5123adc6-ac20-4ae2-9cb8-bc1d77f5902d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:26.510587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5123adc6-ac20-4ae2-9cb8-bc1d77f5902d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:26.532359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-07360445-bd45-4c1e-a947-1f9eac9e4032 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:26.533064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-07360445-bd45-4c1e-a947-1f9eac9e4032 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:26.539390 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07360445-bd45-4c1e-a947-1f9eac9e4032 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:26.539870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07360445-bd45-4c1e-a947-1f9eac9e4032 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:26.540306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07360445-bd45-4c1e-a947-1f9eac9e4032 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:26.540537 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5123adc6-ac20-4ae2-9cb8-bc1d77f5902d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045257 Oct 28 20:21:26.540993 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07360445-bd45-4c1e-a947-1f9eac9e4032 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:26.541099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1097/2208] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:26 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:26.541470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07360445-bd45-4c1e-a947-1f9eac9e4032 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:26.541896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07360445-bd45-4c1e-a947-1f9eac9e4032 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:26.675346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-07360445-bd45-4c1e-a947-1f9eac9e4032 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:26.678750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e99263ae-d0b2-417c-be60-e8579a3cdf3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:26.679373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e99263ae-d0b2-417c-be60-e8579a3cdf3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:26.683800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-07360445-bd45-4c1e-a947-1f9eac9e4032 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.155206 Oct 28 20:21:26.684422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1112/2209] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:26 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:26.685946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e99263ae-d0b2-417c-be60-e8579a3cdf3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:26.686441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e99263ae-d0b2-417c-be60-e8579a3cdf3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:26.686887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e99263ae-d0b2-417c-be60-e8579a3cdf3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:26.687589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e99263ae-d0b2-417c-be60-e8579a3cdf3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:26.688047 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e99263ae-d0b2-417c-be60-e8579a3cdf3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:26.688477 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e99263ae-d0b2-417c-be60-e8579a3cdf3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:26.821377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e99263ae-d0b2-417c-be60-e8579a3cdf3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:26.830122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e99263ae-d0b2-417c-be60-e8579a3cdf3d tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155360 Oct 28 20:21:26.830687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1098/2210] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:26 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:27.553696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f720000d-ad89-4fe8-8dae-b8c23e524bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:27.555898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f720000d-ad89-4fe8-8dae-b8c23e524bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:27.563187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f720000d-ad89-4fe8-8dae-b8c23e524bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:27.563663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f720000d-ad89-4fe8-8dae-b8c23e524bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:27.564100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f720000d-ad89-4fe8-8dae-b8c23e524bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:27.564783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f720000d-ad89-4fe8-8dae-b8c23e524bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:27.565234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f720000d-ad89-4fe8-8dae-b8c23e524bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:27.565689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f720000d-ad89-4fe8-8dae-b8c23e524bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:27.594576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f720000d-ad89-4fe8-8dae-b8c23e524bb9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044831 Oct 28 20:21:27.595128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1113/2211] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:27 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:27.707454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b23cd546-59a0-4050-907c-81653f7baa77 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:27.708077 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b23cd546-59a0-4050-907c-81653f7baa77 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:27.714761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b23cd546-59a0-4050-907c-81653f7baa77 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:27.715326 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b23cd546-59a0-4050-907c-81653f7baa77 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:27.715932 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b23cd546-59a0-4050-907c-81653f7baa77 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:27.716624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b23cd546-59a0-4050-907c-81653f7baa77 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:27.717083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b23cd546-59a0-4050-907c-81653f7baa77 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:27.717558 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b23cd546-59a0-4050-907c-81653f7baa77 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:27.846338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b23cd546-59a0-4050-907c-81653f7baa77 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:27.853626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a093c60-eac2-48f4-8401-4ad1e3835e41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:27.854236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7a093c60-eac2-48f4-8401-4ad1e3835e41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:27.854823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b23cd546-59a0-4050-907c-81653f7baa77 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151201 Oct 28 20:21:27.855384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1099/2212] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:27 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:27.860724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a093c60-eac2-48f4-8401-4ad1e3835e41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:27.861206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a093c60-eac2-48f4-8401-4ad1e3835e41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:27.861673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a093c60-eac2-48f4-8401-4ad1e3835e41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:27.862356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a093c60-eac2-48f4-8401-4ad1e3835e41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:27.862813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a093c60-eac2-48f4-8401-4ad1e3835e41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:27.863466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a093c60-eac2-48f4-8401-4ad1e3835e41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:28.234935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7a093c60-eac2-48f4-8401-4ad1e3835e41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:28.243096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7a093c60-eac2-48f4-8401-4ad1e3835e41 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.393229 Oct 28 20:21:28.243670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1114/2213] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:27 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:28.607816 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a153848e-780d-4979-b605-494a33b69c3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:28.610203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a153848e-780d-4979-b605-494a33b69c3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:28.616060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a153848e-780d-4979-b605-494a33b69c3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:28.616538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a153848e-780d-4979-b605-494a33b69c3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:28.616972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a153848e-780d-4979-b605-494a33b69c3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:28.617684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a153848e-780d-4979-b605-494a33b69c3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:28.618135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a153848e-780d-4979-b605-494a33b69c3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:28.618554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a153848e-780d-4979-b605-494a33b69c3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:28.648181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a153848e-780d-4979-b605-494a33b69c3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044921 Oct 28 20:21:28.648719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1100/2214] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:28 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:28.878616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ace31f1a-c023-4045-a413-f711e08ce8a0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:28.879150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ace31f1a-c023-4045-a413-f711e08ce8a0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:28.885446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ace31f1a-c023-4045-a413-f711e08ce8a0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:28.885927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ace31f1a-c023-4045-a413-f711e08ce8a0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:28.886367 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ace31f1a-c023-4045-a413-f711e08ce8a0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:28.887056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ace31f1a-c023-4045-a413-f711e08ce8a0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:28.887507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ace31f1a-c023-4045-a413-f711e08ce8a0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:28.887931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ace31f1a-c023-4045-a413-f711e08ce8a0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:29.020712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ace31f1a-c023-4045-a413-f711e08ce8a0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:29.028942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ace31f1a-c023-4045-a413-f711e08ce8a0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.154374 Oct 28 20:21:29.029535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1115/2215] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:28 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:29.267040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1934a93a-90a4-4c49-9ee2-3cf472cba07f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:29.267647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1934a93a-90a4-4c49-9ee2-3cf472cba07f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:29.273991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1934a93a-90a4-4c49-9ee2-3cf472cba07f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:29.274468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1934a93a-90a4-4c49-9ee2-3cf472cba07f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:29.274901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1934a93a-90a4-4c49-9ee2-3cf472cba07f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:29.275576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1934a93a-90a4-4c49-9ee2-3cf472cba07f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:29.276018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1934a93a-90a4-4c49-9ee2-3cf472cba07f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:29.276435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1934a93a-90a4-4c49-9ee2-3cf472cba07f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:29.406184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1934a93a-90a4-4c49-9ee2-3cf472cba07f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:29.414463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1934a93a-90a4-4c49-9ee2-3cf472cba07f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151679 Oct 28 20:21:29.414971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1101/2216] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:29 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:29.661205 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-181664a3-c6ba-4737-9f47-9b681774606f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:29.663379 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-181664a3-c6ba-4737-9f47-9b681774606f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:29.669347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-181664a3-c6ba-4737-9f47-9b681774606f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:29.669778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-181664a3-c6ba-4737-9f47-9b681774606f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:29.670219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-181664a3-c6ba-4737-9f47-9b681774606f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:29.670919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-181664a3-c6ba-4737-9f47-9b681774606f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:29.672056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-181664a3-c6ba-4737-9f47-9b681774606f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:29.672486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-181664a3-c6ba-4737-9f47-9b681774606f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:29.701134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-181664a3-c6ba-4737-9f47-9b681774606f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043943 Oct 28 20:21:29.701714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1116/2217] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:29 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:30.053199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37a3d049-ef52-41bd-a8ba-ffcb4e6d3f27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:30.053835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-37a3d049-ef52-41bd-a8ba-ffcb4e6d3f27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:30.059683 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37a3d049-ef52-41bd-a8ba-ffcb4e6d3f27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:30.060159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37a3d049-ef52-41bd-a8ba-ffcb4e6d3f27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:30.060589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37a3d049-ef52-41bd-a8ba-ffcb4e6d3f27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:30.061261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37a3d049-ef52-41bd-a8ba-ffcb4e6d3f27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:30.062258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37a3d049-ef52-41bd-a8ba-ffcb4e6d3f27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:30.062680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37a3d049-ef52-41bd-a8ba-ffcb4e6d3f27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:30.189601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-37a3d049-ef52-41bd-a8ba-ffcb4e6d3f27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:30.197760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-37a3d049-ef52-41bd-a8ba-ffcb4e6d3f27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.148413 Oct 28 20:21:30.198325 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1102/2218] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:30 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:30.437993 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8414127d-8157-4932-ac86-5b06174f842c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:30.438602 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8414127d-8157-4932-ac86-5b06174f842c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:30.444881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8414127d-8157-4932-ac86-5b06174f842c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:30.445384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8414127d-8157-4932-ac86-5b06174f842c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:30.445823 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8414127d-8157-4932-ac86-5b06174f842c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:30.446498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8414127d-8157-4932-ac86-5b06174f842c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:30.446948 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8414127d-8157-4932-ac86-5b06174f842c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:30.447371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8414127d-8157-4932-ac86-5b06174f842c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:30.577506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8414127d-8157-4932-ac86-5b06174f842c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:30.585434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8414127d-8157-4932-ac86-5b06174f842c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151876 Oct 28 20:21:30.585991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1117/2219] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:30 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:30.714458 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ae5d00f7-db4f-4bc1-8158-645c08399069 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:30.716629 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ae5d00f7-db4f-4bc1-8158-645c08399069 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:30.723129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae5d00f7-db4f-4bc1-8158-645c08399069 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:30.723614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae5d00f7-db4f-4bc1-8158-645c08399069 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:30.724083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae5d00f7-db4f-4bc1-8158-645c08399069 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:30.724791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae5d00f7-db4f-4bc1-8158-645c08399069 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:30.725247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae5d00f7-db4f-4bc1-8158-645c08399069 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:30.725699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae5d00f7-db4f-4bc1-8158-645c08399069 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:30.755167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ae5d00f7-db4f-4bc1-8158-645c08399069 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Oct 28 20:21:30.755713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1103/2220] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:30 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:31.222396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c45ec35a-f2f8-4293-ad77-76ad6e52f085 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:31.223062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c45ec35a-f2f8-4293-ad77-76ad6e52f085 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:31.228927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c45ec35a-f2f8-4293-ad77-76ad6e52f085 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:31.229437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c45ec35a-f2f8-4293-ad77-76ad6e52f085 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:31.229871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c45ec35a-f2f8-4293-ad77-76ad6e52f085 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:31.230544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c45ec35a-f2f8-4293-ad77-76ad6e52f085 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:31.230990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c45ec35a-f2f8-4293-ad77-76ad6e52f085 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:31.231407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c45ec35a-f2f8-4293-ad77-76ad6e52f085 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:31.245582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:31.360815 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c45ec35a-f2f8-4293-ad77-76ad6e52f085 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:31.368868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c45ec35a-f2f8-4293-ad77-76ad6e52f085 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150951 Oct 28 20:21:31.369453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1118/2221] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:31 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:31.608247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ec1d3390-faac-4180-a724-754e8a0df953 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:31.608880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ec1d3390-faac-4180-a724-754e8a0df953 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:31.614733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1d3390-faac-4180-a724-754e8a0df953 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:31.615211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1d3390-faac-4180-a724-754e8a0df953 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:31.615641 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1d3390-faac-4180-a724-754e8a0df953 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:31.616315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1d3390-faac-4180-a724-754e8a0df953 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:31.616794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1d3390-faac-4180-a724-754e8a0df953 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:31.617213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1d3390-faac-4180-a724-754e8a0df953 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:31.745474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ec1d3390-faac-4180-a724-754e8a0df953 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:31.754203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ec1d3390-faac-4180-a724-754e8a0df953 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149887 Oct 28 20:21:31.754762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1104/2222] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:31 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:31.768665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f31d799c-4504-451c-838e-b0e2b71a8eec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:31.771058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f31d799c-4504-451c-838e-b0e2b71a8eec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:31.777525 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f31d799c-4504-451c-838e-b0e2b71a8eec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:31.778004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f31d799c-4504-451c-838e-b0e2b71a8eec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:31.778437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f31d799c-4504-451c-838e-b0e2b71a8eec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:31.779117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f31d799c-4504-451c-838e-b0e2b71a8eec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:31.779627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f31d799c-4504-451c-838e-b0e2b71a8eec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:31.780045 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f31d799c-4504-451c-838e-b0e2b71a8eec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:31.808514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f31d799c-4504-451c-838e-b0e2b71a8eec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045024 Oct 28 20:21:31.809049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1119/2223] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:31 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:32.391901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a29498f4-a778-4ecd-9368-eb0532be40b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:32.392498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a29498f4-a778-4ecd-9368-eb0532be40b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:32.398613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29498f4-a778-4ecd-9368-eb0532be40b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:32.399094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29498f4-a778-4ecd-9368-eb0532be40b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:32.407257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29498f4-a778-4ecd-9368-eb0532be40b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:32.407257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29498f4-a778-4ecd-9368-eb0532be40b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:32.407257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29498f4-a778-4ecd-9368-eb0532be40b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:32.407257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29498f4-a778-4ecd-9368-eb0532be40b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:32.539405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a29498f4-a778-4ecd-9368-eb0532be40b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:32.547867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a29498f4-a778-4ecd-9368-eb0532be40b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.159869 Oct 28 20:21:32.548427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1105/2224] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:32 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:32.777611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-97648619-86f1-45b5-9aa7-95eb3cf58b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:32.778228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-97648619-86f1-45b5-9aa7-95eb3cf58b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:32.785197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97648619-86f1-45b5-9aa7-95eb3cf58b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:32.785723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97648619-86f1-45b5-9aa7-95eb3cf58b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:32.786157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97648619-86f1-45b5-9aa7-95eb3cf58b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:32.786835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97648619-86f1-45b5-9aa7-95eb3cf58b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:32.787281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97648619-86f1-45b5-9aa7-95eb3cf58b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:32.787700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97648619-86f1-45b5-9aa7-95eb3cf58b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:32.821401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-478fa131-c795-41c1-a2ed-156d6e8ca7d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:32.823755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-478fa131-c795-41c1-a2ed-156d6e8ca7d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:32.830417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-478fa131-c795-41c1-a2ed-156d6e8ca7d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:32.830900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-478fa131-c795-41c1-a2ed-156d6e8ca7d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:32.831335 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-478fa131-c795-41c1-a2ed-156d6e8ca7d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:32.832023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-478fa131-c795-41c1-a2ed-156d6e8ca7d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:32.832472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-478fa131-c795-41c1-a2ed-156d6e8ca7d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:32.832915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-478fa131-c795-41c1-a2ed-156d6e8ca7d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:32.863640 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-478fa131-c795-41c1-a2ed-156d6e8ca7d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046124 Oct 28 20:21:32.864211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1106/2225] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:32 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:32.920128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-97648619-86f1-45b5-9aa7-95eb3cf58b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:32.928229 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-97648619-86f1-45b5-9aa7-95eb3cf58b88 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.154500 Oct 28 20:21:32.928787 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1120/2226] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:32 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:33.571886 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d58bced4-3e12-4753-b918-c94e21e3d25e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:33.572526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d58bced4-3e12-4753-b918-c94e21e3d25e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:33.578489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d58bced4-3e12-4753-b918-c94e21e3d25e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:33.578979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d58bced4-3e12-4753-b918-c94e21e3d25e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:33.579403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d58bced4-3e12-4753-b918-c94e21e3d25e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:33.580082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d58bced4-3e12-4753-b918-c94e21e3d25e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:33.580532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d58bced4-3e12-4753-b918-c94e21e3d25e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:33.580967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d58bced4-3e12-4753-b918-c94e21e3d25e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:33.598342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:33.712845 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d58bced4-3e12-4753-b918-c94e21e3d25e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:33.721868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d58bced4-3e12-4753-b918-c94e21e3d25e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.153846 Oct 28 20:21:33.722428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1107/2227] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:33 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:33.876339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3b91e9d6-e8fb-4435-ab2c-a3688d03a3ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:33.878432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3b91e9d6-e8fb-4435-ab2c-a3688d03a3ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:33.884664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b91e9d6-e8fb-4435-ab2c-a3688d03a3ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:33.885132 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b91e9d6-e8fb-4435-ab2c-a3688d03a3ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:33.885594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b91e9d6-e8fb-4435-ab2c-a3688d03a3ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:33.886269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b91e9d6-e8fb-4435-ab2c-a3688d03a3ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:33.886714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b91e9d6-e8fb-4435-ab2c-a3688d03a3ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:33.887128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b91e9d6-e8fb-4435-ab2c-a3688d03a3ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:33.916810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3b91e9d6-e8fb-4435-ab2c-a3688d03a3ad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045249 Oct 28 20:21:33.917367 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1121/2228] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:33 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:33.951023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-38899b65-53b8-49c0-8e7f-dd14c35ce833 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:33.951643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-38899b65-53b8-49c0-8e7f-dd14c35ce833 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:33.958703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38899b65-53b8-49c0-8e7f-dd14c35ce833 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:33.959192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38899b65-53b8-49c0-8e7f-dd14c35ce833 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:33.959633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38899b65-53b8-49c0-8e7f-dd14c35ce833 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:33.960328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38899b65-53b8-49c0-8e7f-dd14c35ce833 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:33.960786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38899b65-53b8-49c0-8e7f-dd14c35ce833 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:33.961214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38899b65-53b8-49c0-8e7f-dd14c35ce833 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:34.089094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-38899b65-53b8-49c0-8e7f-dd14c35ce833 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:34.097890 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-38899b65-53b8-49c0-8e7f-dd14c35ce833 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.150635 Oct 28 20:21:34.098745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1108/2229] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:33 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:34.745311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-933a0800-8aec-4f66-9e38-cd9034609f4b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:34.745969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-933a0800-8aec-4f66-9e38-cd9034609f4b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:34.752393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-933a0800-8aec-4f66-9e38-cd9034609f4b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:34.752877 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-933a0800-8aec-4f66-9e38-cd9034609f4b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:34.753345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-933a0800-8aec-4f66-9e38-cd9034609f4b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:34.754030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-933a0800-8aec-4f66-9e38-cd9034609f4b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:34.754489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-933a0800-8aec-4f66-9e38-cd9034609f4b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:34.754918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-933a0800-8aec-4f66-9e38-cd9034609f4b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:34.882867 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-933a0800-8aec-4f66-9e38-cd9034609f4b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:34.892030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-933a0800-8aec-4f66-9e38-cd9034609f4b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150576 Oct 28 20:21:34.892607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1122/2230] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:34 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:34.929443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-47c72406-821e-4318-a2f7-dd5641becf39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:34.931593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-47c72406-821e-4318-a2f7-dd5641becf39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:34.937660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47c72406-821e-4318-a2f7-dd5641becf39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:34.938148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47c72406-821e-4318-a2f7-dd5641becf39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:34.938588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47c72406-821e-4318-a2f7-dd5641becf39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:34.939271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47c72406-821e-4318-a2f7-dd5641becf39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:34.939739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47c72406-821e-4318-a2f7-dd5641becf39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:34.940167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47c72406-821e-4318-a2f7-dd5641becf39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:34.970455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-47c72406-821e-4318-a2f7-dd5641becf39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045016 Oct 28 20:21:34.972045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1109/2231] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:34 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:35.120051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fed0a987-1e14-44ce-9848-3b980b0e4e81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:35.120668 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fed0a987-1e14-44ce-9848-3b980b0e4e81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:35.127953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed0a987-1e14-44ce-9848-3b980b0e4e81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:35.128443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed0a987-1e14-44ce-9848-3b980b0e4e81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:35.128884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed0a987-1e14-44ce-9848-3b980b0e4e81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:35.129647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed0a987-1e14-44ce-9848-3b980b0e4e81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:35.130221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed0a987-1e14-44ce-9848-3b980b0e4e81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:35.130667 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed0a987-1e14-44ce-9848-3b980b0e4e81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:35.260728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fed0a987-1e14-44ce-9848-3b980b0e4e81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:35.269291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fed0a987-1e14-44ce-9848-3b980b0e4e81 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153076 Oct 28 20:21:35.269872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1123/2232] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:35 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:35.915380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-add3b281-d6ff-4c0c-b1b8-7ae74306d4ee tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:35.915917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-add3b281-d6ff-4c0c-b1b8-7ae74306d4ee tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:35.922385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-add3b281-d6ff-4c0c-b1b8-7ae74306d4ee tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:35.922857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-add3b281-d6ff-4c0c-b1b8-7ae74306d4ee tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:35.923292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-add3b281-d6ff-4c0c-b1b8-7ae74306d4ee tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:35.923967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-add3b281-d6ff-4c0c-b1b8-7ae74306d4ee tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:35.924416 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-add3b281-d6ff-4c0c-b1b8-7ae74306d4ee tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:35.924837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-add3b281-d6ff-4c0c-b1b8-7ae74306d4ee tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:35.982874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2ea83757-ee51-41cf-a063-45a0a8ff626b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:35.986285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2ea83757-ee51-41cf-a063-45a0a8ff626b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:35.992688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ea83757-ee51-41cf-a063-45a0a8ff626b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:35.993171 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ea83757-ee51-41cf-a063-45a0a8ff626b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:35.993644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ea83757-ee51-41cf-a063-45a0a8ff626b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:35.994339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ea83757-ee51-41cf-a063-45a0a8ff626b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:35.994800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ea83757-ee51-41cf-a063-45a0a8ff626b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:35.995224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ea83757-ee51-41cf-a063-45a0a8ff626b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:36.027249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2ea83757-ee51-41cf-a063-45a0a8ff626b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048255 Oct 28 20:21:36.028168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1124/2233] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:35 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:21:36.056194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-add3b281-d6ff-4c0c-b1b8-7ae74306d4ee tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:36.064551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-add3b281-d6ff-4c0c-b1b8-7ae74306d4ee tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.153040 Oct 28 20:21:36.065114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1110/2234] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:35 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:36.292718 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ae4d4cd1-ca9b-4cf6-a15b-f291e620dffb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:36.293354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ae4d4cd1-ca9b-4cf6-a15b-f291e620dffb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:36.300379 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae4d4cd1-ca9b-4cf6-a15b-f291e620dffb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:36.300862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae4d4cd1-ca9b-4cf6-a15b-f291e620dffb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:36.301309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae4d4cd1-ca9b-4cf6-a15b-f291e620dffb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:36.302018 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae4d4cd1-ca9b-4cf6-a15b-f291e620dffb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:36.302472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae4d4cd1-ca9b-4cf6-a15b-f291e620dffb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:36.302900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae4d4cd1-ca9b-4cf6-a15b-f291e620dffb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:36.434534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ae4d4cd1-ca9b-4cf6-a15b-f291e620dffb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:36.442724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ae4d4cd1-ca9b-4cf6-a15b-f291e620dffb tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153857 Oct 28 20:21:36.443292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1125/2235] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:36 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:37.040265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cedf7483-e855-4163-93ba-4136191fb157 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:37.042562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cedf7483-e855-4163-93ba-4136191fb157 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:37.044888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=80 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:37.049746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cedf7483-e855-4163-93ba-4136191fb157 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:37.050231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cedf7483-e855-4163-93ba-4136191fb157 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:37.050672 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cedf7483-e855-4163-93ba-4136191fb157 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:37.051359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cedf7483-e855-4163-93ba-4136191fb157 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:37.051822 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cedf7483-e855-4163-93ba-4136191fb157 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:37.052247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cedf7483-e855-4163-93ba-4136191fb157 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:37.084466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cedf7483-e855-4163-93ba-4136191fb157 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047915 Oct 28 20:21:37.085290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1111/2236] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:37 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:37.089124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dfdfa3c0-d92a-4ee3-b629-9a744532da2b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:37.089770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dfdfa3c0-d92a-4ee3-b629-9a744532da2b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:37.096944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfdfa3c0-d92a-4ee3-b629-9a744532da2b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:37.097460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfdfa3c0-d92a-4ee3-b629-9a744532da2b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:37.097909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfdfa3c0-d92a-4ee3-b629-9a744532da2b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:37.098613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfdfa3c0-d92a-4ee3-b629-9a744532da2b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:37.099072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfdfa3c0-d92a-4ee3-b629-9a744532da2b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:37.099502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfdfa3c0-d92a-4ee3-b629-9a744532da2b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:37.227994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dfdfa3c0-d92a-4ee3-b629-9a744532da2b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:37.236965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dfdfa3c0-d92a-4ee3-b629-9a744532da2b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.153108 Oct 28 20:21:37.237565 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1126/2237] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:37 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:37.466571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31193499-59cb-439f-948d-7df1887bcf14 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:37.467194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31193499-59cb-439f-948d-7df1887bcf14 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:37.473845 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31193499-59cb-439f-948d-7df1887bcf14 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:37.474333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31193499-59cb-439f-948d-7df1887bcf14 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:37.474772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31193499-59cb-439f-948d-7df1887bcf14 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:37.475456 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31193499-59cb-439f-948d-7df1887bcf14 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:37.475912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31193499-59cb-439f-948d-7df1887bcf14 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:37.476338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31193499-59cb-439f-948d-7df1887bcf14 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:37.610405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-31193499-59cb-439f-948d-7df1887bcf14 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:37.618500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-31193499-59cb-439f-948d-7df1887bcf14 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.156361 Oct 28 20:21:37.619064 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1112/2238] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:37 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:38.098296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ae06884-9f4b-4cab-956e-63df14e46365 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:38.100461 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ae06884-9f4b-4cab-956e-63df14e46365 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:38.102931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=80 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:38.107554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ae06884-9f4b-4cab-956e-63df14e46365 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:38.108033 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ae06884-9f4b-4cab-956e-63df14e46365 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:38.108470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ae06884-9f4b-4cab-956e-63df14e46365 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:38.109275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ae06884-9f4b-4cab-956e-63df14e46365 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:38.109750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ae06884-9f4b-4cab-956e-63df14e46365 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:38.110173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ae06884-9f4b-4cab-956e-63df14e46365 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:38.138507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ae06884-9f4b-4cab-956e-63df14e46365 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044943 Oct 28 20:21:38.139062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1127/2239] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:38 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:21:38.260907 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-450536a2-d52a-4744-a79c-e0ad6704bad3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:38.261571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-450536a2-d52a-4744-a79c-e0ad6704bad3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:38.268598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-450536a2-d52a-4744-a79c-e0ad6704bad3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:38.269082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-450536a2-d52a-4744-a79c-e0ad6704bad3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:38.269552 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-450536a2-d52a-4744-a79c-e0ad6704bad3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:38.270238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-450536a2-d52a-4744-a79c-e0ad6704bad3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:38.270693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-450536a2-d52a-4744-a79c-e0ad6704bad3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:38.271119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-450536a2-d52a-4744-a79c-e0ad6704bad3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:38.400053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-450536a2-d52a-4744-a79c-e0ad6704bad3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:38.408148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-450536a2-d52a-4744-a79c-e0ad6704bad3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151090 Oct 28 20:21:38.408711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1113/2240] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:38 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:38.641962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-01881113-b4b6-4927-98d9-47373e7bd5d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:38.642534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-01881113-b4b6-4927-98d9-47373e7bd5d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:38.648700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01881113-b4b6-4927-98d9-47373e7bd5d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:38.649179 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01881113-b4b6-4927-98d9-47373e7bd5d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:38.649655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01881113-b4b6-4927-98d9-47373e7bd5d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:38.650338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01881113-b4b6-4927-98d9-47373e7bd5d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:38.650794 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01881113-b4b6-4927-98d9-47373e7bd5d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:38.651217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01881113-b4b6-4927-98d9-47373e7bd5d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:38.782653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-01881113-b4b6-4927-98d9-47373e7bd5d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:38.790871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-01881113-b4b6-4927-98d9-47373e7bd5d2 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.153129 Oct 28 20:21:38.791437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1128/2241] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:38 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:39.151729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b56eb9e7-8ac9-4602-9361-637c9dab642c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:39.154076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b56eb9e7-8ac9-4602-9361-637c9dab642c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:39.160005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b56eb9e7-8ac9-4602-9361-637c9dab642c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:39.160492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b56eb9e7-8ac9-4602-9361-637c9dab642c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:39.160924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b56eb9e7-8ac9-4602-9361-637c9dab642c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:39.161631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b56eb9e7-8ac9-4602-9361-637c9dab642c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:39.162087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b56eb9e7-8ac9-4602-9361-637c9dab642c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:39.162512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b56eb9e7-8ac9-4602-9361-637c9dab642c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:39.191087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b56eb9e7-8ac9-4602-9361-637c9dab642c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043345 Oct 28 20:21:39.191632 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1114/2242] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:39 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:39.431137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0530f9e2-1c59-4460-973b-f96c40192ad1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:39.431843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0530f9e2-1c59-4460-973b-f96c40192ad1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:39.439375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0530f9e2-1c59-4460-973b-f96c40192ad1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:39.439863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0530f9e2-1c59-4460-973b-f96c40192ad1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:39.440305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0530f9e2-1c59-4460-973b-f96c40192ad1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:39.440998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0530f9e2-1c59-4460-973b-f96c40192ad1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:39.441490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0530f9e2-1c59-4460-973b-f96c40192ad1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:39.441919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0530f9e2-1c59-4460-973b-f96c40192ad1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:39.574191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0530f9e2-1c59-4460-973b-f96c40192ad1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:39.583143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0530f9e2-1c59-4460-973b-f96c40192ad1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.155798 Oct 28 20:21:39.583695 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1129/2243] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:39 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:39.813591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bab5efa8-4429-4228-a6ce-873de25bbcc7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:39.814202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bab5efa8-4429-4228-a6ce-873de25bbcc7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:39.820487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bab5efa8-4429-4228-a6ce-873de25bbcc7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:39.820963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bab5efa8-4429-4228-a6ce-873de25bbcc7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:39.821439 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bab5efa8-4429-4228-a6ce-873de25bbcc7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:39.822114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bab5efa8-4429-4228-a6ce-873de25bbcc7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:39.822561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bab5efa8-4429-4228-a6ce-873de25bbcc7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:39.823046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bab5efa8-4429-4228-a6ce-873de25bbcc7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:39.952041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bab5efa8-4429-4228-a6ce-873de25bbcc7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:39.961079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bab5efa8-4429-4228-a6ce-873de25bbcc7 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151500 Oct 28 20:21:39.961686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1115/2244] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:39 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:40.204174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2af7c925-7239-4e90-9b84-e9f2791a5314 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:40.206307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2af7c925-7239-4e90-9b84-e9f2791a5314 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:40.212219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2af7c925-7239-4e90-9b84-e9f2791a5314 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:40.212700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2af7c925-7239-4e90-9b84-e9f2791a5314 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:40.213424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2af7c925-7239-4e90-9b84-e9f2791a5314 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:40.214110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2af7c925-7239-4e90-9b84-e9f2791a5314 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:40.214564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2af7c925-7239-4e90-9b84-e9f2791a5314 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:40.214999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2af7c925-7239-4e90-9b84-e9f2791a5314 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:40.243937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2af7c925-7239-4e90-9b84-e9f2791a5314 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Oct 28 20:21:40.244478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1130/2245] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:40 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:40.606759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-788de022-2b61-4ebc-887a-ca75de699f8a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:40.607396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-788de022-2b61-4ebc-887a-ca75de699f8a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:40.614273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788de022-2b61-4ebc-887a-ca75de699f8a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:40.614759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788de022-2b61-4ebc-887a-ca75de699f8a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:40.615200 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788de022-2b61-4ebc-887a-ca75de699f8a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:40.615909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788de022-2b61-4ebc-887a-ca75de699f8a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:40.616360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788de022-2b61-4ebc-887a-ca75de699f8a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:40.616784 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788de022-2b61-4ebc-887a-ca75de699f8a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:40.757499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-788de022-2b61-4ebc-887a-ca75de699f8a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:40.765780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-788de022-2b61-4ebc-887a-ca75de699f8a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.162830 Oct 28 20:21:40.766344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1116/2246] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:40 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:40.984737 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d3506f35-4625-4063-8c07-3d9b84945061 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:40.985444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d3506f35-4625-4063-8c07-3d9b84945061 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:40.991754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3506f35-4625-4063-8c07-3d9b84945061 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:40.992233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3506f35-4625-4063-8c07-3d9b84945061 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:40.992670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3506f35-4625-4063-8c07-3d9b84945061 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:40.993371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3506f35-4625-4063-8c07-3d9b84945061 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:40.993825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3506f35-4625-4063-8c07-3d9b84945061 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:40.994247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3506f35-4625-4063-8c07-3d9b84945061 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:41.134046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d3506f35-4625-4063-8c07-3d9b84945061 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:41.142660 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d3506f35-4625-4063-8c07-3d9b84945061 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.162319 Oct 28 20:21:41.143227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1131/2247] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:40 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:41.256649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-22359126-d56b-4703-8fcf-9263aff70f41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:41.258830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22359126-d56b-4703-8fcf-9263aff70f41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:41.265309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22359126-d56b-4703-8fcf-9263aff70f41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:41.265825 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22359126-d56b-4703-8fcf-9263aff70f41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:41.266262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22359126-d56b-4703-8fcf-9263aff70f41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:41.266948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22359126-d56b-4703-8fcf-9263aff70f41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:41.267404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22359126-d56b-4703-8fcf-9263aff70f41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:41.267834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22359126-d56b-4703-8fcf-9263aff70f41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:41.297830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-22359126-d56b-4703-8fcf-9263aff70f41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044956 Oct 28 20:21:41.298326 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1117/2248] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:41 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:41.789535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6f21c6e8-ed49-463d-9388-1df04c2f8bfe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:41.790140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6f21c6e8-ed49-463d-9388-1df04c2f8bfe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:41.796262 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f21c6e8-ed49-463d-9388-1df04c2f8bfe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:41.796754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f21c6e8-ed49-463d-9388-1df04c2f8bfe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:41.797223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f21c6e8-ed49-463d-9388-1df04c2f8bfe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:41.797947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f21c6e8-ed49-463d-9388-1df04c2f8bfe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:41.798405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f21c6e8-ed49-463d-9388-1df04c2f8bfe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:41.798865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f21c6e8-ed49-463d-9388-1df04c2f8bfe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:41.928371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6f21c6e8-ed49-463d-9388-1df04c2f8bfe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:41.937936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6f21c6e8-ed49-463d-9388-1df04c2f8bfe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151439 Oct 28 20:21:41.953448 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1132/2249] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:41 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:42.164754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-874f2728-2548-4ab6-9163-88d99add225a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:42.165397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-874f2728-2548-4ab6-9163-88d99add225a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:42.171816 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-874f2728-2548-4ab6-9163-88d99add225a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:42.172316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-874f2728-2548-4ab6-9163-88d99add225a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:42.172746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-874f2728-2548-4ab6-9163-88d99add225a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:42.173465 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-874f2728-2548-4ab6-9163-88d99add225a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:42.173924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-874f2728-2548-4ab6-9163-88d99add225a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:42.174369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-874f2728-2548-4ab6-9163-88d99add225a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:42.309860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-874f2728-2548-4ab6-9163-88d99add225a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:42.310475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ef9378c4-2e58-4a1d-8582-8d81ca057e8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:42.312866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ef9378c4-2e58-4a1d-8582-8d81ca057e8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:42.319492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9378c4-2e58-4a1d-8582-8d81ca057e8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:42.319884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-874f2728-2548-4ab6-9163-88d99add225a tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.159129 Oct 28 20:21:42.320005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9378c4-2e58-4a1d-8582-8d81ca057e8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:42.320376 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9378c4-2e58-4a1d-8582-8d81ca057e8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:42.321062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9378c4-2e58-4a1d-8582-8d81ca057e8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:42.321534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9378c4-2e58-4a1d-8582-8d81ca057e8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:42.321953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9378c4-2e58-4a1d-8582-8d81ca057e8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:42.333515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1118/2250] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:42 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:42.352298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ef9378c4-2e58-4a1d-8582-8d81ca057e8e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046063 Oct 28 20:21:42.352863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1133/2251] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:42 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:21:42.960639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e33ca391-b3e2-4c89-90ac-656dc6cfa1fa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:42.961256 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e33ca391-b3e2-4c89-90ac-656dc6cfa1fa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:42.967539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e33ca391-b3e2-4c89-90ac-656dc6cfa1fa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:42.968579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e33ca391-b3e2-4c89-90ac-656dc6cfa1fa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:42.969575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e33ca391-b3e2-4c89-90ac-656dc6cfa1fa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:42.970269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e33ca391-b3e2-4c89-90ac-656dc6cfa1fa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:42.970729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e33ca391-b3e2-4c89-90ac-656dc6cfa1fa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:42.971157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e33ca391-b3e2-4c89-90ac-656dc6cfa1fa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:43.107615 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e33ca391-b3e2-4c89-90ac-656dc6cfa1fa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:43.116443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e33ca391-b3e2-4c89-90ac-656dc6cfa1fa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.159567 Oct 28 20:21:43.116935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1119/2252] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:42 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:43.344800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-714545c6-1578-4df6-94a6-192cef4a95ec tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:43.345441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-714545c6-1578-4df6-94a6-192cef4a95ec tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:43.351769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-714545c6-1578-4df6-94a6-192cef4a95ec tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:43.352257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-714545c6-1578-4df6-94a6-192cef4a95ec tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:43.352696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-714545c6-1578-4df6-94a6-192cef4a95ec tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:43.353422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-714545c6-1578-4df6-94a6-192cef4a95ec tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:43.353881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-714545c6-1578-4df6-94a6-192cef4a95ec tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:43.354313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-714545c6-1578-4df6-94a6-192cef4a95ec tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:43.364603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9304f08-8b2a-41e5-a558-181cf0369989 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:43.366842 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f9304f08-8b2a-41e5-a558-181cf0369989 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:43.373079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9304f08-8b2a-41e5-a558-181cf0369989 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:43.373605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9304f08-8b2a-41e5-a558-181cf0369989 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:43.374036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9304f08-8b2a-41e5-a558-181cf0369989 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:43.374972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9304f08-8b2a-41e5-a558-181cf0369989 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:43.375611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9304f08-8b2a-41e5-a558-181cf0369989 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:43.379330 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9304f08-8b2a-41e5-a558-181cf0369989 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:43.413251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f9304f08-8b2a-41e5-a558-181cf0369989 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052536 Oct 28 20:21:43.413847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1120/2253] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:43 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:21:43.502111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-714545c6-1578-4df6-94a6-192cef4a95ec tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:43.512306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-714545c6-1578-4df6-94a6-192cef4a95ec tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.170334 Oct 28 20:21:43.512306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1134/2254] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:43 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:44.139088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7055f2bd-e759-4874-8d6b-ed9e6704dcda tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:44.139704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7055f2bd-e759-4874-8d6b-ed9e6704dcda tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:44.146396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7055f2bd-e759-4874-8d6b-ed9e6704dcda tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:44.146877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7055f2bd-e759-4874-8d6b-ed9e6704dcda tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:44.147311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7055f2bd-e759-4874-8d6b-ed9e6704dcda tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:44.147988 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7055f2bd-e759-4874-8d6b-ed9e6704dcda tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:44.148439 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7055f2bd-e759-4874-8d6b-ed9e6704dcda tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:44.148859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7055f2bd-e759-4874-8d6b-ed9e6704dcda tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:44.275506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7055f2bd-e759-4874-8d6b-ed9e6704dcda tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:44.284308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7055f2bd-e759-4874-8d6b-ed9e6704dcda tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149060 Oct 28 20:21:44.284872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1121/2255] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:44 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:44.426278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48673498-7fab-4d55-912b-0f5035cbf9db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:44.428426 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48673498-7fab-4d55-912b-0f5035cbf9db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:44.434867 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48673498-7fab-4d55-912b-0f5035cbf9db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:44.435346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48673498-7fab-4d55-912b-0f5035cbf9db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:44.435782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48673498-7fab-4d55-912b-0f5035cbf9db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:44.436456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48673498-7fab-4d55-912b-0f5035cbf9db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:44.437542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48673498-7fab-4d55-912b-0f5035cbf9db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:44.438111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48673498-7fab-4d55-912b-0f5035cbf9db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:44.440432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:44.468728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48673498-7fab-4d55-912b-0f5035cbf9db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046365 Oct 28 20:21:44.469290 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1135/2256] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:44 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:44.534543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b7ac89ca-13f6-45a5-b26b-4f1ed7a8ff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:44.535085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b7ac89ca-13f6-45a5-b26b-4f1ed7a8ff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:44.541417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7ac89ca-13f6-45a5-b26b-4f1ed7a8ff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:44.541901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7ac89ca-13f6-45a5-b26b-4f1ed7a8ff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:44.542342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7ac89ca-13f6-45a5-b26b-4f1ed7a8ff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:44.543019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7ac89ca-13f6-45a5-b26b-4f1ed7a8ff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:44.543471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7ac89ca-13f6-45a5-b26b-4f1ed7a8ff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:44.543894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7ac89ca-13f6-45a5-b26b-4f1ed7a8ff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:44.677118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b7ac89ca-13f6-45a5-b26b-4f1ed7a8ff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:44.685616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b7ac89ca-13f6-45a5-b26b-4f1ed7a8ff35 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.155115 Oct 28 20:21:44.686176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1122/2257] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:44 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:45.306730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7f46b809-def1-4e56-b5a2-fc6bd56db813 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:45.307347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7f46b809-def1-4e56-b5a2-fc6bd56db813 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:45.314173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f46b809-def1-4e56-b5a2-fc6bd56db813 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:45.314374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f46b809-def1-4e56-b5a2-fc6bd56db813 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:45.314814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f46b809-def1-4e56-b5a2-fc6bd56db813 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:45.315509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f46b809-def1-4e56-b5a2-fc6bd56db813 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:45.315966 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f46b809-def1-4e56-b5a2-fc6bd56db813 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:45.316394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f46b809-def1-4e56-b5a2-fc6bd56db813 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:45.446295 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7f46b809-def1-4e56-b5a2-fc6bd56db813 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:45.454269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7f46b809-def1-4e56-b5a2-fc6bd56db813 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151811 Oct 28 20:21:45.454823 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1136/2258] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:45 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:45.480888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-15044bcd-5b3b-4952-8236-5f3c6b50030d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:45.483076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-15044bcd-5b3b-4952-8236-5f3c6b50030d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:45.489545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15044bcd-5b3b-4952-8236-5f3c6b50030d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:45.490019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15044bcd-5b3b-4952-8236-5f3c6b50030d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:45.490452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15044bcd-5b3b-4952-8236-5f3c6b50030d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:45.491121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15044bcd-5b3b-4952-8236-5f3c6b50030d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:45.491567 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15044bcd-5b3b-4952-8236-5f3c6b50030d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:45.492005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15044bcd-5b3b-4952-8236-5f3c6b50030d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:45.520898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-15044bcd-5b3b-4952-8236-5f3c6b50030d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043839 Oct 28 20:21:45.521471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1123/2259] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:45 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:45.710531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5669d54f-950c-4b3d-b9b4-e52c33d41222 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:45.711151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5669d54f-950c-4b3d-b9b4-e52c33d41222 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:45.717249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5669d54f-950c-4b3d-b9b4-e52c33d41222 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:45.717763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5669d54f-950c-4b3d-b9b4-e52c33d41222 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:45.718198 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5669d54f-950c-4b3d-b9b4-e52c33d41222 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:45.718910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5669d54f-950c-4b3d-b9b4-e52c33d41222 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:45.719366 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5669d54f-950c-4b3d-b9b4-e52c33d41222 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:45.719796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5669d54f-950c-4b3d-b9b4-e52c33d41222 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:45.850553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5669d54f-950c-4b3d-b9b4-e52c33d41222 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:45.858598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5669d54f-950c-4b3d-b9b4-e52c33d41222 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151871 Oct 28 20:21:45.859153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1137/2260] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:45 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:46.477871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b210e5e0-73c3-4d16-beec-272c9e1c558b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:46.478508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b210e5e0-73c3-4d16-beec-272c9e1c558b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:46.484941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b210e5e0-73c3-4d16-beec-272c9e1c558b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:46.485457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b210e5e0-73c3-4d16-beec-272c9e1c558b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:46.485891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b210e5e0-73c3-4d16-beec-272c9e1c558b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:46.486560 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b210e5e0-73c3-4d16-beec-272c9e1c558b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:46.487007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b210e5e0-73c3-4d16-beec-272c9e1c558b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:46.487424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b210e5e0-73c3-4d16-beec-272c9e1c558b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:46.492502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:46.533774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d66e674-616e-4c3e-8b68-dbeb3380732d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:46.535954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4d66e674-616e-4c3e-8b68-dbeb3380732d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:46.542320 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d66e674-616e-4c3e-8b68-dbeb3380732d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:46.542803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d66e674-616e-4c3e-8b68-dbeb3380732d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:46.543237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d66e674-616e-4c3e-8b68-dbeb3380732d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:46.543984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d66e674-616e-4c3e-8b68-dbeb3380732d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:46.544442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d66e674-616e-4c3e-8b68-dbeb3380732d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:46.544862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d66e674-616e-4c3e-8b68-dbeb3380732d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:46.574701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4d66e674-616e-4c3e-8b68-dbeb3380732d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045631 Oct 28 20:21:46.575263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1138/2261] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:46 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:21:46.625262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b210e5e0-73c3-4d16-beec-272c9e1c558b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:46.633344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b210e5e0-73c3-4d16-beec-272c9e1c558b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.159279 Oct 28 20:21:46.633915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1124/2262] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:46 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:46.881786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f6b5f9da-682a-432f-8ae1-66888a395e5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:46.882397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f6b5f9da-682a-432f-8ae1-66888a395e5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:46.888200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6b5f9da-682a-432f-8ae1-66888a395e5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:46.888680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6b5f9da-682a-432f-8ae1-66888a395e5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:46.889113 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6b5f9da-682a-432f-8ae1-66888a395e5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:46.889817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6b5f9da-682a-432f-8ae1-66888a395e5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:46.890270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6b5f9da-682a-432f-8ae1-66888a395e5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:46.891218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6b5f9da-682a-432f-8ae1-66888a395e5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:47.019617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f6b5f9da-682a-432f-8ae1-66888a395e5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:47.027863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f6b5f9da-682a-432f-8ae1-66888a395e5f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.149909 Oct 28 20:21:47.028437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1139/2263] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:46 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:47.586186 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7aafded6-7575-4c31-a823-00ae3d4b31c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:47.588622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7aafded6-7575-4c31-a823-00ae3d4b31c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:47.595710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aafded6-7575-4c31-a823-00ae3d4b31c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:47.596191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aafded6-7575-4c31-a823-00ae3d4b31c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:47.596624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aafded6-7575-4c31-a823-00ae3d4b31c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:47.597307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aafded6-7575-4c31-a823-00ae3d4b31c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:47.597828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aafded6-7575-4c31-a823-00ae3d4b31c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:47.598251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7aafded6-7575-4c31-a823-00ae3d4b31c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:47.626406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7aafded6-7575-4c31-a823-00ae3d4b31c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044121 Oct 28 20:21:47.626945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1125/2264] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:47 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:47.658050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8e743fd-68ac-49f5-a3ba-6314c85c6075 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:47.658604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b8e743fd-68ac-49f5-a3ba-6314c85c6075 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:47.664906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8e743fd-68ac-49f5-a3ba-6314c85c6075 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:47.665419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8e743fd-68ac-49f5-a3ba-6314c85c6075 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:47.665862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8e743fd-68ac-49f5-a3ba-6314c85c6075 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:47.666546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8e743fd-68ac-49f5-a3ba-6314c85c6075 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:47.666999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8e743fd-68ac-49f5-a3ba-6314c85c6075 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:47.667502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8e743fd-68ac-49f5-a3ba-6314c85c6075 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:47.800020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8e743fd-68ac-49f5-a3ba-6314c85c6075 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:47.808063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b8e743fd-68ac-49f5-a3ba-6314c85c6075 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.155007 Oct 28 20:21:47.808630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1140/2265] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:47 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:47.910500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8b751234-7c03-4209-8217-c9afe49648d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:47.910942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8b751234-7c03-4209-8217-c9afe49648d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:47.916742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b751234-7c03-4209-8217-c9afe49648d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:47.917224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b751234-7c03-4209-8217-c9afe49648d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:47.917699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b751234-7c03-4209-8217-c9afe49648d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:47.918389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b751234-7c03-4209-8217-c9afe49648d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:47.918846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b751234-7c03-4209-8217-c9afe49648d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:47.919272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b751234-7c03-4209-8217-c9afe49648d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:47.944374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8b751234-7c03-4209-8217-c9afe49648d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:21:48.055904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-479c7770-c131-4352-8414-496d3327d839 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:48.056520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-479c7770-c131-4352-8414-496d3327d839 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:48.062464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-479c7770-c131-4352-8414-496d3327d839 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:48.063008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-479c7770-c131-4352-8414-496d3327d839 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:48.063442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-479c7770-c131-4352-8414-496d3327d839 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:48.064126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-479c7770-c131-4352-8414-496d3327d839 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:48.064580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-479c7770-c131-4352-8414-496d3327d839 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:48.065000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-479c7770-c131-4352-8414-496d3327d839 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:48.216620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-479c7770-c131-4352-8414-496d3327d839 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:48.225226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-479c7770-c131-4352-8414-496d3327d839 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.173112 Oct 28 20:21:48.225873 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1141/2266] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:48 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:48.257494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8b751234-7c03-4209-8217-c9afe49648d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "DELETE /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 204 len: 0 microversion: 2.1 time: 0.351367 Oct 28 20:21:48.258077 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1126/2267] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:21:47 2022] DELETE /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:21:48.266309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85ef3fa0-7bc5-4673-bfa6-bab5bdf8ecdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:48.266934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-85ef3fa0-7bc5-4673-bfa6-bab5bdf8ecdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:48.272851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85ef3fa0-7bc5-4673-bfa6-bab5bdf8ecdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:48.273364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85ef3fa0-7bc5-4673-bfa6-bab5bdf8ecdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:48.273808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85ef3fa0-7bc5-4673-bfa6-bab5bdf8ecdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:48.274494 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85ef3fa0-7bc5-4673-bfa6-bab5bdf8ecdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:48.274945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85ef3fa0-7bc5-4673-bfa6-bab5bdf8ecdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:48.275367 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85ef3fa0-7bc5-4673-bfa6-bab5bdf8ecdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:48.403895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-85ef3fa0-7bc5-4673-bfa6-bab5bdf8ecdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:48.411912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-85ef3fa0-7bc5-4673-bfa6-bab5bdf8ecdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.149770 Oct 28 20:21:48.412469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1142/2268] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:48 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:48.639824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c72da996-b56a-4c7b-b821-3678ce963fb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:48.642965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c72da996-b56a-4c7b-b821-3678ce963fb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:48.649338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c72da996-b56a-4c7b-b821-3678ce963fb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:48.649838 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c72da996-b56a-4c7b-b821-3678ce963fb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:48.650275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c72da996-b56a-4c7b-b821-3678ce963fb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:48.650961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c72da996-b56a-4c7b-b821-3678ce963fb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:48.651417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c72da996-b56a-4c7b-b821-3678ce963fb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:48.651842 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c72da996-b56a-4c7b-b821-3678ce963fb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:48.680463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c72da996-b56a-4c7b-b821-3678ce963fb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045008 Oct 28 20:21:48.681015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1127/2269] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:48 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:48.832555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4ce7cc01-deae-4188-87dd-2c1439e92f33 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:48.833166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4ce7cc01-deae-4188-87dd-2c1439e92f33 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:48.839727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ce7cc01-deae-4188-87dd-2c1439e92f33 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:48.840202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ce7cc01-deae-4188-87dd-2c1439e92f33 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:48.840633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ce7cc01-deae-4188-87dd-2c1439e92f33 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:48.841308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ce7cc01-deae-4188-87dd-2c1439e92f33 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:48.841774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ce7cc01-deae-4188-87dd-2c1439e92f33 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:48.842190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ce7cc01-deae-4188-87dd-2c1439e92f33 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:48.973785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4ce7cc01-deae-4188-87dd-2c1439e92f33 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:48.981916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4ce7cc01-deae-4188-87dd-2c1439e92f33 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.153834 Oct 28 20:21:48.982479 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1143/2270] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:48 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:49.248815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7bd4ed4-7b8a-4a30-9e02-7e9686ba4980 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:49.249503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7bd4ed4-7b8a-4a30-9e02-7e9686ba4980 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:49.256070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7bd4ed4-7b8a-4a30-9e02-7e9686ba4980 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:49.256558 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7bd4ed4-7b8a-4a30-9e02-7e9686ba4980 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:49.256998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7bd4ed4-7b8a-4a30-9e02-7e9686ba4980 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:49.257716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7bd4ed4-7b8a-4a30-9e02-7e9686ba4980 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:49.258173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7bd4ed4-7b8a-4a30-9e02-7e9686ba4980 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:49.258598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7bd4ed4-7b8a-4a30-9e02-7e9686ba4980 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:49.388635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7bd4ed4-7b8a-4a30-9e02-7e9686ba4980 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:49.396956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7bd4ed4-7b8a-4a30-9e02-7e9686ba4980 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.151973 Oct 28 20:21:49.397534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1128/2271] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:49 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:49.435288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7f56d462-30e7-40a4-b33d-3e44d9e63254 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:49.435836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7f56d462-30e7-40a4-b33d-3e44d9e63254 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:49.442199 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f56d462-30e7-40a4-b33d-3e44d9e63254 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:49.442692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f56d462-30e7-40a4-b33d-3e44d9e63254 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:49.443102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f56d462-30e7-40a4-b33d-3e44d9e63254 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:49.443773 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f56d462-30e7-40a4-b33d-3e44d9e63254 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:49.444217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f56d462-30e7-40a4-b33d-3e44d9e63254 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:49.444627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f56d462-30e7-40a4-b33d-3e44d9e63254 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:49.573861 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7f56d462-30e7-40a4-b33d-3e44d9e63254 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:49.582888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7f56d462-30e7-40a4-b33d-3e44d9e63254 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.151409 Oct 28 20:21:49.583461 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1144/2272] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:49 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:49.693260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9974764e-ad75-443d-aafc-72d900eaeccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:49.695457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9974764e-ad75-443d-aafc-72d900eaeccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:49.701760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9974764e-ad75-443d-aafc-72d900eaeccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:49.702239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9974764e-ad75-443d-aafc-72d900eaeccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:49.702674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9974764e-ad75-443d-aafc-72d900eaeccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:49.703390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9974764e-ad75-443d-aafc-72d900eaeccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:49.703840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9974764e-ad75-443d-aafc-72d900eaeccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:49.704258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9974764e-ad75-443d-aafc-72d900eaeccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:49.732945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9974764e-ad75-443d-aafc-72d900eaeccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043651 Oct 28 20:21:49.733533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1129/2273] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:49 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:50.006332 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a5fa9acc-9c8b-4c12-b698-3d1d6b3da28d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:50.006860 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a5fa9acc-9c8b-4c12-b698-3d1d6b3da28d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:50.013397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5fa9acc-9c8b-4c12-b698-3d1d6b3da28d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:50.013886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5fa9acc-9c8b-4c12-b698-3d1d6b3da28d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:50.014329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5fa9acc-9c8b-4c12-b698-3d1d6b3da28d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:50.015072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5fa9acc-9c8b-4c12-b698-3d1d6b3da28d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:50.015879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5fa9acc-9c8b-4c12-b698-3d1d6b3da28d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:50.016549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5fa9acc-9c8b-4c12-b698-3d1d6b3da28d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:50.144437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a5fa9acc-9c8b-4c12-b698-3d1d6b3da28d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:50.152563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a5fa9acc-9c8b-4c12-b698-3d1d6b3da28d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150198 Oct 28 20:21:50.153135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1145/2274] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:50 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:50.419958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0214d3cc-dae9-4af2-aa53-d30443b9332f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:50.420568 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0214d3cc-dae9-4af2-aa53-d30443b9332f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: cf57f68e-5160-4fec-98e7-a8f9f9480b72] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:50.426895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0214d3cc-dae9-4af2-aa53-d30443b9332f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:50.428831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0214d3cc-dae9-4af2-aa53-d30443b9332f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:50.428831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0214d3cc-dae9-4af2-aa53-d30443b9332f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:50.428831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0214d3cc-dae9-4af2-aa53-d30443b9332f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:50.429199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0214d3cc-dae9-4af2-aa53-d30443b9332f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:50.429462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0214d3cc-dae9-4af2-aa53-d30443b9332f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:50.560542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0214d3cc-dae9-4af2-aa53-d30443b9332f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:50.568752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0214d3cc-dae9-4af2-aa53-d30443b9332f tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72" status: 200 len: 1734 microversion: 2.1 time: 0.152678 Oct 28 20:21:50.569303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1130/2275] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:50 2022] GET /compute/v2.1/servers/cf57f68e-5160-4fec-98e7-a8f9f9480b72 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:50.591613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0deea4b-793f-400f-8572-a44c0792031c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '.version_select at 0x7f1f4ced8790>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:50.606039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9f0d64ae-9eb6-4e6e-b591-0acf62d868a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:50.606654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9f0d64ae-9eb6-4e6e-b591-0acf62d868a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:50.613289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f0d64ae-9eb6-4e6e-b591-0acf62d868a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:50.613813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f0d64ae-9eb6-4e6e-b591-0acf62d868a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:50.614254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f0d64ae-9eb6-4e6e-b591-0acf62d868a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:50.614941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f0d64ae-9eb6-4e6e-b591-0acf62d868a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:50.615398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f0d64ae-9eb6-4e6e-b591-0acf62d868a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:50.615826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f0d64ae-9eb6-4e6e-b591-0acf62d868a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:50.671096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0deea4b-793f-400f-8572-a44c0792031c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-203961108" status: 202 len: 0 microversion: 2.1 time: 0.083407 Oct 28 20:21:50.676329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1146/2276] 10.222.0.66 () {58 vars in 1218 bytes} [Fri Oct 28 20:21:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-203961108 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:21:50.746074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fb8d3e80-979a-4360-8ab1-00c61db93f2e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:50.748221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fb8d3e80-979a-4360-8ab1-00c61db93f2e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:50.748520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9f0d64ae-9eb6-4e6e-b591-0acf62d868a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:50.755096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb8d3e80-979a-4360-8ab1-00c61db93f2e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:50.755803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb8d3e80-979a-4360-8ab1-00c61db93f2e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:50.756238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb8d3e80-979a-4360-8ab1-00c61db93f2e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:50.756968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb8d3e80-979a-4360-8ab1-00c61db93f2e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:50.757486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb8d3e80-979a-4360-8ab1-00c61db93f2e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:50.757868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9f0d64ae-9eb6-4e6e-b591-0acf62d868a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.155514 Oct 28 20:21:50.758034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb8d3e80-979a-4360-8ab1-00c61db93f2e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:50.758755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1131/2277] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:50 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:50.789971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fb8d3e80-979a-4360-8ab1-00c61db93f2e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047792 Oct 28 20:21:50.790521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1147/2278] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:50 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:21:51.357786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a9aa1c9d-bb6c-4e9f-aa5f-4595c6a32468 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:51.358501 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a9aa1c9d-bb6c-4e9f-aa5f-4595c6a32468 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:51.366550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9aa1c9d-bb6c-4e9f-aa5f-4595c6a32468 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:51.367452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9aa1c9d-bb6c-4e9f-aa5f-4595c6a32468 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:51.367904 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9aa1c9d-bb6c-4e9f-aa5f-4595c6a32468 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:51.369456 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9aa1c9d-bb6c-4e9f-aa5f-4595c6a32468 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:51.370289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9aa1c9d-bb6c-4e9f-aa5f-4595c6a32468 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:51.371079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9aa1c9d-bb6c-4e9f-aa5f-4595c6a32468 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:51.535777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a9aa1c9d-bb6c-4e9f-aa5f-4595c6a32468 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:51.544713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a9aa1c9d-bb6c-4e9f-aa5f-4595c6a32468 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.372417 Oct 28 20:21:51.545338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1132/2279] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:51 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:51.782629 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9db6ad43-a4ef-48ae-8338-c9c375a79868 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:51.785948 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9db6ad43-a4ef-48ae-8338-c9c375a79868 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:51.790576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9db6ad43-a4ef-48ae-8338-c9c375a79868 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:51.791424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9db6ad43-a4ef-48ae-8338-c9c375a79868 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:51.792061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9db6ad43-a4ef-48ae-8338-c9c375a79868 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:51.794209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9db6ad43-a4ef-48ae-8338-c9c375a79868 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:51.794679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9db6ad43-a4ef-48ae-8338-c9c375a79868 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:51.795525 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9db6ad43-a4ef-48ae-8338-c9c375a79868 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:51.887731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-281dccf1-1c33-4e41-b35d-e716e3792b45 req-b2414654-30df-4c51-985c-d67dd4bfd57b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf57f68e-5160-4fec-98e7-a8f9f9480b72", "tag": "eb535d9c-e24b-43d0-b8b6-bf1d7e7de721"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:21:51.900821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-281dccf1-1c33-4e41-b35d-e716e3792b45 req-b2414654-30df-4c51-985c-d67dd4bfd57b service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:51.901299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-281dccf1-1c33-4e41-b35d-e716e3792b45 req-b2414654-30df-4c51-985c-d67dd4bfd57b service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:51.901745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-281dccf1-1c33-4e41-b35d-e716e3792b45 req-b2414654-30df-4c51-985c-d67dd4bfd57b service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:51.921363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-281dccf1-1c33-4e41-b35d-e716e3792b45 req-b2414654-30df-4c51-985c-d67dd4bfd57b service nova] Creating event network-changed:eb535d9c-e24b-43d0-b8b6-bf1d7e7de721 for instance cf57f68e-5160-4fec-98e7-a8f9f9480b72 on hv-cinder-86236 Oct 28 20:21:51.931107 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-281dccf1-1c33-4e41-b35d-e716e3792b45 req-b2414654-30df-4c51-985c-d67dd4bfd57b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135063 Oct 28 20:21:51.936196 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1133/2280] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:51.943198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e4aec37-6b21-467e-b2cf-664faf7263a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:51.945972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4e4aec37-6b21-467e-b2cf-664faf7263a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:51.962576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e4aec37-6b21-467e-b2cf-664faf7263a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:51.963093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e4aec37-6b21-467e-b2cf-664faf7263a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:51.963957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e4aec37-6b21-467e-b2cf-664faf7263a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:51.966826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e4aec37-6b21-467e-b2cf-664faf7263a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:51.966826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e4aec37-6b21-467e-b2cf-664faf7263a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:51.966826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e4aec37-6b21-467e-b2cf-664faf7263a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:51.989005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9db6ad43-a4ef-48ae-8338-c9c375a79868 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:52.002739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9db6ad43-a4ef-48ae-8338-c9c375a79868 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.224314 Oct 28 20:21:52.003244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1148/2281] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:51 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:52.033861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4e4aec37-6b21-467e-b2cf-664faf7263a4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095932 Oct 28 20:21:52.034731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1134/2282] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:51 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:52.570883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1b5908d3-1f20-483c-b148-8a2a1708ce9e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:52.571496 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1b5908d3-1f20-483c-b148-8a2a1708ce9e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:52.577387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b5908d3-1f20-483c-b148-8a2a1708ce9e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:52.583639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b5908d3-1f20-483c-b148-8a2a1708ce9e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:52.583639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b5908d3-1f20-483c-b148-8a2a1708ce9e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:52.583639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b5908d3-1f20-483c-b148-8a2a1708ce9e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:52.583639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b5908d3-1f20-483c-b148-8a2a1708ce9e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:52.584095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b5908d3-1f20-483c-b148-8a2a1708ce9e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:52.719675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1b5908d3-1f20-483c-b148-8a2a1708ce9e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:52.728246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1b5908d3-1f20-483c-b148-8a2a1708ce9e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.161102 Oct 28 20:21:52.729073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1149/2283] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:52 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:53.036397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-90a1a8ed-12c3-433b-9d22-83795fdb5c08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:53.037019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-90a1a8ed-12c3-433b-9d22-83795fdb5c08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:53.043619 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90a1a8ed-12c3-433b-9d22-83795fdb5c08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:53.044104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90a1a8ed-12c3-433b-9d22-83795fdb5c08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:53.044545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90a1a8ed-12c3-433b-9d22-83795fdb5c08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:53.045238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90a1a8ed-12c3-433b-9d22-83795fdb5c08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:53.045731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90a1a8ed-12c3-433b-9d22-83795fdb5c08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:53.046159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90a1a8ed-12c3-433b-9d22-83795fdb5c08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:53.047918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85553067-29a4-46b9-bd09-10514edb04d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:53.050104 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-85553067-29a4-46b9-bd09-10514edb04d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:53.056210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85553067-29a4-46b9-bd09-10514edb04d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:53.056635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85553067-29a4-46b9-bd09-10514edb04d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:53.057077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85553067-29a4-46b9-bd09-10514edb04d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:53.057795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85553067-29a4-46b9-bd09-10514edb04d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:53.058251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85553067-29a4-46b9-bd09-10514edb04d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:53.058677 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85553067-29a4-46b9-bd09-10514edb04d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:53.091001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-85553067-29a4-46b9-bd09-10514edb04d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046852 Oct 28 20:21:53.091566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1150/2284] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:21:53 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:21:53.186375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-90a1a8ed-12c3-433b-9d22-83795fdb5c08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:53.194602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-90a1a8ed-12c3-433b-9d22-83795fdb5c08 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.162034 Oct 28 20:21:53.195160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1135/2285] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:53 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:53.752376 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b25e10ed-8250-4982-9593-1d866356819a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:53.752997 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b25e10ed-8250-4982-9593-1d866356819a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:53.758929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b25e10ed-8250-4982-9593-1d866356819a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:53.759439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b25e10ed-8250-4982-9593-1d866356819a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:53.759878 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b25e10ed-8250-4982-9593-1d866356819a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:53.760561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b25e10ed-8250-4982-9593-1d866356819a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:53.761014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b25e10ed-8250-4982-9593-1d866356819a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:53.761471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b25e10ed-8250-4982-9593-1d866356819a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:53.887808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b25e10ed-8250-4982-9593-1d866356819a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:53.896723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b25e10ed-8250-4982-9593-1d866356819a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.148948 Oct 28 20:21:53.897292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1151/2286] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:53 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:54.103945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-04f89584-e51c-4151-93d3-9648e18f18de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:21:54.106127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-04f89584-e51c-4151-93d3-9648e18f18de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:54.113052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04f89584-e51c-4151-93d3-9648e18f18de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:54.113572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04f89584-e51c-4151-93d3-9648e18f18de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:54.114012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04f89584-e51c-4151-93d3-9648e18f18de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:54.114691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04f89584-e51c-4151-93d3-9648e18f18de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:54.115147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04f89584-e51c-4151-93d3-9648e18f18de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:54.115568 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04f89584-e51c-4151-93d3-9648e18f18de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:54.197053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-04f89584-e51c-4151-93d3-9648e18f18de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "POST /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/action" status: 200 len: 73895 microversion: 2.1 time: 0.096716 Oct 28 20:21:54.197726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1136/2287] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Oct 28 20:21:54 2022] POST /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91/action => generated 73895 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:21:54.217543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e8657686-0332-49c6-b21c-cce9b5cdcf2b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:54.218182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e8657686-0332-49c6-b21c-cce9b5cdcf2b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:54.225191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8657686-0332-49c6-b21c-cce9b5cdcf2b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:54.225747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8657686-0332-49c6-b21c-cce9b5cdcf2b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:54.226183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8657686-0332-49c6-b21c-cce9b5cdcf2b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:54.226876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8657686-0332-49c6-b21c-cce9b5cdcf2b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:54.227327 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8657686-0332-49c6-b21c-cce9b5cdcf2b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:54.227744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8657686-0332-49c6-b21c-cce9b5cdcf2b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:54.356081 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e8657686-0332-49c6-b21c-cce9b5cdcf2b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:54.358244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:54.364912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e8657686-0332-49c6-b21c-cce9b5cdcf2b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.151496 Oct 28 20:21:54.365506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1152/2288] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:54 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:54.920381 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-235ddaac-3d70-4afd-a4e2-c3bbfc1721fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:54.920998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-235ddaac-3d70-4afd-a4e2-c3bbfc1721fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:54.928585 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235ddaac-3d70-4afd-a4e2-c3bbfc1721fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:54.929061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235ddaac-3d70-4afd-a4e2-c3bbfc1721fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:54.929816 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235ddaac-3d70-4afd-a4e2-c3bbfc1721fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:54.930263 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235ddaac-3d70-4afd-a4e2-c3bbfc1721fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:54.930710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235ddaac-3d70-4afd-a4e2-c3bbfc1721fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:54.931128 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235ddaac-3d70-4afd-a4e2-c3bbfc1721fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:55.065664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-235ddaac-3d70-4afd-a4e2-c3bbfc1721fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:55.073763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-235ddaac-3d70-4afd-a4e2-c3bbfc1721fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.157611 Oct 28 20:21:55.074327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1137/2289] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:54 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:55.388098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3fd9daf4-a126-4395-bf4d-7efe403f4e30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:55.388708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3fd9daf4-a126-4395-bf4d-7efe403f4e30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:55.396170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fd9daf4-a126-4395-bf4d-7efe403f4e30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:55.396647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fd9daf4-a126-4395-bf4d-7efe403f4e30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:55.397071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fd9daf4-a126-4395-bf4d-7efe403f4e30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:55.397775 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fd9daf4-a126-4395-bf4d-7efe403f4e30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:55.398223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fd9daf4-a126-4395-bf4d-7efe403f4e30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:55.398640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fd9daf4-a126-4395-bf4d-7efe403f4e30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:55.524759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3fd9daf4-a126-4395-bf4d-7efe403f4e30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:55.532918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3fd9daf4-a126-4395-bf4d-7efe403f4e30 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.148587 Oct 28 20:21:55.533508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1153/2290] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:55 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:56.097790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1c394d41-4062-44b1-9fd6-5b2f4832f02d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:56.098406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1c394d41-4062-44b1-9fd6-5b2f4832f02d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:56.105064 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c394d41-4062-44b1-9fd6-5b2f4832f02d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:56.105587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c394d41-4062-44b1-9fd6-5b2f4832f02d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:56.106030 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c394d41-4062-44b1-9fd6-5b2f4832f02d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:56.106733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c394d41-4062-44b1-9fd6-5b2f4832f02d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:56.107229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c394d41-4062-44b1-9fd6-5b2f4832f02d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:56.107657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c394d41-4062-44b1-9fd6-5b2f4832f02d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:56.245052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1c394d41-4062-44b1-9fd6-5b2f4832f02d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:56.253501 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1c394d41-4062-44b1-9fd6-5b2f4832f02d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.160079 Oct 28 20:21:56.254098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1138/2291] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:56 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:56.556404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f2b7dc5b-d491-4755-bed8-fa244b7aa059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:56.557019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f2b7dc5b-d491-4755-bed8-fa244b7aa059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:56.563653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2b7dc5b-d491-4755-bed8-fa244b7aa059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:56.564122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2b7dc5b-d491-4755-bed8-fa244b7aa059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:56.564552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2b7dc5b-d491-4755-bed8-fa244b7aa059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:56.565223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2b7dc5b-d491-4755-bed8-fa244b7aa059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:56.565696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2b7dc5b-d491-4755-bed8-fa244b7aa059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:56.566111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2b7dc5b-d491-4755-bed8-fa244b7aa059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:56.695975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f2b7dc5b-d491-4755-bed8-fa244b7aa059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:56.704197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f2b7dc5b-d491-4755-bed8-fa244b7aa059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.151633 Oct 28 20:21:56.704758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1154/2292] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:56 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:57.277014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c905bc8d-7242-465c-b4be-44917dcf1aff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:57.277794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c905bc8d-7242-465c-b4be-44917dcf1aff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:57.285084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c905bc8d-7242-465c-b4be-44917dcf1aff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:57.285556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c905bc8d-7242-465c-b4be-44917dcf1aff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:57.285998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c905bc8d-7242-465c-b4be-44917dcf1aff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:57.286685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c905bc8d-7242-465c-b4be-44917dcf1aff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:57.287149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c905bc8d-7242-465c-b4be-44917dcf1aff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:57.287576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c905bc8d-7242-465c-b4be-44917dcf1aff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:57.421609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c905bc8d-7242-465c-b4be-44917dcf1aff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:57.430339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c905bc8d-7242-465c-b4be-44917dcf1aff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.157119 Oct 28 20:21:57.430993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1139/2293] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:57 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:57.726477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2f1d1064-aed6-4c67-982e-d35a8db03e59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:57.727135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2f1d1064-aed6-4c67-982e-d35a8db03e59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:57.733517 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f1d1064-aed6-4c67-982e-d35a8db03e59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:57.733999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f1d1064-aed6-4c67-982e-d35a8db03e59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:57.734873 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f1d1064-aed6-4c67-982e-d35a8db03e59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:57.735560 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f1d1064-aed6-4c67-982e-d35a8db03e59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:57.736018 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f1d1064-aed6-4c67-982e-d35a8db03e59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:57.736445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f1d1064-aed6-4c67-982e-d35a8db03e59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:57.868217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2f1d1064-aed6-4c67-982e-d35a8db03e59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:57.876513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2f1d1064-aed6-4c67-982e-d35a8db03e59 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.153867 Oct 28 20:21:57.877074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1155/2294] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:57 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:58.454427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-604e2683-d3e0-4821-ac4a-6e8d7e69f24f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:58.455070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-604e2683-d3e0-4821-ac4a-6e8d7e69f24f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:58.461506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-604e2683-d3e0-4821-ac4a-6e8d7e69f24f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:58.461919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-604e2683-d3e0-4821-ac4a-6e8d7e69f24f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:58.462353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-604e2683-d3e0-4821-ac4a-6e8d7e69f24f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:58.463035 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-604e2683-d3e0-4821-ac4a-6e8d7e69f24f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:58.463750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-604e2683-d3e0-4821-ac4a-6e8d7e69f24f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:58.464170 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-604e2683-d3e0-4821-ac4a-6e8d7e69f24f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:58.468201 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:58.593102 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-604e2683-d3e0-4821-ac4a-6e8d7e69f24f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:58.602023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-604e2683-d3e0-4821-ac4a-6e8d7e69f24f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152046 Oct 28 20:21:58.602632 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1140/2295] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:58 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:58.899865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b2f56524-f45f-41b9-a59a-e66deed3cee1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:58.900489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b2f56524-f45f-41b9-a59a-e66deed3cee1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:58.907552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2f56524-f45f-41b9-a59a-e66deed3cee1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:58.908038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2f56524-f45f-41b9-a59a-e66deed3cee1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:58.908481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2f56524-f45f-41b9-a59a-e66deed3cee1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:58.909168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2f56524-f45f-41b9-a59a-e66deed3cee1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:58.909656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2f56524-f45f-41b9-a59a-e66deed3cee1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:58.910086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2f56524-f45f-41b9-a59a-e66deed3cee1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:59.041599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b2f56524-f45f-41b9-a59a-e66deed3cee1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:59.050251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b2f56524-f45f-41b9-a59a-e66deed3cee1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.154224 Oct 28 20:21:59.050809 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1156/2296] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:58 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:59.625755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6e5353c2-65fe-48cc-a520-06f99eecbf5a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:59.626378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6e5353c2-65fe-48cc-a520-06f99eecbf5a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:59.632700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e5353c2-65fe-48cc-a520-06f99eecbf5a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:59.633171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e5353c2-65fe-48cc-a520-06f99eecbf5a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:59.633637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e5353c2-65fe-48cc-a520-06f99eecbf5a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:59.634311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e5353c2-65fe-48cc-a520-06f99eecbf5a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:59.634868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e5353c2-65fe-48cc-a520-06f99eecbf5a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:59.635291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e5353c2-65fe-48cc-a520-06f99eecbf5a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:59.763909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6e5353c2-65fe-48cc-a520-06f99eecbf5a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:59.772888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6e5353c2-65fe-48cc-a520-06f99eecbf5a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151156 Oct 28 20:21:59.773483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1141/2297] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:59 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:00.073388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f60361d6-d9d8-496a-8307-fade91e8e533 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:00.074016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f60361d6-d9d8-496a-8307-fade91e8e533 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:00.081271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f60361d6-d9d8-496a-8307-fade91e8e533 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:00.081780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f60361d6-d9d8-496a-8307-fade91e8e533 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:00.082218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f60361d6-d9d8-496a-8307-fade91e8e533 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:00.082964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f60361d6-d9d8-496a-8307-fade91e8e533 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:00.083415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f60361d6-d9d8-496a-8307-fade91e8e533 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:00.083839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f60361d6-d9d8-496a-8307-fade91e8e533 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:00.216895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f60361d6-d9d8-496a-8307-fade91e8e533 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:00.225752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f60361d6-d9d8-496a-8307-fade91e8e533 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.156171 Oct 28 20:22:00.226337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1157/2298] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:00 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:00.796714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-638abb27-6f30-4989-abf0-affde2862d07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:00.797587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-638abb27-6f30-4989-abf0-affde2862d07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:00.810227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-638abb27-6f30-4989-abf0-affde2862d07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:00.810227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-638abb27-6f30-4989-abf0-affde2862d07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:00.810227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-638abb27-6f30-4989-abf0-affde2862d07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:00.810227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-638abb27-6f30-4989-abf0-affde2862d07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:00.810689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-638abb27-6f30-4989-abf0-affde2862d07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:00.810689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-638abb27-6f30-4989-abf0-affde2862d07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:00.935844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-638abb27-6f30-4989-abf0-affde2862d07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:00.944607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-638abb27-6f30-4989-abf0-affde2862d07 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151935 Oct 28 20:22:00.945179 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1142/2299] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:00 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:01.248068 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a28f1d2e-ad90-4e7c-9e3c-abe970fb0ca7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:01.248689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a28f1d2e-ad90-4e7c-9e3c-abe970fb0ca7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:01.255788 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a28f1d2e-ad90-4e7c-9e3c-abe970fb0ca7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:01.256269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a28f1d2e-ad90-4e7c-9e3c-abe970fb0ca7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:01.256709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a28f1d2e-ad90-4e7c-9e3c-abe970fb0ca7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:01.257422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a28f1d2e-ad90-4e7c-9e3c-abe970fb0ca7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:01.257880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a28f1d2e-ad90-4e7c-9e3c-abe970fb0ca7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:01.258309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a28f1d2e-ad90-4e7c-9e3c-abe970fb0ca7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:01.386693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a28f1d2e-ad90-4e7c-9e3c-abe970fb0ca7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:01.395419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a28f1d2e-ad90-4e7c-9e3c-abe970fb0ca7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.151279 Oct 28 20:22:01.395983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1158/2300] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:01 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:01.967796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-536de440-1bb1-4b18-9acb-7880ecbcd315 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:01.968491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-536de440-1bb1-4b18-9acb-7880ecbcd315 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:01.975211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536de440-1bb1-4b18-9acb-7880ecbcd315 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:01.975696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536de440-1bb1-4b18-9acb-7880ecbcd315 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:01.976144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536de440-1bb1-4b18-9acb-7880ecbcd315 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:01.976831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536de440-1bb1-4b18-9acb-7880ecbcd315 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:01.977344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536de440-1bb1-4b18-9acb-7880ecbcd315 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:01.977779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536de440-1bb1-4b18-9acb-7880ecbcd315 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:02.109866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-536de440-1bb1-4b18-9acb-7880ecbcd315 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:02.117903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-536de440-1bb1-4b18-9acb-7880ecbcd315 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.154280 Oct 28 20:22:02.118466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1143/2301] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:01 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:02.418612 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-09108bbf-9cd5-4174-bc8f-a2c1dcb9de65 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:02.422168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-09108bbf-9cd5-4174-bc8f-a2c1dcb9de65 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:02.425913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09108bbf-9cd5-4174-bc8f-a2c1dcb9de65 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:02.426386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09108bbf-9cd5-4174-bc8f-a2c1dcb9de65 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:02.426849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09108bbf-9cd5-4174-bc8f-a2c1dcb9de65 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:02.427598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09108bbf-9cd5-4174-bc8f-a2c1dcb9de65 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:02.428041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09108bbf-9cd5-4174-bc8f-a2c1dcb9de65 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:02.428460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09108bbf-9cd5-4174-bc8f-a2c1dcb9de65 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:02.560014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-09108bbf-9cd5-4174-bc8f-a2c1dcb9de65 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:02.568745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-09108bbf-9cd5-4174-bc8f-a2c1dcb9de65 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.154244 Oct 28 20:22:02.569337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1159/2302] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:02 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:03.140961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81b4900a-eb0e-4fe2-ae67-755067b9be92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:03.141594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-81b4900a-eb0e-4fe2-ae67-755067b9be92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:03.147974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81b4900a-eb0e-4fe2-ae67-755067b9be92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:03.148456 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81b4900a-eb0e-4fe2-ae67-755067b9be92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:03.148891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81b4900a-eb0e-4fe2-ae67-755067b9be92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:03.149600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81b4900a-eb0e-4fe2-ae67-755067b9be92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:03.150056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81b4900a-eb0e-4fe2-ae67-755067b9be92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:03.150477 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81b4900a-eb0e-4fe2-ae67-755067b9be92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:03.292307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-81b4900a-eb0e-4fe2-ae67-755067b9be92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:03.301541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-81b4900a-eb0e-4fe2-ae67-755067b9be92 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.164740 Oct 28 20:22:03.303178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1144/2303] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:03 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:03.592124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed25ba69-d49a-466f-8be9-13fbd0885c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:03.592741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ed25ba69-d49a-466f-8be9-13fbd0885c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:03.599937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed25ba69-d49a-466f-8be9-13fbd0885c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:03.600424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed25ba69-d49a-466f-8be9-13fbd0885c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:03.600995 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed25ba69-d49a-466f-8be9-13fbd0885c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:03.601718 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed25ba69-d49a-466f-8be9-13fbd0885c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:03.602151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed25ba69-d49a-466f-8be9-13fbd0885c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:03.602571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed25ba69-d49a-466f-8be9-13fbd0885c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:03.729621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ed25ba69-d49a-466f-8be9-13fbd0885c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:03.738600 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ed25ba69-d49a-466f-8be9-13fbd0885c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.150473 Oct 28 20:22:03.739173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1160/2304] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:03 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:04.326017 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3993abae-a59d-4ec1-9644-7b86669ea747 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:04.326638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3993abae-a59d-4ec1-9644-7b86669ea747 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:04.332876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3993abae-a59d-4ec1-9644-7b86669ea747 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:04.333386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3993abae-a59d-4ec1-9644-7b86669ea747 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:04.333827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3993abae-a59d-4ec1-9644-7b86669ea747 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:04.334507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3993abae-a59d-4ec1-9644-7b86669ea747 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:04.334961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3993abae-a59d-4ec1-9644-7b86669ea747 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:04.335384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3993abae-a59d-4ec1-9644-7b86669ea747 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:04.467676 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3993abae-a59d-4ec1-9644-7b86669ea747 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:04.476547 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3993abae-a59d-4ec1-9644-7b86669ea747 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.154546 Oct 28 20:22:04.477111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1145/2305] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:04 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:04.761780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a95a36c-a4f0-4fd1-8d12-a4f281181a34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:04.762388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2a95a36c-a4f0-4fd1-8d12-a4f281181a34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:04.768828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a95a36c-a4f0-4fd1-8d12-a4f281181a34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:04.769305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a95a36c-a4f0-4fd1-8d12-a4f281181a34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:04.769765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a95a36c-a4f0-4fd1-8d12-a4f281181a34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:04.770572 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a95a36c-a4f0-4fd1-8d12-a4f281181a34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:04.771004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a95a36c-a4f0-4fd1-8d12-a4f281181a34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:04.771422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a95a36c-a4f0-4fd1-8d12-a4f281181a34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:04.902894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2a95a36c-a4f0-4fd1-8d12-a4f281181a34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:04.911145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a95a36c-a4f0-4fd1-8d12-a4f281181a34 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.153290 Oct 28 20:22:04.911706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1161/2306] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:04 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:05.498938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c7d81534-09f6-4a07-8629-b865033ba402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:05.500192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c7d81534-09f6-4a07-8629-b865033ba402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:05.506525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d81534-09f6-4a07-8629-b865033ba402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:05.507001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d81534-09f6-4a07-8629-b865033ba402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:05.507434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d81534-09f6-4a07-8629-b865033ba402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:05.508107 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d81534-09f6-4a07-8629-b865033ba402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:05.508555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d81534-09f6-4a07-8629-b865033ba402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:05.508979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d81534-09f6-4a07-8629-b865033ba402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:05.636943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c7d81534-09f6-4a07-8629-b865033ba402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:05.645184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c7d81534-09f6-4a07-8629-b865033ba402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150073 Oct 28 20:22:05.645786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1146/2307] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:05 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:05.935399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-289e17b0-f25c-4c4a-9373-38f1d6b76581 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:05.935907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-289e17b0-f25c-4c4a-9373-38f1d6b76581 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:05.942908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-289e17b0-f25c-4c4a-9373-38f1d6b76581 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:05.943386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-289e17b0-f25c-4c4a-9373-38f1d6b76581 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:05.943820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-289e17b0-f25c-4c4a-9373-38f1d6b76581 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:05.944497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-289e17b0-f25c-4c4a-9373-38f1d6b76581 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:05.944942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-289e17b0-f25c-4c4a-9373-38f1d6b76581 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:05.945386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-289e17b0-f25c-4c4a-9373-38f1d6b76581 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:06.079124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-289e17b0-f25c-4c4a-9373-38f1d6b76581 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:06.087418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-289e17b0-f25c-4c4a-9373-38f1d6b76581 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.155667 Oct 28 20:22:06.087767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1162/2308] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:05 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:06.668081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-222a5aac-c8d5-4ae0-8f6a-6c1a61d08f9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:06.668617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-222a5aac-c8d5-4ae0-8f6a-6c1a61d08f9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:06.675054 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-222a5aac-c8d5-4ae0-8f6a-6c1a61d08f9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:06.675533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-222a5aac-c8d5-4ae0-8f6a-6c1a61d08f9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:06.675969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-222a5aac-c8d5-4ae0-8f6a-6c1a61d08f9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:06.676649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-222a5aac-c8d5-4ae0-8f6a-6c1a61d08f9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:06.677103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-222a5aac-c8d5-4ae0-8f6a-6c1a61d08f9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:06.677555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-222a5aac-c8d5-4ae0-8f6a-6c1a61d08f9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:06.806398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-222a5aac-c8d5-4ae0-8f6a-6c1a61d08f9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:06.815276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-222a5aac-c8d5-4ae0-8f6a-6c1a61d08f9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151159 Oct 28 20:22:06.818666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1147/2309] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:06 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:07.111411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-76f64ba2-8f2d-424c-bb88-c3f3c1b08402 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:07.112032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-76f64ba2-8f2d-424c-bb88-c3f3c1b08402 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:07.118803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f64ba2-8f2d-424c-bb88-c3f3c1b08402 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:07.119277 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f64ba2-8f2d-424c-bb88-c3f3c1b08402 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:07.119706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f64ba2-8f2d-424c-bb88-c3f3c1b08402 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:07.120383 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f64ba2-8f2d-424c-bb88-c3f3c1b08402 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:07.121077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f64ba2-8f2d-424c-bb88-c3f3c1b08402 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:07.121535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f64ba2-8f2d-424c-bb88-c3f3c1b08402 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:07.261040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-76f64ba2-8f2d-424c-bb88-c3f3c1b08402 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:07.272809 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-76f64ba2-8f2d-424c-bb88-c3f3c1b08402 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.165414 Oct 28 20:22:07.273539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1163/2310] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:07 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:07.840076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c3dcbb60-699f-4466-bcd5-e197bf2abc63 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:07.840690 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c3dcbb60-699f-4466-bcd5-e197bf2abc63 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:07.843107 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:07.848161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3dcbb60-699f-4466-bcd5-e197bf2abc63 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:07.848638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3dcbb60-699f-4466-bcd5-e197bf2abc63 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:07.849070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3dcbb60-699f-4466-bcd5-e197bf2abc63 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:07.849781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3dcbb60-699f-4466-bcd5-e197bf2abc63 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:07.850238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3dcbb60-699f-4466-bcd5-e197bf2abc63 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:07.850660 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3dcbb60-699f-4466-bcd5-e197bf2abc63 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:07.978734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c3dcbb60-699f-4466-bcd5-e197bf2abc63 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:07.987568 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c3dcbb60-699f-4466-bcd5-e197bf2abc63 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151535 Oct 28 20:22:07.988136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1148/2311] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:07 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:08.295954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ddaf11ec-f068-4309-b3fa-618f24be7f5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:08.296687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ddaf11ec-f068-4309-b3fa-618f24be7f5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:08.304265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddaf11ec-f068-4309-b3fa-618f24be7f5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:08.304749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddaf11ec-f068-4309-b3fa-618f24be7f5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:08.305190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddaf11ec-f068-4309-b3fa-618f24be7f5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:08.305983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddaf11ec-f068-4309-b3fa-618f24be7f5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:08.306437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddaf11ec-f068-4309-b3fa-618f24be7f5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:08.306864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddaf11ec-f068-4309-b3fa-618f24be7f5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:08.435429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ddaf11ec-f068-4309-b3fa-618f24be7f5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:08.443621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ddaf11ec-f068-4309-b3fa-618f24be7f5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.151474 Oct 28 20:22:08.444193 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1164/2312] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:08 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:09.010771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-95d994d6-0eea-4d06-a7fd-d4b89e6dff49 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:09.011377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-95d994d6-0eea-4d06-a7fd-d4b89e6dff49 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:09.018443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95d994d6-0eea-4d06-a7fd-d4b89e6dff49 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:09.018920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95d994d6-0eea-4d06-a7fd-d4b89e6dff49 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:09.019352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95d994d6-0eea-4d06-a7fd-d4b89e6dff49 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:09.020038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95d994d6-0eea-4d06-a7fd-d4b89e6dff49 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:09.020485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95d994d6-0eea-4d06-a7fd-d4b89e6dff49 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:09.020901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95d994d6-0eea-4d06-a7fd-d4b89e6dff49 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:09.151154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-95d994d6-0eea-4d06-a7fd-d4b89e6dff49 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:09.159178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-95d994d6-0eea-4d06-a7fd-d4b89e6dff49 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152209 Oct 28 20:22:09.159745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1149/2313] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:09 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:09.466875 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5695b873-b89e-43fa-9ec0-9dee65a42b3a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:09.467490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5695b873-b89e-43fa-9ec0-9dee65a42b3a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:09.470027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:09.474679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5695b873-b89e-43fa-9ec0-9dee65a42b3a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:09.475164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5695b873-b89e-43fa-9ec0-9dee65a42b3a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:09.475603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5695b873-b89e-43fa-9ec0-9dee65a42b3a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:09.476283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5695b873-b89e-43fa-9ec0-9dee65a42b3a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:09.476733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5695b873-b89e-43fa-9ec0-9dee65a42b3a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:09.477153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5695b873-b89e-43fa-9ec0-9dee65a42b3a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:09.603729 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5695b873-b89e-43fa-9ec0-9dee65a42b3a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:09.611936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5695b873-b89e-43fa-9ec0-9dee65a42b3a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.149054 Oct 28 20:22:09.612500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1165/2314] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:09 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:10.182734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9e648080-a3b9-4329-831a-ac1b2de4cb0c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:10.183262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9e648080-a3b9-4329-831a-ac1b2de4cb0c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:10.189769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e648080-a3b9-4329-831a-ac1b2de4cb0c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:10.190245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e648080-a3b9-4329-831a-ac1b2de4cb0c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:10.190679 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e648080-a3b9-4329-831a-ac1b2de4cb0c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:10.191372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e648080-a3b9-4329-831a-ac1b2de4cb0c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:10.191803 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e648080-a3b9-4329-831a-ac1b2de4cb0c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:10.192220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e648080-a3b9-4329-831a-ac1b2de4cb0c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:10.325536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9e648080-a3b9-4329-831a-ac1b2de4cb0c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:10.334770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9e648080-a3b9-4329-831a-ac1b2de4cb0c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.155885 Oct 28 20:22:10.335326 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1150/2315] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:10 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:10.635413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aa76ce2a-cd2d-4887-aff2-13e26a6e61c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:10.636037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aa76ce2a-cd2d-4887-aff2-13e26a6e61c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:10.642501 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa76ce2a-cd2d-4887-aff2-13e26a6e61c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:10.642976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa76ce2a-cd2d-4887-aff2-13e26a6e61c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:10.643411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa76ce2a-cd2d-4887-aff2-13e26a6e61c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:10.644091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa76ce2a-cd2d-4887-aff2-13e26a6e61c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:10.644570 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa76ce2a-cd2d-4887-aff2-13e26a6e61c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:10.644990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa76ce2a-cd2d-4887-aff2-13e26a6e61c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:10.772293 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-aa76ce2a-cd2d-4887-aff2-13e26a6e61c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:10.780355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aa76ce2a-cd2d-4887-aff2-13e26a6e61c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.148809 Oct 28 20:22:10.781094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1166/2316] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:10 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:11.358123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03acdb43-3104-406b-b0f7-dfe62c17c454 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:11.359977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-03acdb43-3104-406b-b0f7-dfe62c17c454 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:11.366591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03acdb43-3104-406b-b0f7-dfe62c17c454 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:11.367081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03acdb43-3104-406b-b0f7-dfe62c17c454 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:11.397924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03acdb43-3104-406b-b0f7-dfe62c17c454 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:11.397924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03acdb43-3104-406b-b0f7-dfe62c17c454 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:11.397924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03acdb43-3104-406b-b0f7-dfe62c17c454 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:11.397924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03acdb43-3104-406b-b0f7-dfe62c17c454 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:11.512189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-03acdb43-3104-406b-b0f7-dfe62c17c454 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:11.522053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-03acdb43-3104-406b-b0f7-dfe62c17c454 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.167823 Oct 28 20:22:11.522711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1151/2317] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:11 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:11.804488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bd55aeae-ad32-455b-b693-28c648abed4b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:11.805102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bd55aeae-ad32-455b-b693-28c648abed4b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:11.811506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd55aeae-ad32-455b-b693-28c648abed4b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:11.812552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd55aeae-ad32-455b-b693-28c648abed4b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:11.812986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd55aeae-ad32-455b-b693-28c648abed4b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:11.813697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd55aeae-ad32-455b-b693-28c648abed4b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:11.814152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd55aeae-ad32-455b-b693-28c648abed4b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:11.814574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd55aeae-ad32-455b-b693-28c648abed4b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:11.943003 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bd55aeae-ad32-455b-b693-28c648abed4b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:11.951027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bd55aeae-ad32-455b-b693-28c648abed4b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.150437 Oct 28 20:22:11.951577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1167/2318] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:11 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:12.547293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-390cbb8c-cdb2-4222-ae6f-e033b31afc8f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:12.547900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-390cbb8c-cdb2-4222-ae6f-e033b31afc8f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:12.554977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-390cbb8c-cdb2-4222-ae6f-e033b31afc8f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:12.555485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-390cbb8c-cdb2-4222-ae6f-e033b31afc8f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:12.556093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-390cbb8c-cdb2-4222-ae6f-e033b31afc8f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:12.558158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-390cbb8c-cdb2-4222-ae6f-e033b31afc8f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:12.558158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-390cbb8c-cdb2-4222-ae6f-e033b31afc8f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:12.558158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-390cbb8c-cdb2-4222-ae6f-e033b31afc8f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:12.685112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-390cbb8c-cdb2-4222-ae6f-e033b31afc8f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:12.693233 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-390cbb8c-cdb2-4222-ae6f-e033b31afc8f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150778 Oct 28 20:22:12.693877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1152/2319] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:12 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:12.974846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9d82564b-6ec0-498b-87fa-1c4255db723a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:12.975458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9d82564b-6ec0-498b-87fa-1c4255db723a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:12.981808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d82564b-6ec0-498b-87fa-1c4255db723a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:12.982287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d82564b-6ec0-498b-87fa-1c4255db723a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:12.982726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d82564b-6ec0-498b-87fa-1c4255db723a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:12.983948 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d82564b-6ec0-498b-87fa-1c4255db723a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:12.984416 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d82564b-6ec0-498b-87fa-1c4255db723a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:12.984849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d82564b-6ec0-498b-87fa-1c4255db723a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:13.115942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9d82564b-6ec0-498b-87fa-1c4255db723a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:13.124234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9d82564b-6ec0-498b-87fa-1c4255db723a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.153067 Oct 28 20:22:13.125463 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1168/2320] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:12 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:13.716166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-250b6699-bf97-4d2e-a442-f5c4c237e4b7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:13.716779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-250b6699-bf97-4d2e-a442-f5c4c237e4b7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:13.723912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-250b6699-bf97-4d2e-a442-f5c4c237e4b7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:13.724395 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-250b6699-bf97-4d2e-a442-f5c4c237e4b7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:13.724836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-250b6699-bf97-4d2e-a442-f5c4c237e4b7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:13.725821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-250b6699-bf97-4d2e-a442-f5c4c237e4b7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:13.726283 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-250b6699-bf97-4d2e-a442-f5c4c237e4b7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:13.726707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-250b6699-bf97-4d2e-a442-f5c4c237e4b7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:13.851974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-250b6699-bf97-4d2e-a442-f5c4c237e4b7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:13.860719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-250b6699-bf97-4d2e-a442-f5c4c237e4b7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.148079 Oct 28 20:22:13.861306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1153/2321] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:13 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:14.147774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36324318-d814-4690-8fa6-8a7553f95a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:14.148410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36324318-d814-4690-8fa6-8a7553f95a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:14.154717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36324318-d814-4690-8fa6-8a7553f95a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:14.155200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36324318-d814-4690-8fa6-8a7553f95a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:14.155640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36324318-d814-4690-8fa6-8a7553f95a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:14.156327 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36324318-d814-4690-8fa6-8a7553f95a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:14.156780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36324318-d814-4690-8fa6-8a7553f95a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:14.157825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36324318-d814-4690-8fa6-8a7553f95a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:14.172235 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:14.293119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-36324318-d814-4690-8fa6-8a7553f95a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:14.302110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36324318-d814-4690-8fa6-8a7553f95a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.158162 Oct 28 20:22:14.302673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1169/2322] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:14 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:14.884499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0628d8f0-2bea-4fb7-9e6c-1deb170b7add tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:14.885061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0628d8f0-2bea-4fb7-9e6c-1deb170b7add tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:14.892270 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0628d8f0-2bea-4fb7-9e6c-1deb170b7add tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:14.892977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0628d8f0-2bea-4fb7-9e6c-1deb170b7add tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:14.893447 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0628d8f0-2bea-4fb7-9e6c-1deb170b7add tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:14.894164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0628d8f0-2bea-4fb7-9e6c-1deb170b7add tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:14.894621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0628d8f0-2bea-4fb7-9e6c-1deb170b7add tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:14.895048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0628d8f0-2bea-4fb7-9e6c-1deb170b7add tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:15.021609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0628d8f0-2bea-4fb7-9e6c-1deb170b7add tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:15.029856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0628d8f0-2bea-4fb7-9e6c-1deb170b7add tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149288 Oct 28 20:22:15.030451 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1154/2323] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:14 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:15.325790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-673ff9c5-63da-4db3-a450-b5f221dce059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:15.326407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-673ff9c5-63da-4db3-a450-b5f221dce059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:15.333350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-673ff9c5-63da-4db3-a450-b5f221dce059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:15.333836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-673ff9c5-63da-4db3-a450-b5f221dce059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:15.334277 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-673ff9c5-63da-4db3-a450-b5f221dce059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:15.334960 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-673ff9c5-63da-4db3-a450-b5f221dce059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:15.335408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-673ff9c5-63da-4db3-a450-b5f221dce059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:15.335831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-673ff9c5-63da-4db3-a450-b5f221dce059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:15.465492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-673ff9c5-63da-4db3-a450-b5f221dce059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:15.474086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-673ff9c5-63da-4db3-a450-b5f221dce059 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.152108 Oct 28 20:22:15.474638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1170/2324] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:15 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:15.763932 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b1243789-6441-4082-974f-8ab0d3295637 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:15.764479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b1243789-6441-4082-974f-8ab0d3295637 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:15.770572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1243789-6441-4082-974f-8ab0d3295637 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:15.771048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1243789-6441-4082-974f-8ab0d3295637 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:15.771493 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1243789-6441-4082-974f-8ab0d3295637 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:15.772153 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1243789-6441-4082-974f-8ab0d3295637 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:15.772598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1243789-6441-4082-974f-8ab0d3295637 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:15.773016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1243789-6441-4082-974f-8ab0d3295637 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:15.797374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b1243789-6441-4082-974f-8ab0d3295637 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:22:15.831510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:16.052951 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0462f78d-ff29-473a-9805-2f2a880eacce tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:16.053597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0462f78d-ff29-473a-9805-2f2a880eacce tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:16.059515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0462f78d-ff29-473a-9805-2f2a880eacce tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:16.059999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0462f78d-ff29-473a-9805-2f2a880eacce tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:16.060437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0462f78d-ff29-473a-9805-2f2a880eacce tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:16.061162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0462f78d-ff29-473a-9805-2f2a880eacce tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:16.061642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0462f78d-ff29-473a-9805-2f2a880eacce tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:16.062071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0462f78d-ff29-473a-9805-2f2a880eacce tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:16.086572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b1243789-6441-4082-974f-8ab0d3295637 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 204 len: 0 microversion: 2.20 time: 0.326108 Oct 28 20:22:16.087283 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1155/2325] 10.222.0.66 () {60 vars in 1280 bytes} [Fri Oct 28 20:22:15 2022] DELETE /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 20:22:16.096940 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c9d2fe14-63a1-428e-a576-8e34856c1e13 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:16.097712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c9d2fe14-63a1-428e-a576-8e34856c1e13 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:16.103889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d2fe14-63a1-428e-a576-8e34856c1e13 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:16.104372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d2fe14-63a1-428e-a576-8e34856c1e13 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:16.104812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d2fe14-63a1-428e-a576-8e34856c1e13 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:16.105544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d2fe14-63a1-428e-a576-8e34856c1e13 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:16.105999 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d2fe14-63a1-428e-a576-8e34856c1e13 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:16.106431 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d2fe14-63a1-428e-a576-8e34856c1e13 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:16.241603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0462f78d-ff29-473a-9805-2f2a880eacce tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:16.250919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0462f78d-ff29-473a-9805-2f2a880eacce tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.200952 Oct 28 20:22:16.250919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1171/2326] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:16 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:16.280353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c9d2fe14-63a1-428e-a576-8e34856c1e13 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:16.288807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c9d2fe14-63a1-428e-a576-8e34856c1e13 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:16.290389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c9d2fe14-63a1-428e-a576-8e34856c1e13 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:16.291619 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c9d2fe14-63a1-428e-a576-8e34856c1e13 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 200 len: 1724 microversion: 2.20 time: 0.199499 Oct 28 20:22:16.292184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1156/2327] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:22:16 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 20:22:16.497680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9276f8ab-1c2d-462e-bed7-c05d846bbdc5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:16.498331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9276f8ab-1c2d-462e-bed7-c05d846bbdc5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:16.504271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9276f8ab-1c2d-462e-bed7-c05d846bbdc5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:16.504754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9276f8ab-1c2d-462e-bed7-c05d846bbdc5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:16.505196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9276f8ab-1c2d-462e-bed7-c05d846bbdc5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:16.505918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9276f8ab-1c2d-462e-bed7-c05d846bbdc5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:16.506375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9276f8ab-1c2d-462e-bed7-c05d846bbdc5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:16.506798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9276f8ab-1c2d-462e-bed7-c05d846bbdc5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:16.641882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9276f8ab-1c2d-462e-bed7-c05d846bbdc5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:16.651965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9276f8ab-1c2d-462e-bed7-c05d846bbdc5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.158019 Oct 28 20:22:16.652953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1172/2328] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:16 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:17.274438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7a9d356e-727e-4cda-94ec-1b18e192cffe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:17.275049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7a9d356e-727e-4cda-94ec-1b18e192cffe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:17.281936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a9d356e-727e-4cda-94ec-1b18e192cffe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:17.282478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a9d356e-727e-4cda-94ec-1b18e192cffe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:17.282925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a9d356e-727e-4cda-94ec-1b18e192cffe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:17.283673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a9d356e-727e-4cda-94ec-1b18e192cffe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:17.284477 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a9d356e-727e-4cda-94ec-1b18e192cffe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:17.285236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a9d356e-727e-4cda-94ec-1b18e192cffe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:17.318367 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-18a2ea26-02e6-4480-8a8d-0cdd5790e07f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:17.319624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-18a2ea26-02e6-4480-8a8d-0cdd5790e07f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:17.329428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18a2ea26-02e6-4480-8a8d-0cdd5790e07f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:17.329859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18a2ea26-02e6-4480-8a8d-0cdd5790e07f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:17.330337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18a2ea26-02e6-4480-8a8d-0cdd5790e07f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:17.331198 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18a2ea26-02e6-4480-8a8d-0cdd5790e07f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:17.331505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18a2ea26-02e6-4480-8a8d-0cdd5790e07f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:17.331933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18a2ea26-02e6-4480-8a8d-0cdd5790e07f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:17.428404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-18a2ea26-02e6-4480-8a8d-0cdd5790e07f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:17.438762 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-18a2ea26-02e6-4480-8a8d-0cdd5790e07f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:17.440241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-18a2ea26-02e6-4480-8a8d-0cdd5790e07f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:17.441500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-18a2ea26-02e6-4480-8a8d-0cdd5790e07f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 200 len: 1657 microversion: 2.20 time: 0.128161 Oct 28 20:22:17.458201 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1173/2329] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:22:17 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 1657 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:22:17.465499 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-f46d6859-e546-4cdc-9330-a7200de290c7 req-720173a0-4fd9-4177-a541-0e71951ef1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a0384e-d0fc-4074-ae6f-32c22703e39e", "name": "network-vif-deleted", "tag": "97663e7d-9314-4317-8bfc-b53edd5ed176"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:22:17.479175 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f46d6859-e546-4cdc-9330-a7200de290c7 req-720173a0-4fd9-4177-a541-0e71951ef1f6 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:17.479661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f46d6859-e546-4cdc-9330-a7200de290c7 req-720173a0-4fd9-4177-a541-0e71951ef1f6 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:17.480094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f46d6859-e546-4cdc-9330-a7200de290c7 req-720173a0-4fd9-4177-a541-0e71951ef1f6 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:17.488404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7a9d356e-727e-4cda-94ec-1b18e192cffe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:17.494070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-f46d6859-e546-4cdc-9330-a7200de290c7 req-720173a0-4fd9-4177-a541-0e71951ef1f6 service nova] Creating event network-vif-deleted:97663e7d-9314-4317-8bfc-b53edd5ed176 for instance c6a0384e-d0fc-4074-ae6f-32c22703e39e on hv-cinder-86236 Oct 28 20:22:17.496787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7a9d356e-727e-4cda-94ec-1b18e192cffe tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.226262 Oct 28 20:22:17.505375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1157/2330] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:17 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:17.517389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-f46d6859-e546-4cdc-9330-a7200de290c7 req-720173a0-4fd9-4177-a541-0e71951ef1f6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057565 Oct 28 20:22:17.519035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1174/2331] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:22:17.676712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-feeff703-f3bc-4529-934c-b4a5799819bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:17.677354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-feeff703-f3bc-4529-934c-b4a5799819bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:17.694351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feeff703-f3bc-4529-934c-b4a5799819bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:17.696926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feeff703-f3bc-4529-934c-b4a5799819bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:17.696926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feeff703-f3bc-4529-934c-b4a5799819bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:17.696926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feeff703-f3bc-4529-934c-b4a5799819bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:17.696926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feeff703-f3bc-4529-934c-b4a5799819bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:17.697387 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feeff703-f3bc-4529-934c-b4a5799819bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:17.843092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-feeff703-f3bc-4529-934c-b4a5799819bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:17.851821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-feeff703-f3bc-4529-934c-b4a5799819bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.179170 Oct 28 20:22:17.854840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1158/2332] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:17 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:18.467751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e723aaf9-93db-45d8-9646-7ee477378dbc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:18.468507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e723aaf9-93db-45d8-9646-7ee477378dbc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:18.477135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e723aaf9-93db-45d8-9646-7ee477378dbc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:18.478814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e723aaf9-93db-45d8-9646-7ee477378dbc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:18.478814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e723aaf9-93db-45d8-9646-7ee477378dbc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:18.478814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e723aaf9-93db-45d8-9646-7ee477378dbc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:18.479261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e723aaf9-93db-45d8-9646-7ee477378dbc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:18.479675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e723aaf9-93db-45d8-9646-7ee477378dbc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:18.518686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e723aaf9-93db-45d8-9646-7ee477378dbc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:18.518686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e723aaf9-93db-45d8-9646-7ee477378dbc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:18.518686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e723aaf9-93db-45d8-9646-7ee477378dbc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:18.518686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-e723aaf9-93db-45d8-9646-7ee477378dbc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lazy-loading 'fault' on Instance uuid c6a0384e-d0fc-4074-ae6f-32c22703e39e {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:22:18.526723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-043b4ac0-0d4a-4559-b6b9-dbb1b817802a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:18.530973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-043b4ac0-0d4a-4559-b6b9-dbb1b817802a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:18.536535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043b4ac0-0d4a-4559-b6b9-dbb1b817802a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:18.537019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043b4ac0-0d4a-4559-b6b9-dbb1b817802a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:18.537728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043b4ac0-0d4a-4559-b6b9-dbb1b817802a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:18.538952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043b4ac0-0d4a-4559-b6b9-dbb1b817802a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:18.539672 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043b4ac0-0d4a-4559-b6b9-dbb1b817802a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:18.540269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043b4ac0-0d4a-4559-b6b9-dbb1b817802a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:18.563394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e723aaf9-93db-45d8-9646-7ee477378dbc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:18.572423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e723aaf9-93db-45d8-9646-7ee477378dbc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:18.574060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e723aaf9-93db-45d8-9646-7ee477378dbc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0ba6bf2459d4a98a3a1f5684bdad2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d30fbe6fa645bd9ea3d88ea5f68449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:18.575349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e723aaf9-93db-45d8-9646-7ee477378dbc tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 200 len: 1371 microversion: 2.20 time: 0.112289 Oct 28 20:22:18.587912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1175/2333] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:22:18 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 20:22:18.680607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-043b4ac0-0d4a-4559-b6b9-dbb1b817802a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:18.688987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-043b4ac0-0d4a-4559-b6b9-dbb1b817802a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.168749 Oct 28 20:22:18.690307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1159/2334] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:18 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:18.875502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2df93527-35d4-4729-b5b3-a907f7495a0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:18.876126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2df93527-35d4-4729-b5b3-a907f7495a0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:18.882616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2df93527-35d4-4729-b5b3-a907f7495a0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:18.883139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2df93527-35d4-4729-b5b3-a907f7495a0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:18.883625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2df93527-35d4-4729-b5b3-a907f7495a0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:18.884309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2df93527-35d4-4729-b5b3-a907f7495a0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:18.884785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2df93527-35d4-4729-b5b3-a907f7495a0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:18.885210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2df93527-35d4-4729-b5b3-a907f7495a0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:19.014115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2df93527-35d4-4729-b5b3-a907f7495a0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:19.023451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2df93527-35d4-4729-b5b3-a907f7495a0a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.152071 Oct 28 20:22:19.024015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1176/2335] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:18 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:19.600445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4cbb6662-d5cc-488e-b80f-5b8dea04e193 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:19.601101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4cbb6662-d5cc-488e-b80f-5b8dea04e193 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:19.607551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cbb6662-d5cc-488e-b80f-5b8dea04e193 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:19.608035 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cbb6662-d5cc-488e-b80f-5b8dea04e193 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:19.608475 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cbb6662-d5cc-488e-b80f-5b8dea04e193 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:19.609158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cbb6662-d5cc-488e-b80f-5b8dea04e193 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:19.609643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cbb6662-d5cc-488e-b80f-5b8dea04e193 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:19.610069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cbb6662-d5cc-488e-b80f-5b8dea04e193 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:19.623798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-4cbb6662-d5cc-488e-b80f-5b8dea04e193 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] HTTP exception thrown: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4cbb6662-d5cc-488e-b80f-5b8dea04e193 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Request method failure captured: Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e HTTP/1.1 Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDYUV_YNM0XXwBBLx-WTdB2tjq5FfUSX5VRsT-xAlZ_e2f17iFR5KGzRqSyIT82YsBG3tEufG_S544gzvHRmKEDqErboY4PRO_Jp3hTpg8bXzg1fr4ePkhDzlMYdYf0HRuRZe5iaTEAu5mcOB7RsQRVC4HQxwtLzgZrAvWmiG9LEcj0 Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 34d30fbe6fa645bd9ea3d88ea5f68449 Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:22:19.625466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:22:19.627355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34d30fbe6fa645bd9ea3d88ea5f68449", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:22:19.627355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:22:19.627355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 34d30fbe6fa645bd9ea3d88ea5f68449 Oct 28 20:22:19.627355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:22:19.627355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-AttachVolumeShelveTestJSON-1907610215-project Oct 28 20:22:19.627355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:22:19.627355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:22:19.627355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: e0ba6bf2459d4a98a3a1f5684bdad2b2 Oct 28 20:22:19.627355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1907610215-project Oct 28 20:22:19.627355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:22:19.627355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. Oct 28 20:22:19.627355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': 'c6a0384e-d0fc-4074-ae6f-32c22703e39e'} Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:22:19.628378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. Oct 28 20:22:19.630720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:22:19.632382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4cbb6662-d5cc-488e-b80f-5b8dea04e193 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Returning 404 to user: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:22:19.632382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4cbb6662-d5cc-488e-b80f-5b8dea04e193 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 404 len: 111 microversion: 2.20 time: 0.030293 Oct 28 20:22:19.632382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1160/2336] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:22:19 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 20:22:19.636464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e0dfd721-6fe3-4e73-966f-042234c62b1b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '.version_select at 0x7f1f4cf173a0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:19.710504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e0dfd721-6fe3-4e73-966f-042234c62b1b tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-453711579" status: 204 len: 0 microversion: 2.20 time: 0.077775 Oct 28 20:22:19.711099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1177/2337] 10.222.0.66 () {60 vars in 1259 bytes} [Fri Oct 28 20:22:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-453711579 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 20:22:19.714238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-16dc33d9-ea03-4543-a36c-999b2cfdcf06 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:19.714957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-16dc33d9-ea03-4543-a36c-999b2cfdcf06 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:19.724199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16dc33d9-ea03-4543-a36c-999b2cfdcf06 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:19.724199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16dc33d9-ea03-4543-a36c-999b2cfdcf06 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:19.724199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16dc33d9-ea03-4543-a36c-999b2cfdcf06 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:19.724199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16dc33d9-ea03-4543-a36c-999b2cfdcf06 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:19.725163 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16dc33d9-ea03-4543-a36c-999b2cfdcf06 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:19.725163 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16dc33d9-ea03-4543-a36c-999b2cfdcf06 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:19.869230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-16dc33d9-ea03-4543-a36c-999b2cfdcf06 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:19.878004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-16dc33d9-ea03-4543-a36c-999b2cfdcf06 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.167299 Oct 28 20:22:19.878563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1161/2338] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:19 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:20.048003 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-143779c0-4ae5-4a26-b8f7-f4040b016457 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:20.049608 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-143779c0-4ae5-4a26-b8f7-f4040b016457 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:20.056508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-143779c0-4ae5-4a26-b8f7-f4040b016457 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:20.061471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-143779c0-4ae5-4a26-b8f7-f4040b016457 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:20.061471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-143779c0-4ae5-4a26-b8f7-f4040b016457 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:20.061471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-143779c0-4ae5-4a26-b8f7-f4040b016457 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:20.061471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-143779c0-4ae5-4a26-b8f7-f4040b016457 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:20.061894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-143779c0-4ae5-4a26-b8f7-f4040b016457 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:20.205292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-143779c0-4ae5-4a26-b8f7-f4040b016457 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:20.214114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-143779c0-4ae5-4a26-b8f7-f4040b016457 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.169813 Oct 28 20:22:20.214617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1178/2339] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:20 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:20.900655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7dd1ba7-0a11-410a-91d8-a0668bcf310a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:20.901272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7dd1ba7-0a11-410a-91d8-a0668bcf310a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:20.907681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7dd1ba7-0a11-410a-91d8-a0668bcf310a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:20.908167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7dd1ba7-0a11-410a-91d8-a0668bcf310a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:20.908685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7dd1ba7-0a11-410a-91d8-a0668bcf310a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:20.909566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7dd1ba7-0a11-410a-91d8-a0668bcf310a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:20.910029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7dd1ba7-0a11-410a-91d8-a0668bcf310a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:20.910459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7dd1ba7-0a11-410a-91d8-a0668bcf310a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:21.037945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7dd1ba7-0a11-410a-91d8-a0668bcf310a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:21.046122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7dd1ba7-0a11-410a-91d8-a0668bcf310a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149355 Oct 28 20:22:21.046693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1162/2340] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:20 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:21.240641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3b097420-518c-45d4-9cc4-edc3de0d447b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:21.241256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3b097420-518c-45d4-9cc4-edc3de0d447b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:21.247575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b097420-518c-45d4-9cc4-edc3de0d447b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:21.248064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b097420-518c-45d4-9cc4-edc3de0d447b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:21.248503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b097420-518c-45d4-9cc4-edc3de0d447b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:21.249184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b097420-518c-45d4-9cc4-edc3de0d447b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:21.249676 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b097420-518c-45d4-9cc4-edc3de0d447b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:21.250098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b097420-518c-45d4-9cc4-edc3de0d447b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:21.387021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3b097420-518c-45d4-9cc4-edc3de0d447b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:21.396140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3b097420-518c-45d4-9cc4-edc3de0d447b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.160064 Oct 28 20:22:21.396708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1179/2341] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:21 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:22.070374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-badc55db-90db-40ec-8f00-512f85425ccc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:22.070996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-badc55db-90db-40ec-8f00-512f85425ccc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:22.077391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-badc55db-90db-40ec-8f00-512f85425ccc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:22.077876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-badc55db-90db-40ec-8f00-512f85425ccc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:22.078318 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-badc55db-90db-40ec-8f00-512f85425ccc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:22.079004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-badc55db-90db-40ec-8f00-512f85425ccc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:22.079461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-badc55db-90db-40ec-8f00-512f85425ccc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:22.079891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-badc55db-90db-40ec-8f00-512f85425ccc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:22.208569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-badc55db-90db-40ec-8f00-512f85425ccc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:22.216948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-badc55db-90db-40ec-8f00-512f85425ccc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150412 Oct 28 20:22:22.217541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1163/2342] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:22 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:22.419653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-28dfb730-bfc2-4b9a-9605-e4e85a6ce2b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:22.420231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-28dfb730-bfc2-4b9a-9605-e4e85a6ce2b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:22.426766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28dfb730-bfc2-4b9a-9605-e4e85a6ce2b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:22.427240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28dfb730-bfc2-4b9a-9605-e4e85a6ce2b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:22.427669 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28dfb730-bfc2-4b9a-9605-e4e85a6ce2b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:22.428345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28dfb730-bfc2-4b9a-9605-e4e85a6ce2b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:22.428794 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28dfb730-bfc2-4b9a-9605-e4e85a6ce2b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:22.429213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28dfb730-bfc2-4b9a-9605-e4e85a6ce2b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:22.557536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-28dfb730-bfc2-4b9a-9605-e4e85a6ce2b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:22.565646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-28dfb730-bfc2-4b9a-9605-e4e85a6ce2b5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.149937 Oct 28 20:22:22.566212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1180/2343] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:22 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:23.241071 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1fc80b0b-2742-4c2c-b3a6-6c3c7041f59a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:23.241651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1fc80b0b-2742-4c2c-b3a6-6c3c7041f59a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:23.247979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fc80b0b-2742-4c2c-b3a6-6c3c7041f59a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:23.248453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fc80b0b-2742-4c2c-b3a6-6c3c7041f59a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:23.248933 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fc80b0b-2742-4c2c-b3a6-6c3c7041f59a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:23.249628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fc80b0b-2742-4c2c-b3a6-6c3c7041f59a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:23.250083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fc80b0b-2742-4c2c-b3a6-6c3c7041f59a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:23.250505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fc80b0b-2742-4c2c-b3a6-6c3c7041f59a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:23.395228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1fc80b0b-2742-4c2c-b3a6-6c3c7041f59a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:23.403471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1fc80b0b-2742-4c2c-b3a6-6c3c7041f59a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.167060 Oct 28 20:22:23.404031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1164/2344] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:23 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:23.589801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f28b2850-0e16-4152-8d07-65caece6b1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:23.590361 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f28b2850-0e16-4152-8d07-65caece6b1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:23.597417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f28b2850-0e16-4152-8d07-65caece6b1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:23.597893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f28b2850-0e16-4152-8d07-65caece6b1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:23.598323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f28b2850-0e16-4152-8d07-65caece6b1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:23.598988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f28b2850-0e16-4152-8d07-65caece6b1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:23.599433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f28b2850-0e16-4152-8d07-65caece6b1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:23.599851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f28b2850-0e16-4152-8d07-65caece6b1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:23.729771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f28b2850-0e16-4152-8d07-65caece6b1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:23.738058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f28b2850-0e16-4152-8d07-65caece6b1d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.152773 Oct 28 20:22:23.738616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1181/2345] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:23 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:24.427814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a3d6905-348d-4dfd-be75-cb6cbc229f28 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:24.428437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9a3d6905-348d-4dfd-be75-cb6cbc229f28 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:24.434538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a3d6905-348d-4dfd-be75-cb6cbc229f28 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:24.435025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a3d6905-348d-4dfd-be75-cb6cbc229f28 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:24.435465 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a3d6905-348d-4dfd-be75-cb6cbc229f28 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:24.436150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a3d6905-348d-4dfd-be75-cb6cbc229f28 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:24.436606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a3d6905-348d-4dfd-be75-cb6cbc229f28 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:24.437035 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a3d6905-348d-4dfd-be75-cb6cbc229f28 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:24.565571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9a3d6905-348d-4dfd-be75-cb6cbc229f28 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:24.573657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9a3d6905-348d-4dfd-be75-cb6cbc229f28 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149860 Oct 28 20:22:24.574222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1165/2346] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:24 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:24.762021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-45f9300a-bc23-49c8-878e-98d87a9cfff0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:24.762657 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-45f9300a-bc23-49c8-878e-98d87a9cfff0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:24.769449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45f9300a-bc23-49c8-878e-98d87a9cfff0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:24.769932 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45f9300a-bc23-49c8-878e-98d87a9cfff0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:24.770361 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45f9300a-bc23-49c8-878e-98d87a9cfff0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:24.771036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45f9300a-bc23-49c8-878e-98d87a9cfff0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:24.771480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45f9300a-bc23-49c8-878e-98d87a9cfff0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:24.772198 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45f9300a-bc23-49c8-878e-98d87a9cfff0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:24.900984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-45f9300a-bc23-49c8-878e-98d87a9cfff0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:24.909772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-45f9300a-bc23-49c8-878e-98d87a9cfff0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.152174 Oct 28 20:22:24.910335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1182/2347] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:24 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:25.597049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b909556a-5746-4ec5-9ab9-54d59a28635f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:25.597713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b909556a-5746-4ec5-9ab9-54d59a28635f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:25.604083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b909556a-5746-4ec5-9ab9-54d59a28635f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:25.604564 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b909556a-5746-4ec5-9ab9-54d59a28635f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:25.605001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b909556a-5746-4ec5-9ab9-54d59a28635f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:25.605723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b909556a-5746-4ec5-9ab9-54d59a28635f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:25.606178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b909556a-5746-4ec5-9ab9-54d59a28635f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:25.606608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b909556a-5746-4ec5-9ab9-54d59a28635f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:25.735887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b909556a-5746-4ec5-9ab9-54d59a28635f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:25.744591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b909556a-5746-4ec5-9ab9-54d59a28635f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151662 Oct 28 20:22:25.745140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1166/2348] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:25 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:25.931727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ca4bcca9-d764-4b35-8ebc-b570a03872cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:25.932331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ca4bcca9-d764-4b35-8ebc-b570a03872cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:25.938761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca4bcca9-d764-4b35-8ebc-b570a03872cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:25.939180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca4bcca9-d764-4b35-8ebc-b570a03872cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:25.939825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca4bcca9-d764-4b35-8ebc-b570a03872cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:25.940526 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca4bcca9-d764-4b35-8ebc-b570a03872cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:25.940973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca4bcca9-d764-4b35-8ebc-b570a03872cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:25.941423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca4bcca9-d764-4b35-8ebc-b570a03872cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:26.070046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ca4bcca9-d764-4b35-8ebc-b570a03872cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:26.078296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ca4bcca9-d764-4b35-8ebc-b570a03872cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.150345 Oct 28 20:22:26.078863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1183/2349] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:25 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:26.768371 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5bcf2620-2bfb-4619-9435-320526abbb94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:26.769029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5bcf2620-2bfb-4619-9435-320526abbb94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:26.775465 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bcf2620-2bfb-4619-9435-320526abbb94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:26.775942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bcf2620-2bfb-4619-9435-320526abbb94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:26.776374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bcf2620-2bfb-4619-9435-320526abbb94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:26.777048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bcf2620-2bfb-4619-9435-320526abbb94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:26.777522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bcf2620-2bfb-4619-9435-320526abbb94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:26.777942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bcf2620-2bfb-4619-9435-320526abbb94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:26.908643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5bcf2620-2bfb-4619-9435-320526abbb94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:26.917224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5bcf2620-2bfb-4619-9435-320526abbb94 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.153409 Oct 28 20:22:26.917868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1167/2350] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:26 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:27.101564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-256dd82b-092a-43a0-ac35-ad634cea01fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:27.102227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-256dd82b-092a-43a0-ac35-ad634cea01fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:27.108541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-256dd82b-092a-43a0-ac35-ad634cea01fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:27.109043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-256dd82b-092a-43a0-ac35-ad634cea01fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:27.109515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-256dd82b-092a-43a0-ac35-ad634cea01fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:27.110195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-256dd82b-092a-43a0-ac35-ad634cea01fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:27.110643 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-256dd82b-092a-43a0-ac35-ad634cea01fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:27.111062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-256dd82b-092a-43a0-ac35-ad634cea01fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:27.243214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-256dd82b-092a-43a0-ac35-ad634cea01fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:27.251733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-256dd82b-092a-43a0-ac35-ad634cea01fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.154032 Oct 28 20:22:27.252653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1184/2351] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:27 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:27.939708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-189323bc-3a9c-45db-a8c0-08fbf3b95bf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:27.940325 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-189323bc-3a9c-45db-a8c0-08fbf3b95bf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:27.946697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-189323bc-3a9c-45db-a8c0-08fbf3b95bf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:27.947177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-189323bc-3a9c-45db-a8c0-08fbf3b95bf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:27.947610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-189323bc-3a9c-45db-a8c0-08fbf3b95bf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:27.948291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-189323bc-3a9c-45db-a8c0-08fbf3b95bf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:27.948773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-189323bc-3a9c-45db-a8c0-08fbf3b95bf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:27.949374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-189323bc-3a9c-45db-a8c0-08fbf3b95bf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:28.083033 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-189323bc-3a9c-45db-a8c0-08fbf3b95bf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:28.091599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-189323bc-3a9c-45db-a8c0-08fbf3b95bf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.155692 Oct 28 20:22:28.092263 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1168/2352] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:27 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:28.275737 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d478bd1d-a04e-43f0-83a9-5aba64e546e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:28.276372 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d478bd1d-a04e-43f0-83a9-5aba64e546e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:28.282695 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d478bd1d-a04e-43f0-83a9-5aba64e546e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:28.283237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d478bd1d-a04e-43f0-83a9-5aba64e546e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:28.283707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d478bd1d-a04e-43f0-83a9-5aba64e546e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:28.284453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d478bd1d-a04e-43f0-83a9-5aba64e546e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:28.284899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d478bd1d-a04e-43f0-83a9-5aba64e546e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:28.285340 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d478bd1d-a04e-43f0-83a9-5aba64e546e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:28.415811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d478bd1d-a04e-43f0-83a9-5aba64e546e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:28.423879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d478bd1d-a04e-43f0-83a9-5aba64e546e2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.151824 Oct 28 20:22:28.424436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1185/2353] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:28 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:29.116982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-25596af1-fbd3-4437-9afb-bc841cc770ff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:29.117648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-25596af1-fbd3-4437-9afb-bc841cc770ff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:29.123980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25596af1-fbd3-4437-9afb-bc841cc770ff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:29.124460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25596af1-fbd3-4437-9afb-bc841cc770ff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:29.124896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25596af1-fbd3-4437-9afb-bc841cc770ff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:29.125620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25596af1-fbd3-4437-9afb-bc841cc770ff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:29.126072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25596af1-fbd3-4437-9afb-bc841cc770ff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:29.126497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25596af1-fbd3-4437-9afb-bc841cc770ff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:29.255449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-25596af1-fbd3-4437-9afb-bc841cc770ff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:29.263586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-25596af1-fbd3-4437-9afb-bc841cc770ff tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151338 Oct 28 20:22:29.264148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1169/2354] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:29 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:29.446747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cb056755-b44b-4539-9478-554c2c77747e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:29.447370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cb056755-b44b-4539-9478-554c2c77747e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:29.453808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb056755-b44b-4539-9478-554c2c77747e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:29.454292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb056755-b44b-4539-9478-554c2c77747e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:29.454725 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb056755-b44b-4539-9478-554c2c77747e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:29.455409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb056755-b44b-4539-9478-554c2c77747e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:29.456373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb056755-b44b-4539-9478-554c2c77747e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:29.456988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb056755-b44b-4539-9478-554c2c77747e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:29.582282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cb056755-b44b-4539-9478-554c2c77747e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:29.590605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cb056755-b44b-4539-9478-554c2c77747e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.147700 Oct 28 20:22:29.591178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1186/2355] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:29 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:30.288605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9970bb30-4da2-420a-9041-6b5c08ad946c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:30.289400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9970bb30-4da2-420a-9041-6b5c08ad946c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:30.295624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9970bb30-4da2-420a-9041-6b5c08ad946c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:30.296112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9970bb30-4da2-420a-9041-6b5c08ad946c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:30.296552 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9970bb30-4da2-420a-9041-6b5c08ad946c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:30.297247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9970bb30-4da2-420a-9041-6b5c08ad946c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:30.297739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9970bb30-4da2-420a-9041-6b5c08ad946c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:30.298166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9970bb30-4da2-420a-9041-6b5c08ad946c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:30.615922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e51e7bf4-3863-4f79-aa18-7fa269d4ba23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:30.616584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e51e7bf4-3863-4f79-aa18-7fa269d4ba23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:30.623185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e51e7bf4-3863-4f79-aa18-7fa269d4ba23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:30.623686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e51e7bf4-3863-4f79-aa18-7fa269d4ba23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:30.624120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e51e7bf4-3863-4f79-aa18-7fa269d4ba23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:30.624802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e51e7bf4-3863-4f79-aa18-7fa269d4ba23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:30.625278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e51e7bf4-3863-4f79-aa18-7fa269d4ba23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:30.625726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e51e7bf4-3863-4f79-aa18-7fa269d4ba23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:30.642201 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:30.708181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9970bb30-4da2-420a-9041-6b5c08ad946c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:30.716648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9970bb30-4da2-420a-9041-6b5c08ad946c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.433002 Oct 28 20:22:30.717216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1170/2356] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:30 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:30.769105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e51e7bf4-3863-4f79-aa18-7fa269d4ba23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:30.777257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e51e7bf4-3863-4f79-aa18-7fa269d4ba23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.165746 Oct 28 20:22:30.777842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1187/2357] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:30 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:31.740900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-75bc2398-76bd-4a7d-b45d-ad6c1c223f84 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:31.741575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-75bc2398-76bd-4a7d-b45d-ad6c1c223f84 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:31.748164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75bc2398-76bd-4a7d-b45d-ad6c1c223f84 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:31.748642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75bc2398-76bd-4a7d-b45d-ad6c1c223f84 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:31.749072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75bc2398-76bd-4a7d-b45d-ad6c1c223f84 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:31.749812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75bc2398-76bd-4a7d-b45d-ad6c1c223f84 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:31.750260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75bc2398-76bd-4a7d-b45d-ad6c1c223f84 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:31.753800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75bc2398-76bd-4a7d-b45d-ad6c1c223f84 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:31.800563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-20b56aee-3e6a-4497-bed6-0bbf667c4eae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:31.801189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-20b56aee-3e6a-4497-bed6-0bbf667c4eae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:31.808108 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20b56aee-3e6a-4497-bed6-0bbf667c4eae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:31.808580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20b56aee-3e6a-4497-bed6-0bbf667c4eae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:31.809011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20b56aee-3e6a-4497-bed6-0bbf667c4eae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:31.809730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20b56aee-3e6a-4497-bed6-0bbf667c4eae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:31.810177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20b56aee-3e6a-4497-bed6-0bbf667c4eae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:31.810598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20b56aee-3e6a-4497-bed6-0bbf667c4eae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:31.921309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-75bc2398-76bd-4a7d-b45d-ad6c1c223f84 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:31.930210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-75bc2398-76bd-4a7d-b45d-ad6c1c223f84 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.194007 Oct 28 20:22:31.930787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1171/2358] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:31 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:31.965505 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-20b56aee-3e6a-4497-bed6-0bbf667c4eae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:31.974488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-20b56aee-3e6a-4497-bed6-0bbf667c4eae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.178363 Oct 28 20:22:31.974989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1188/2359] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:31 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:32.953640 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bdc3d2d0-c10a-4e9d-bdc8-02ad2efe704d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:32.954250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bdc3d2d0-c10a-4e9d-bdc8-02ad2efe704d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:32.960568 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdc3d2d0-c10a-4e9d-bdc8-02ad2efe704d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:32.961042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdc3d2d0-c10a-4e9d-bdc8-02ad2efe704d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:32.961512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdc3d2d0-c10a-4e9d-bdc8-02ad2efe704d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:32.962190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdc3d2d0-c10a-4e9d-bdc8-02ad2efe704d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:32.962637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdc3d2d0-c10a-4e9d-bdc8-02ad2efe704d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:32.963056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdc3d2d0-c10a-4e9d-bdc8-02ad2efe704d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:32.983320 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:32.997672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0a8d2051-f1dc-4900-b5d1-bbdeb9102688 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:32.998321 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0a8d2051-f1dc-4900-b5d1-bbdeb9102688 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:33.005590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a8d2051-f1dc-4900-b5d1-bbdeb9102688 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:33.006080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a8d2051-f1dc-4900-b5d1-bbdeb9102688 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:33.006520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a8d2051-f1dc-4900-b5d1-bbdeb9102688 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:33.007217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a8d2051-f1dc-4900-b5d1-bbdeb9102688 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:33.007670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a8d2051-f1dc-4900-b5d1-bbdeb9102688 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:33.008099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a8d2051-f1dc-4900-b5d1-bbdeb9102688 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:33.146868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bdc3d2d0-c10a-4e9d-bdc8-02ad2efe704d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:33.154919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bdc3d2d0-c10a-4e9d-bdc8-02ad2efe704d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.205091 Oct 28 20:22:33.155480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1172/2360] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:32 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:33.176123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0a8d2051-f1dc-4900-b5d1-bbdeb9102688 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:33.184067 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0a8d2051-f1dc-4900-b5d1-bbdeb9102688 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.190272 Oct 28 20:22:33.184624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1189/2361] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:32 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:34.178868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a18317d6-93df-4c65-b941-70f958face27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:34.179466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a18317d6-93df-4c65-b941-70f958face27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:34.186175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a18317d6-93df-4c65-b941-70f958face27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:34.186694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a18317d6-93df-4c65-b941-70f958face27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:34.188198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a18317d6-93df-4c65-b941-70f958face27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:34.188968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a18317d6-93df-4c65-b941-70f958face27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:34.189455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a18317d6-93df-4c65-b941-70f958face27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:34.190385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a18317d6-93df-4c65-b941-70f958face27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:34.211100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6c2b81b0-e42d-47da-9abe-4ab343164667 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:34.211799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6c2b81b0-e42d-47da-9abe-4ab343164667 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:34.218573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c2b81b0-e42d-47da-9abe-4ab343164667 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:34.219055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c2b81b0-e42d-47da-9abe-4ab343164667 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:34.219520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c2b81b0-e42d-47da-9abe-4ab343164667 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:34.220211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c2b81b0-e42d-47da-9abe-4ab343164667 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:34.220663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c2b81b0-e42d-47da-9abe-4ab343164667 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:34.221213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c2b81b0-e42d-47da-9abe-4ab343164667 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:34.399230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a18317d6-93df-4c65-b941-70f958face27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:34.407362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a18317d6-93df-4c65-b941-70f958face27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.232353 Oct 28 20:22:34.407923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1173/2362] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:34 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:34.421622 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6c2b81b0-e42d-47da-9abe-4ab343164667 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:34.429922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6c2b81b0-e42d-47da-9abe-4ab343164667 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.222933 Oct 28 20:22:34.430483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1190/2363] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:34 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:35.430752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-967f5316-7c88-4f5e-ab67-8f3ee44cf894 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:35.431376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-967f5316-7c88-4f5e-ab67-8f3ee44cf894 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:35.437798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-967f5316-7c88-4f5e-ab67-8f3ee44cf894 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:35.438281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-967f5316-7c88-4f5e-ab67-8f3ee44cf894 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:35.438723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-967f5316-7c88-4f5e-ab67-8f3ee44cf894 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:35.439409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-967f5316-7c88-4f5e-ab67-8f3ee44cf894 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:35.439871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-967f5316-7c88-4f5e-ab67-8f3ee44cf894 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:35.440595 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-967f5316-7c88-4f5e-ab67-8f3ee44cf894 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:35.458325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c27ff30e-bd99-48d2-8f3b-8a698a4ce689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:35.459470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c27ff30e-bd99-48d2-8f3b-8a698a4ce689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:35.468068 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c27ff30e-bd99-48d2-8f3b-8a698a4ce689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:35.468683 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c27ff30e-bd99-48d2-8f3b-8a698a4ce689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:35.469125 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c27ff30e-bd99-48d2-8f3b-8a698a4ce689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:35.469852 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c27ff30e-bd99-48d2-8f3b-8a698a4ce689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:35.470311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c27ff30e-bd99-48d2-8f3b-8a698a4ce689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:35.470739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c27ff30e-bd99-48d2-8f3b-8a698a4ce689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:35.640558 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-967f5316-7c88-4f5e-ab67-8f3ee44cf894 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:35.649651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-967f5316-7c88-4f5e-ab67-8f3ee44cf894 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.222727 Oct 28 20:22:35.650658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1174/2364] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:35 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:35.663791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c27ff30e-bd99-48d2-8f3b-8a698a4ce689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:35.671971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c27ff30e-bd99-48d2-8f3b-8a698a4ce689 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.221722 Oct 28 20:22:35.672520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1191/2365] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:35 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:36.673355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c6a2d281-1550-4d7d-af18-0e75175d9687 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:36.673976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c6a2d281-1550-4d7d-af18-0e75175d9687 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:36.680704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6a2d281-1550-4d7d-af18-0e75175d9687 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:36.681192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6a2d281-1550-4d7d-af18-0e75175d9687 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:36.681657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6a2d281-1550-4d7d-af18-0e75175d9687 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:36.682356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6a2d281-1550-4d7d-af18-0e75175d9687 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:36.682812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6a2d281-1550-4d7d-af18-0e75175d9687 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:36.683233 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6a2d281-1550-4d7d-af18-0e75175d9687 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:36.696914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6c273f26-b923-4183-ac47-fc625eec7929 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:36.698082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6c273f26-b923-4183-ac47-fc625eec7929 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:36.709958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c273f26-b923-4183-ac47-fc625eec7929 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:36.709958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c273f26-b923-4183-ac47-fc625eec7929 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:36.709958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c273f26-b923-4183-ac47-fc625eec7929 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:36.709958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c273f26-b923-4183-ac47-fc625eec7929 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:36.710306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c273f26-b923-4183-ac47-fc625eec7929 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:36.710306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c273f26-b923-4183-ac47-fc625eec7929 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:36.884145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c6a2d281-1550-4d7d-af18-0e75175d9687 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:36.887468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6c273f26-b923-4183-ac47-fc625eec7929 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:36.892333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c6a2d281-1550-4d7d-af18-0e75175d9687 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.222827 Oct 28 20:22:36.893061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1175/2366] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:36 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:36.896372 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6c273f26-b923-4183-ac47-fc625eec7929 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.203612 Oct 28 20:22:36.896934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1192/2367] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:36 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:37.915574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-82af392c-1f8f-407a-8e7d-3b4a4ff296f1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:37.916190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-82af392c-1f8f-407a-8e7d-3b4a4ff296f1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:37.918497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:37.919665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-887a1062-a9ef-4a6a-bda6-d20ac3881e0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:37.920290 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-887a1062-a9ef-4a6a-bda6-d20ac3881e0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:37.923189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82af392c-1f8f-407a-8e7d-3b4a4ff296f1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:37.923674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82af392c-1f8f-407a-8e7d-3b4a4ff296f1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:37.924157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82af392c-1f8f-407a-8e7d-3b4a4ff296f1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:37.924826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82af392c-1f8f-407a-8e7d-3b4a4ff296f1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:37.925301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82af392c-1f8f-407a-8e7d-3b4a4ff296f1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:37.925750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82af392c-1f8f-407a-8e7d-3b4a4ff296f1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:37.926684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-887a1062-a9ef-4a6a-bda6-d20ac3881e0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:37.927156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-887a1062-a9ef-4a6a-bda6-d20ac3881e0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:37.927588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-887a1062-a9ef-4a6a-bda6-d20ac3881e0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:37.928265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-887a1062-a9ef-4a6a-bda6-d20ac3881e0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:37.928706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-887a1062-a9ef-4a6a-bda6-d20ac3881e0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:37.929121 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-887a1062-a9ef-4a6a-bda6-d20ac3881e0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:38.123716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-82af392c-1f8f-407a-8e7d-3b4a4ff296f1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:38.126690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-887a1062-a9ef-4a6a-bda6-d20ac3881e0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:38.132913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-82af392c-1f8f-407a-8e7d-3b4a4ff296f1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.221112 Oct 28 20:22:38.133577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1176/2368] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:37 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:38.135703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-887a1062-a9ef-4a6a-bda6-d20ac3881e0e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.219911 Oct 28 20:22:38.136278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1193/2369] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:37 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:39.156972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ea44d7dd-9f54-45e4-b9e3-5b368faa1f7c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:39.157640 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ea44d7dd-9f54-45e4-b9e3-5b368faa1f7c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:39.159949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-95202ceb-2a7c-4a49-a02e-e2120df074c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:39.160618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-95202ceb-2a7c-4a49-a02e-e2120df074c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:39.164852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea44d7dd-9f54-45e4-b9e3-5b368faa1f7c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:39.165366 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea44d7dd-9f54-45e4-b9e3-5b368faa1f7c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:39.165808 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea44d7dd-9f54-45e4-b9e3-5b368faa1f7c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:39.166508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea44d7dd-9f54-45e4-b9e3-5b368faa1f7c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:39.166964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea44d7dd-9f54-45e4-b9e3-5b368faa1f7c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:39.167084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95202ceb-2a7c-4a49-a02e-e2120df074c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:39.167393 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea44d7dd-9f54-45e4-b9e3-5b368faa1f7c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:39.167512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95202ceb-2a7c-4a49-a02e-e2120df074c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:39.167880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95202ceb-2a7c-4a49-a02e-e2120df074c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:39.168564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95202ceb-2a7c-4a49-a02e-e2120df074c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:39.169013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95202ceb-2a7c-4a49-a02e-e2120df074c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:39.169459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95202ceb-2a7c-4a49-a02e-e2120df074c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:39.365277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ea44d7dd-9f54-45e4-b9e3-5b368faa1f7c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:39.369576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-95202ceb-2a7c-4a49-a02e-e2120df074c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:39.373428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ea44d7dd-9f54-45e4-b9e3-5b368faa1f7c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.220484 Oct 28 20:22:39.374023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1177/2370] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:39 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:39.378446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-95202ceb-2a7c-4a49-a02e-e2120df074c1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.222389 Oct 28 20:22:39.379407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1194/2371] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:39 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:40.397998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e1d7e669-5c4e-4241-bced-cd7bf40a4786 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:40.398610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e1d7e669-5c4e-4241-bced-cd7bf40a4786 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:40.402330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ae48a379-d325-4b0e-b127-c5cc4d123d51 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:40.402952 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ae48a379-d325-4b0e-b127-c5cc4d123d51 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:40.405036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d7e669-5c4e-4241-bced-cd7bf40a4786 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:40.405338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:40.405552 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d7e669-5c4e-4241-bced-cd7bf40a4786 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:40.406377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d7e669-5c4e-4241-bced-cd7bf40a4786 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:40.407064 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d7e669-5c4e-4241-bced-cd7bf40a4786 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:40.407515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d7e669-5c4e-4241-bced-cd7bf40a4786 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:40.407934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d7e669-5c4e-4241-bced-cd7bf40a4786 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:40.410595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae48a379-d325-4b0e-b127-c5cc4d123d51 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:40.411076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae48a379-d325-4b0e-b127-c5cc4d123d51 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:40.411515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae48a379-d325-4b0e-b127-c5cc4d123d51 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:40.412213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae48a379-d325-4b0e-b127-c5cc4d123d51 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:40.412663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae48a379-d325-4b0e-b127-c5cc4d123d51 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:40.413084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae48a379-d325-4b0e-b127-c5cc4d123d51 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:40.608353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e1d7e669-5c4e-4241-bced-cd7bf40a4786 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:40.612334 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ae48a379-d325-4b0e-b127-c5cc4d123d51 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:40.619443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e1d7e669-5c4e-4241-bced-cd7bf40a4786 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.225560 Oct 28 20:22:40.620250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1178/2372] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:40 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:40.622398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ae48a379-d325-4b0e-b127-c5cc4d123d51 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.223878 Oct 28 20:22:40.625520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1195/2373] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:40 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:41.643639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-446c1f21-727d-4b44-83bd-8209d22b438a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:41.644401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-446c1f21-727d-4b44-83bd-8209d22b438a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:41.646349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-949b702d-0ebd-4bd4-9b07-7e5890da8fc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:41.647019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-949b702d-0ebd-4bd4-9b07-7e5890da8fc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:41.650910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-446c1f21-727d-4b44-83bd-8209d22b438a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:41.651399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-446c1f21-727d-4b44-83bd-8209d22b438a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:41.651834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-446c1f21-727d-4b44-83bd-8209d22b438a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:41.652527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-446c1f21-727d-4b44-83bd-8209d22b438a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:41.652983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-446c1f21-727d-4b44-83bd-8209d22b438a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:41.653364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-949b702d-0ebd-4bd4-9b07-7e5890da8fc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:41.653480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-446c1f21-727d-4b44-83bd-8209d22b438a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:41.653848 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-949b702d-0ebd-4bd4-9b07-7e5890da8fc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:41.654283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-949b702d-0ebd-4bd4-9b07-7e5890da8fc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:41.654963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-949b702d-0ebd-4bd4-9b07-7e5890da8fc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:41.655414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-949b702d-0ebd-4bd4-9b07-7e5890da8fc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:41.655836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-949b702d-0ebd-4bd4-9b07-7e5890da8fc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:41.855736 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-446c1f21-727d-4b44-83bd-8209d22b438a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:41.859748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-949b702d-0ebd-4bd4-9b07-7e5890da8fc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:41.864139 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-446c1f21-727d-4b44-83bd-8209d22b438a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.224462 Oct 28 20:22:41.864711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1179/2374] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:41 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:41.868494 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-949b702d-0ebd-4bd4-9b07-7e5890da8fc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.225984 Oct 28 20:22:41.869145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1196/2375] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:41 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:42.888072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d897857b-cceb-4db3-86f0-2d01afa68a85 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:42.888676 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d897857b-cceb-4db3-86f0-2d01afa68a85 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:42.892328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3cc29687-adc8-4503-b8af-a57be61d9915 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:42.892953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3cc29687-adc8-4503-b8af-a57be61d9915 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:42.895220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d897857b-cceb-4db3-86f0-2d01afa68a85 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:42.895696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d897857b-cceb-4db3-86f0-2d01afa68a85 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:42.896315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d897857b-cceb-4db3-86f0-2d01afa68a85 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:42.896806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d897857b-cceb-4db3-86f0-2d01afa68a85 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:42.897250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d897857b-cceb-4db3-86f0-2d01afa68a85 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:42.897702 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d897857b-cceb-4db3-86f0-2d01afa68a85 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:42.899309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cc29687-adc8-4503-b8af-a57be61d9915 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:42.899787 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cc29687-adc8-4503-b8af-a57be61d9915 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:42.900227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cc29687-adc8-4503-b8af-a57be61d9915 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:42.900912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cc29687-adc8-4503-b8af-a57be61d9915 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:42.901388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cc29687-adc8-4503-b8af-a57be61d9915 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:42.901814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cc29687-adc8-4503-b8af-a57be61d9915 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:43.095725 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d897857b-cceb-4db3-86f0-2d01afa68a85 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:43.103986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3cc29687-adc8-4503-b8af-a57be61d9915 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:43.107264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d897857b-cceb-4db3-86f0-2d01afa68a85 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.223017 Oct 28 20:22:43.108194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1180/2376] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:42 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:43.112951 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3cc29687-adc8-4503-b8af-a57be61d9915 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.223831 Oct 28 20:22:43.122239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1197/2377] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:42 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:44.143762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a83e67a-dfda-4639-9812-8a43c2e6ef93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:44.144381 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6a83e67a-dfda-4639-9812-8a43c2e6ef93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:44.144616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a53416b0-eb7b-4c58-8a9b-258f7269576a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:44.145227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a53416b0-eb7b-4c58-8a9b-258f7269576a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:44.150889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a83e67a-dfda-4639-9812-8a43c2e6ef93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:44.151365 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a83e67a-dfda-4639-9812-8a43c2e6ef93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:44.151482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a53416b0-eb7b-4c58-8a9b-258f7269576a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:44.151794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a83e67a-dfda-4639-9812-8a43c2e6ef93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:44.151921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a53416b0-eb7b-4c58-8a9b-258f7269576a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:44.152293 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a53416b0-eb7b-4c58-8a9b-258f7269576a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:44.152513 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a83e67a-dfda-4639-9812-8a43c2e6ef93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:44.152970 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a83e67a-dfda-4639-9812-8a43c2e6ef93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:44.153103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a53416b0-eb7b-4c58-8a9b-258f7269576a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:44.153419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a83e67a-dfda-4639-9812-8a43c2e6ef93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:44.153534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a53416b0-eb7b-4c58-8a9b-258f7269576a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:44.153854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a53416b0-eb7b-4c58-8a9b-258f7269576a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:44.349662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a83e67a-dfda-4639-9812-8a43c2e6ef93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:44.354050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a53416b0-eb7b-4c58-8a9b-258f7269576a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:44.357960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a83e67a-dfda-4639-9812-8a43c2e6ef93 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.217977 Oct 28 20:22:44.358528 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1181/2378] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:44 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:44.362293 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a53416b0-eb7b-4c58-8a9b-258f7269576a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.221695 Oct 28 20:22:44.362979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1198/2379] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:44 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:45.383048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0421e262-fba1-4ee7-b2f2-926e2ccd74b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:45.383873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0421e262-fba1-4ee7-b2f2-926e2ccd74b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:45.384950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fa30cdaa-05d7-4969-b4d2-9d03aec2026f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:45.385596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fa30cdaa-05d7-4969-b4d2-9d03aec2026f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:45.390231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0421e262-fba1-4ee7-b2f2-926e2ccd74b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:45.390726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0421e262-fba1-4ee7-b2f2-926e2ccd74b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:45.391165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0421e262-fba1-4ee7-b2f2-926e2ccd74b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:45.391855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0421e262-fba1-4ee7-b2f2-926e2ccd74b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:45.391968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa30cdaa-05d7-4969-b4d2-9d03aec2026f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:45.392311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0421e262-fba1-4ee7-b2f2-926e2ccd74b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:45.392429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa30cdaa-05d7-4969-b4d2-9d03aec2026f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:45.392736 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0421e262-fba1-4ee7-b2f2-926e2ccd74b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:45.392849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa30cdaa-05d7-4969-b4d2-9d03aec2026f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:45.393538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa30cdaa-05d7-4969-b4d2-9d03aec2026f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:45.394084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa30cdaa-05d7-4969-b4d2-9d03aec2026f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:45.394529 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa30cdaa-05d7-4969-b4d2-9d03aec2026f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:45.589052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0421e262-fba1-4ee7-b2f2-926e2ccd74b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:45.593334 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fa30cdaa-05d7-4969-b4d2-9d03aec2026f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:45.598028 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0421e262-fba1-4ee7-b2f2-926e2ccd74b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.219750 Oct 28 20:22:45.598592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1182/2380] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:45 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:45.602704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fa30cdaa-05d7-4969-b4d2-9d03aec2026f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.221445 Oct 28 20:22:45.603269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1199/2381] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:45 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:46.622066 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-09fd20d6-9637-484d-b77b-fe16b6e8c23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:46.622663 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-09fd20d6-9637-484d-b77b-fe16b6e8c23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:46.625566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a7948735-1431-4dd7-8757-a7a2148d81f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:46.626225 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a7948735-1431-4dd7-8757-a7a2148d81f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:46.629367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09fd20d6-9637-484d-b77b-fe16b6e8c23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:46.629845 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09fd20d6-9637-484d-b77b-fe16b6e8c23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:46.630282 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09fd20d6-9637-484d-b77b-fe16b6e8c23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:46.630966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09fd20d6-9637-484d-b77b-fe16b6e8c23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:46.631413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09fd20d6-9637-484d-b77b-fe16b6e8c23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:46.631830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09fd20d6-9637-484d-b77b-fe16b6e8c23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:46.632394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7948735-1431-4dd7-8757-a7a2148d81f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:46.632894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7948735-1431-4dd7-8757-a7a2148d81f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:46.633314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7948735-1431-4dd7-8757-a7a2148d81f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:46.634024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7948735-1431-4dd7-8757-a7a2148d81f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:46.634477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7948735-1431-4dd7-8757-a7a2148d81f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:46.634901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7948735-1431-4dd7-8757-a7a2148d81f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:46.825551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-09fd20d6-9637-484d-b77b-fe16b6e8c23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:46.828462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a7948735-1431-4dd7-8757-a7a2148d81f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:46.835222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-09fd20d6-9637-484d-b77b-fe16b6e8c23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.217039 Oct 28 20:22:46.835802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1183/2382] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:46 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:46.837072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a7948735-1431-4dd7-8757-a7a2148d81f4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.215306 Oct 28 20:22:46.837687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1200/2383] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:46 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:47.859822 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2ca624cb-1cb9-437e-95e7-2d68fe1b742e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:47.860437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2ca624cb-1cb9-437e-95e7-2d68fe1b742e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:47.860929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-62cfbe44-0c1e-461f-bd47-41594b57d508 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:47.861597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-62cfbe44-0c1e-461f-bd47-41594b57d508 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:47.867582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ca624cb-1cb9-437e-95e7-2d68fe1b742e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:47.868067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ca624cb-1cb9-437e-95e7-2d68fe1b742e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:47.868445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62cfbe44-0c1e-461f-bd47-41594b57d508 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:47.868578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ca624cb-1cb9-437e-95e7-2d68fe1b742e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:47.868929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62cfbe44-0c1e-461f-bd47-41594b57d508 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:47.869180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ca624cb-1cb9-437e-95e7-2d68fe1b742e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:47.869386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62cfbe44-0c1e-461f-bd47-41594b57d508 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:47.869664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ca624cb-1cb9-437e-95e7-2d68fe1b742e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:47.870073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62cfbe44-0c1e-461f-bd47-41594b57d508 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:47.870181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ca624cb-1cb9-437e-95e7-2d68fe1b742e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:47.870524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62cfbe44-0c1e-461f-bd47-41594b57d508 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:47.870943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62cfbe44-0c1e-461f-bd47-41594b57d508 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:48.065892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2ca624cb-1cb9-437e-95e7-2d68fe1b742e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:48.069609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-62cfbe44-0c1e-461f-bd47-41594b57d508 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:48.074222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2ca624cb-1cb9-437e-95e7-2d68fe1b742e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.218340 Oct 28 20:22:48.077363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1184/2384] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:47 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:48.078314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-62cfbe44-0c1e-461f-bd47-41594b57d508 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.221149 Oct 28 20:22:48.078872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1201/2385] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:47 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:49.101165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6fc7baab-2a81-4194-92c3-a4f02450d039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:49.102112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6fc7baab-2a81-4194-92c3-a4f02450d039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:49.102251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-70487a0f-1fbb-47b6-a477-8db4fcd5e04c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:49.102791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-70487a0f-1fbb-47b6-a477-8db4fcd5e04c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:49.109309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fc7baab-2a81-4194-92c3-a4f02450d039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:49.109503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70487a0f-1fbb-47b6-a477-8db4fcd5e04c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:49.109841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fc7baab-2a81-4194-92c3-a4f02450d039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:49.109974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70487a0f-1fbb-47b6-a477-8db4fcd5e04c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:49.110278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fc7baab-2a81-4194-92c3-a4f02450d039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:49.110408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70487a0f-1fbb-47b6-a477-8db4fcd5e04c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:49.110971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fc7baab-2a81-4194-92c3-a4f02450d039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:49.111088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70487a0f-1fbb-47b6-a477-8db4fcd5e04c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:49.111426 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fc7baab-2a81-4194-92c3-a4f02450d039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:49.111549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70487a0f-1fbb-47b6-a477-8db4fcd5e04c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:49.111850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fc7baab-2a81-4194-92c3-a4f02450d039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:49.111983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70487a0f-1fbb-47b6-a477-8db4fcd5e04c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:49.299394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-70487a0f-1fbb-47b6-a477-8db4fcd5e04c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:49.307729 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-70487a0f-1fbb-47b6-a477-8db4fcd5e04c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.209290 Oct 28 20:22:49.312057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1202/2386] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:49 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:49.312364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6fc7baab-2a81-4194-92c3-a4f02450d039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:49.320421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6fc7baab-2a81-4194-92c3-a4f02450d039 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.226064 Oct 28 20:22:49.320979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1185/2387] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:49 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:50.331091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a8821bf8-524f-4ed1-b7d8-767e10a32592 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:50.332127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a8821bf8-524f-4ed1-b7d8-767e10a32592 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:50.338630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8821bf8-524f-4ed1-b7d8-767e10a32592 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:50.339119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8821bf8-524f-4ed1-b7d8-767e10a32592 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:50.339844 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8821bf8-524f-4ed1-b7d8-767e10a32592 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:50.340620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8821bf8-524f-4ed1-b7d8-767e10a32592 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:50.341083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8821bf8-524f-4ed1-b7d8-767e10a32592 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:50.341548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8821bf8-524f-4ed1-b7d8-767e10a32592 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:50.345139 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fb4fba2f-af99-4e10-a619-aa3683189063 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:50.345840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fb4fba2f-af99-4e10-a619-aa3683189063 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:50.352413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb4fba2f-af99-4e10-a619-aa3683189063 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:50.352894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb4fba2f-af99-4e10-a619-aa3683189063 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:50.353340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb4fba2f-af99-4e10-a619-aa3683189063 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:50.354020 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb4fba2f-af99-4e10-a619-aa3683189063 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:50.354466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb4fba2f-af99-4e10-a619-aa3683189063 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:50.354884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb4fba2f-af99-4e10-a619-aa3683189063 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:50.551239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a8821bf8-524f-4ed1-b7d8-767e10a32592 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:50.554342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fb4fba2f-af99-4e10-a619-aa3683189063 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:50.560474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a8821bf8-524f-4ed1-b7d8-767e10a32592 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.233242 Oct 28 20:22:50.561067 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1203/2388] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:50 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:50.562876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fb4fba2f-af99-4e10-a619-aa3683189063 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.221321 Oct 28 20:22:50.566729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1186/2389] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:50 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:51.586484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3fbd4bd9-7faa-456f-aa86-8cf23309e938 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:51.587093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3fbd4bd9-7faa-456f-aa86-8cf23309e938 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:51.587367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6e96ebe8-45b4-4f4d-bc87-97761a52c044 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:51.587985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6e96ebe8-45b4-4f4d-bc87-97761a52c044 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:51.594350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fbd4bd9-7faa-456f-aa86-8cf23309e938 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:51.594849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fbd4bd9-7faa-456f-aa86-8cf23309e938 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:51.595099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e96ebe8-45b4-4f4d-bc87-97761a52c044 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:51.595525 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fbd4bd9-7faa-456f-aa86-8cf23309e938 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:51.595639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e96ebe8-45b4-4f4d-bc87-97761a52c044 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:51.596020 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e96ebe8-45b4-4f4d-bc87-97761a52c044 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:51.596599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fbd4bd9-7faa-456f-aa86-8cf23309e938 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:51.596790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e96ebe8-45b4-4f4d-bc87-97761a52c044 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:51.597184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e96ebe8-45b4-4f4d-bc87-97761a52c044 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:51.597701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fbd4bd9-7faa-456f-aa86-8cf23309e938 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:51.597831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e96ebe8-45b4-4f4d-bc87-97761a52c044 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:51.598435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fbd4bd9-7faa-456f-aa86-8cf23309e938 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:51.604938 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:51.821923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6e96ebe8-45b4-4f4d-bc87-97761a52c044 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:51.828812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3fbd4bd9-7faa-456f-aa86-8cf23309e938 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:51.831057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6e96ebe8-45b4-4f4d-bc87-97761a52c044 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.247889 Oct 28 20:22:51.832552 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1187/2390] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:51 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:51.840213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3fbd4bd9-7faa-456f-aa86-8cf23309e938 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.256955 Oct 28 20:22:51.840213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1204/2391] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:51 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:52.856198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c6e7ae20-9aed-4258-9fd7-6c43fe89783a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:52.856820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c6e7ae20-9aed-4258-9fd7-6c43fe89783a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:52.862943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-68274855-7fa1-4361-bdef-be4618059811 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:52.863591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-68274855-7fa1-4361-bdef-be4618059811 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:52.863971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6e7ae20-9aed-4258-9fd7-6c43fe89783a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:52.864455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6e7ae20-9aed-4258-9fd7-6c43fe89783a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:52.864894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6e7ae20-9aed-4258-9fd7-6c43fe89783a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:52.865612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6e7ae20-9aed-4258-9fd7-6c43fe89783a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:52.866068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6e7ae20-9aed-4258-9fd7-6c43fe89783a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:52.866495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6e7ae20-9aed-4258-9fd7-6c43fe89783a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:52.870274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68274855-7fa1-4361-bdef-be4618059811 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:52.870755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68274855-7fa1-4361-bdef-be4618059811 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:52.871187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68274855-7fa1-4361-bdef-be4618059811 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:52.871869 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68274855-7fa1-4361-bdef-be4618059811 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:52.872322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68274855-7fa1-4361-bdef-be4618059811 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:52.872743 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68274855-7fa1-4361-bdef-be4618059811 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:53.062378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c6e7ae20-9aed-4258-9fd7-6c43fe89783a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:53.065220 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-68274855-7fa1-4361-bdef-be4618059811 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:53.070787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c6e7ae20-9aed-4258-9fd7-6c43fe89783a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.218579 Oct 28 20:22:53.071404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1188/2392] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:52 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:53.073541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-68274855-7fa1-4361-bdef-be4618059811 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.214881 Oct 28 20:22:53.074102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1205/2393] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:52 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:54.094144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bc409a22-d07c-4dc5-a133-7eaced0d8966 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:54.094756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bc409a22-d07c-4dc5-a133-7eaced0d8966 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:54.095946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-43e23c7c-51ce-4c90-a94a-b432a4906c32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:54.096567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-43e23c7c-51ce-4c90-a94a-b432a4906c32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:54.101696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc409a22-d07c-4dc5-a133-7eaced0d8966 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:54.102181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc409a22-d07c-4dc5-a133-7eaced0d8966 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:54.102612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc409a22-d07c-4dc5-a133-7eaced0d8966 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:54.103054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43e23c7c-51ce-4c90-a94a-b432a4906c32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:54.103290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc409a22-d07c-4dc5-a133-7eaced0d8966 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:54.103535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43e23c7c-51ce-4c90-a94a-b432a4906c32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:54.103738 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc409a22-d07c-4dc5-a133-7eaced0d8966 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:54.103973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43e23c7c-51ce-4c90-a94a-b432a4906c32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:54.104158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc409a22-d07c-4dc5-a133-7eaced0d8966 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:54.104661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43e23c7c-51ce-4c90-a94a-b432a4906c32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:54.105114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43e23c7c-51ce-4c90-a94a-b432a4906c32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:54.105569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43e23c7c-51ce-4c90-a94a-b432a4906c32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:54.108159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:54.299522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bc409a22-d07c-4dc5-a133-7eaced0d8966 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:54.304382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-43e23c7c-51ce-4c90-a94a-b432a4906c32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:54.308226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bc409a22-d07c-4dc5-a133-7eaced0d8966 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.217881 Oct 28 20:22:54.308806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1189/2394] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:54 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:54.312624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-43e23c7c-51ce-4c90-a94a-b432a4906c32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.220525 Oct 28 20:22:54.313177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1206/2395] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:54 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:55.332888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2f41778d-d000-45df-9cee-12bbc2683827 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:55.333459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2f41778d-d000-45df-9cee-12bbc2683827 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:55.336657 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d78b8540-ef71-4c04-8748-e8fd616524b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:55.337285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d78b8540-ef71-4c04-8748-e8fd616524b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:55.339296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f41778d-d000-45df-9cee-12bbc2683827 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:55.340039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f41778d-d000-45df-9cee-12bbc2683827 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:55.340470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f41778d-d000-45df-9cee-12bbc2683827 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:55.341149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f41778d-d000-45df-9cee-12bbc2683827 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:55.341618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f41778d-d000-45df-9cee-12bbc2683827 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:55.342041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f41778d-d000-45df-9cee-12bbc2683827 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:55.344000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d78b8540-ef71-4c04-8748-e8fd616524b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:55.344480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d78b8540-ef71-4c04-8748-e8fd616524b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:55.344919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d78b8540-ef71-4c04-8748-e8fd616524b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:55.345631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d78b8540-ef71-4c04-8748-e8fd616524b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:55.346091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d78b8540-ef71-4c04-8748-e8fd616524b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:55.346516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d78b8540-ef71-4c04-8748-e8fd616524b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:55.539653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d78b8540-ef71-4c04-8748-e8fd616524b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:55.543190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2f41778d-d000-45df-9cee-12bbc2683827 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:55.548271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d78b8540-ef71-4c04-8748-e8fd616524b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.215331 Oct 28 20:22:55.548932 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1207/2396] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:55 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:55.552258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2f41778d-d000-45df-9cee-12bbc2683827 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.224009 Oct 28 20:22:55.553210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1190/2397] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:55 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:56.575607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7d33ba25-b3fd-47f6-9100-b3b5a3f9b2c4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:56.576227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7d33ba25-b3fd-47f6-9100-b3b5a3f9b2c4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:56.578883 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e083cd1d-23ab-4b7e-8e3b-bd572096e23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:56.579562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e083cd1d-23ab-4b7e-8e3b-bd572096e23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:56.583491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d33ba25-b3fd-47f6-9100-b3b5a3f9b2c4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:56.583981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d33ba25-b3fd-47f6-9100-b3b5a3f9b2c4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:56.584536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d33ba25-b3fd-47f6-9100-b3b5a3f9b2c4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:56.585134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d33ba25-b3fd-47f6-9100-b3b5a3f9b2c4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:56.585611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d33ba25-b3fd-47f6-9100-b3b5a3f9b2c4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:56.585911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e083cd1d-23ab-4b7e-8e3b-bd572096e23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:56.586041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d33ba25-b3fd-47f6-9100-b3b5a3f9b2c4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:56.586391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e083cd1d-23ab-4b7e-8e3b-bd572096e23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:56.586821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e083cd1d-23ab-4b7e-8e3b-bd572096e23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:56.587494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e083cd1d-23ab-4b7e-8e3b-bd572096e23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:56.587942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e083cd1d-23ab-4b7e-8e3b-bd572096e23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:56.588360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e083cd1d-23ab-4b7e-8e3b-bd572096e23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:56.783943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e083cd1d-23ab-4b7e-8e3b-bd572096e23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:56.786544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7d33ba25-b3fd-47f6-9100-b3b5a3f9b2c4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:56.795046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7d33ba25-b3fd-47f6-9100-b3b5a3f9b2c4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.223214 Oct 28 20:22:56.799633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e083cd1d-23ab-4b7e-8e3b-bd572096e23e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.224574 Oct 28 20:22:56.800888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1191/2398] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:56 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:56.804271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1208/2399] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:56 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:57.819811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37705595-256f-44b8-8585-980dff4d28c3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:57.820434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-37705595-256f-44b8-8585-980dff4d28c3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:57.823988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a8908bc9-c1c2-42d4-a7c6-f95264d2e450 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:57.824827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a8908bc9-c1c2-42d4-a7c6-f95264d2e450 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:57.827168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37705595-256f-44b8-8585-980dff4d28c3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:57.827736 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37705595-256f-44b8-8585-980dff4d28c3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:57.828099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37705595-256f-44b8-8585-980dff4d28c3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:57.828793 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37705595-256f-44b8-8585-980dff4d28c3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:57.829468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37705595-256f-44b8-8585-980dff4d28c3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:57.829906 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37705595-256f-44b8-8585-980dff4d28c3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:57.831369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8908bc9-c1c2-42d4-a7c6-f95264d2e450 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:57.833433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8908bc9-c1c2-42d4-a7c6-f95264d2e450 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:57.833895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8908bc9-c1c2-42d4-a7c6-f95264d2e450 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:57.834609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8908bc9-c1c2-42d4-a7c6-f95264d2e450 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:57.835069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8908bc9-c1c2-42d4-a7c6-f95264d2e450 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:57.835490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8908bc9-c1c2-42d4-a7c6-f95264d2e450 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:58.033033 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-37705595-256f-44b8-8585-980dff4d28c3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:58.036640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a8908bc9-c1c2-42d4-a7c6-f95264d2e450 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:58.042176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-37705595-256f-44b8-8585-980dff4d28c3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.227012 Oct 28 20:22:58.042962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1192/2400] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:57 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:58.045100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a8908bc9-c1c2-42d4-a7c6-f95264d2e450 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.225098 Oct 28 20:22:58.045688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1209/2401] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:57 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:22:59.064967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-722f7513-dd12-4d01-abaa-338d47ae836a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:59.065613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-722f7513-dd12-4d01-abaa-338d47ae836a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:59.068252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-074faf6d-505a-4cab-85a2-2def8e584556 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:59.068870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-074faf6d-505a-4cab-85a2-2def8e584556 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:59.072129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-722f7513-dd12-4d01-abaa-338d47ae836a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:59.072696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-722f7513-dd12-4d01-abaa-338d47ae836a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:59.073141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-722f7513-dd12-4d01-abaa-338d47ae836a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:59.073858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-722f7513-dd12-4d01-abaa-338d47ae836a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:59.074317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-722f7513-dd12-4d01-abaa-338d47ae836a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:59.074749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-722f7513-dd12-4d01-abaa-338d47ae836a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:59.075147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-074faf6d-505a-4cab-85a2-2def8e584556 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:59.075637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-074faf6d-505a-4cab-85a2-2def8e584556 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:59.076079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-074faf6d-505a-4cab-85a2-2def8e584556 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:59.076814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-074faf6d-505a-4cab-85a2-2def8e584556 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:59.077275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-074faf6d-505a-4cab-85a2-2def8e584556 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:59.077729 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-074faf6d-505a-4cab-85a2-2def8e584556 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:59.274095 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-722f7513-dd12-4d01-abaa-338d47ae836a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:59.277593 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-074faf6d-505a-4cab-85a2-2def8e584556 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:59.282444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-722f7513-dd12-4d01-abaa-338d47ae836a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.221318 Oct 28 20:22:59.283017 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1193/2402] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:59 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:59.286734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-074faf6d-505a-4cab-85a2-2def8e584556 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.222813 Oct 28 20:22:59.287327 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1210/2403] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:59 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:00.307428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ea76fbd5-454f-42ba-bbd7-156270c2433c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:00.308004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ea76fbd5-454f-42ba-bbd7-156270c2433c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:00.317233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5e859729-5825-479e-85cb-7fafe52793fc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:00.318483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5e859729-5825-479e-85cb-7fafe52793fc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:00.320090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea76fbd5-454f-42ba-bbd7-156270c2433c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:00.320753 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea76fbd5-454f-42ba-bbd7-156270c2433c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:00.321277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea76fbd5-454f-42ba-bbd7-156270c2433c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:00.322250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea76fbd5-454f-42ba-bbd7-156270c2433c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:00.322900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea76fbd5-454f-42ba-bbd7-156270c2433c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:00.323502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea76fbd5-454f-42ba-bbd7-156270c2433c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:00.325118 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e859729-5825-479e-85cb-7fafe52793fc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:00.325619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e859729-5825-479e-85cb-7fafe52793fc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:00.326584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e859729-5825-479e-85cb-7fafe52793fc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:00.326979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e859729-5825-479e-85cb-7fafe52793fc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:00.327611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e859729-5825-479e-85cb-7fafe52793fc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:00.328037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e859729-5825-479e-85cb-7fafe52793fc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:00.529868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ea76fbd5-454f-42ba-bbd7-156270c2433c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:00.538071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5e859729-5825-479e-85cb-7fafe52793fc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:00.538696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ea76fbd5-454f-42ba-bbd7-156270c2433c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.235336 Oct 28 20:23:00.543470 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1194/2404] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:00 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:00.547921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5e859729-5825-479e-85cb-7fafe52793fc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1727 microversion: 2.1 time: 0.235007 Oct 28 20:23:00.549355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1211/2405] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:00 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1727 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:01.067831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-eec21381-af4d-4685-bb37-c847ecc2167e req-88437a32-aa26-4da4-aea6-5d031d2c005e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83fb8150-cbd4-4139-bb47-a0fd318f8b86", "name": "network-vif-deleted", "tag": "44d34977-72a3-481b-b7c3-7284888f0990"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:23:01.078155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-eec21381-af4d-4685-bb37-c847ecc2167e req-88437a32-aa26-4da4-aea6-5d031d2c005e service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:01.078635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-eec21381-af4d-4685-bb37-c847ecc2167e req-88437a32-aa26-4da4-aea6-5d031d2c005e service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:01.079061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-eec21381-af4d-4685-bb37-c847ecc2167e req-88437a32-aa26-4da4-aea6-5d031d2c005e service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:01.091417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-eec21381-af4d-4685-bb37-c847ecc2167e req-88437a32-aa26-4da4-aea6-5d031d2c005e service nova] Creating event network-vif-deleted:44d34977-72a3-481b-b7c3-7284888f0990 for instance 83fb8150-cbd4-4139-bb47-a0fd318f8b86 on hv-cinder-86236 Oct 28 20:23:01.097882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-eec21381-af4d-4685-bb37-c847ecc2167e req-88437a32-aa26-4da4-aea6-5d031d2c005e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034805 Oct 28 20:23:01.098485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1195/2406] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:23:01.562042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-698e04ce-9b77-4d94-b856-56797050fcaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:01.562650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-698e04ce-9b77-4d94-b856-56797050fcaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:01.569115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-698e04ce-9b77-4d94-b856-56797050fcaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:01.569831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-698e04ce-9b77-4d94-b856-56797050fcaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:01.570042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-698e04ce-9b77-4d94-b856-56797050fcaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:01.570723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-698e04ce-9b77-4d94-b856-56797050fcaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:01.571717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-698e04ce-9b77-4d94-b856-56797050fcaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:01.571717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-698e04ce-9b77-4d94-b856-56797050fcaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:01.573646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-65551f91-ee88-4e99-adf1-8c85614971ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:01.574465 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-65551f91-ee88-4e99-adf1-8c85614971ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:01.581818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65551f91-ee88-4e99-adf1-8c85614971ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:01.582471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65551f91-ee88-4e99-adf1-8c85614971ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:01.583014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65551f91-ee88-4e99-adf1-8c85614971ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:01.583889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65551f91-ee88-4e99-adf1-8c85614971ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:01.584447 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65551f91-ee88-4e99-adf1-8c85614971ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:01.584998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65551f91-ee88-4e99-adf1-8c85614971ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:01.664823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-65551f91-ee88-4e99-adf1-8c85614971ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:01.673621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-65551f91-ee88-4e99-adf1-8c85614971ca tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.105193 Oct 28 20:23:01.674209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1196/2407] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:01 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:01.735693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-698e04ce-9b77-4d94-b856-56797050fcaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:01.744359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-698e04ce-9b77-4d94-b856-56797050fcaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.186130 Oct 28 20:23:01.744972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1212/2408] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:01 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:02.696830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40e29eb4-c759-4dc5-97c8-656cb49877d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:02.697457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-40e29eb4-c759-4dc5-97c8-656cb49877d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:02.704251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e29eb4-c759-4dc5-97c8-656cb49877d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:02.704738 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e29eb4-c759-4dc5-97c8-656cb49877d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:02.705174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e29eb4-c759-4dc5-97c8-656cb49877d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:02.705892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e29eb4-c759-4dc5-97c8-656cb49877d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:02.706577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e29eb4-c759-4dc5-97c8-656cb49877d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:02.706903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e29eb4-c759-4dc5-97c8-656cb49877d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:02.767902 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-40e29eb4-c759-4dc5-97c8-656cb49877d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:02.769449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e038c980-80b9-4424-871f-569a9d10d9c9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:02.770128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e038c980-80b9-4424-871f-569a9d10d9c9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:02.776724 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-40e29eb4-c759-4dc5-97c8-656cb49877d2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083757 Oct 28 20:23:02.776884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e038c980-80b9-4424-871f-569a9d10d9c9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:02.777244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e038c980-80b9-4424-871f-569a9d10d9c9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:02.777424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1197/2409] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:02 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:02.780583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e038c980-80b9-4424-871f-569a9d10d9c9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:02.781411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e038c980-80b9-4424-871f-569a9d10d9c9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:02.781945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e038c980-80b9-4424-871f-569a9d10d9c9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:02.782442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e038c980-80b9-4424-871f-569a9d10d9c9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:02.910903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e038c980-80b9-4424-871f-569a9d10d9c9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:02.919003 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e038c980-80b9-4424-871f-569a9d10d9c9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.154629 Oct 28 20:23:02.919565 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1213/2410] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:02 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:03.800882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-59b4f689-03a4-4d28-9514-5afe34de51b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:03.801512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-59b4f689-03a4-4d28-9514-5afe34de51b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:03.807870 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59b4f689-03a4-4d28-9514-5afe34de51b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:03.808352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59b4f689-03a4-4d28-9514-5afe34de51b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:03.808789 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59b4f689-03a4-4d28-9514-5afe34de51b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:03.809515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59b4f689-03a4-4d28-9514-5afe34de51b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:03.809974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59b4f689-03a4-4d28-9514-5afe34de51b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:03.810395 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59b4f689-03a4-4d28-9514-5afe34de51b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:03.870543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-59b4f689-03a4-4d28-9514-5afe34de51b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:03.878644 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-59b4f689-03a4-4d28-9514-5afe34de51b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.081644 Oct 28 20:23:03.879204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1198/2411] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:03 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:03.941581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f6a3a7b8-80a9-4bea-877c-dc89ae532f87 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:03.942194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f6a3a7b8-80a9-4bea-877c-dc89ae532f87 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:03.948541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6a3a7b8-80a9-4bea-877c-dc89ae532f87 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:03.949021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6a3a7b8-80a9-4bea-877c-dc89ae532f87 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:03.949500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6a3a7b8-80a9-4bea-877c-dc89ae532f87 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:03.950187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6a3a7b8-80a9-4bea-877c-dc89ae532f87 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:03.950641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6a3a7b8-80a9-4bea-877c-dc89ae532f87 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:03.951066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6a3a7b8-80a9-4bea-877c-dc89ae532f87 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:04.080291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f6a3a7b8-80a9-4bea-877c-dc89ae532f87 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:04.088971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f6a3a7b8-80a9-4bea-877c-dc89ae532f87 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151228 Oct 28 20:23:04.089833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1214/2412] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:03 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:04.901844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-70725a68-910a-481d-ac7c-9b9b52a5330c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:04.902445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-70725a68-910a-481d-ac7c-9b9b52a5330c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:04.908792 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70725a68-910a-481d-ac7c-9b9b52a5330c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:04.909927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70725a68-910a-481d-ac7c-9b9b52a5330c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:04.910358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70725a68-910a-481d-ac7c-9b9b52a5330c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:04.911036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70725a68-910a-481d-ac7c-9b9b52a5330c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:04.911489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70725a68-910a-481d-ac7c-9b9b52a5330c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:04.911914 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70725a68-910a-481d-ac7c-9b9b52a5330c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:04.974121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-70725a68-910a-481d-ac7c-9b9b52a5330c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:04.982096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-70725a68-910a-481d-ac7c-9b9b52a5330c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084193 Oct 28 20:23:04.982659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1199/2413] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:04 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:05.112061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc9e2648-0d0a-49bd-9fd2-43700c0b2aae tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:05.113288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fc9e2648-0d0a-49bd-9fd2-43700c0b2aae tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:05.119561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc9e2648-0d0a-49bd-9fd2-43700c0b2aae tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:05.120042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc9e2648-0d0a-49bd-9fd2-43700c0b2aae tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:05.120480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc9e2648-0d0a-49bd-9fd2-43700c0b2aae tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:05.121161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc9e2648-0d0a-49bd-9fd2-43700c0b2aae tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:05.121640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc9e2648-0d0a-49bd-9fd2-43700c0b2aae tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:05.122064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc9e2648-0d0a-49bd-9fd2-43700c0b2aae tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:05.249886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fc9e2648-0d0a-49bd-9fd2-43700c0b2aae tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:05.258204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fc9e2648-0d0a-49bd-9fd2-43700c0b2aae tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150032 Oct 28 20:23:05.258873 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1215/2414] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:05 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:06.005670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-73233f31-65fd-4b80-831d-ac135c69cde5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:06.006277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-73233f31-65fd-4b80-831d-ac135c69cde5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:06.012869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73233f31-65fd-4b80-831d-ac135c69cde5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:06.013386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73233f31-65fd-4b80-831d-ac135c69cde5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:06.013830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73233f31-65fd-4b80-831d-ac135c69cde5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:06.014534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73233f31-65fd-4b80-831d-ac135c69cde5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:06.014993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73233f31-65fd-4b80-831d-ac135c69cde5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:06.015442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73233f31-65fd-4b80-831d-ac135c69cde5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:06.078861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-73233f31-65fd-4b80-831d-ac135c69cde5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:06.087466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-73233f31-65fd-4b80-831d-ac135c69cde5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085760 Oct 28 20:23:06.088031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1200/2415] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:06 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:06.283453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-66676be3-e1a8-4181-95b3-e1808d66629e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:06.284587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-66676be3-e1a8-4181-95b3-e1808d66629e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:06.290927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66676be3-e1a8-4181-95b3-e1808d66629e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:06.291404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66676be3-e1a8-4181-95b3-e1808d66629e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:06.291849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66676be3-e1a8-4181-95b3-e1808d66629e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:06.292526 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66676be3-e1a8-4181-95b3-e1808d66629e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:06.292978 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66676be3-e1a8-4181-95b3-e1808d66629e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:06.293430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66676be3-e1a8-4181-95b3-e1808d66629e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:06.423157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-66676be3-e1a8-4181-95b3-e1808d66629e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:06.428416 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-66676be3-e1a8-4181-95b3-e1808d66629e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.148957 Oct 28 20:23:06.428971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1216/2416] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:06 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:07.110787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5cfff4da-cf4a-4a1d-8c8f-da7b593a8338 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:07.111406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5cfff4da-cf4a-4a1d-8c8f-da7b593a8338 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:07.117948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cfff4da-cf4a-4a1d-8c8f-da7b593a8338 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:07.118431 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cfff4da-cf4a-4a1d-8c8f-da7b593a8338 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:07.118871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cfff4da-cf4a-4a1d-8c8f-da7b593a8338 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:07.119548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cfff4da-cf4a-4a1d-8c8f-da7b593a8338 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:07.120004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cfff4da-cf4a-4a1d-8c8f-da7b593a8338 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:07.120428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cfff4da-cf4a-4a1d-8c8f-da7b593a8338 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:07.179956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5cfff4da-cf4a-4a1d-8c8f-da7b593a8338 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:07.188085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5cfff4da-cf4a-4a1d-8c8f-da7b593a8338 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.081147 Oct 28 20:23:07.188646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1201/2417] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:07 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:07.451611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91ba2299-1f99-4724-af68-89bb170165fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:07.452233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-91ba2299-1f99-4724-af68-89bb170165fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:07.458990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91ba2299-1f99-4724-af68-89bb170165fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:07.459473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91ba2299-1f99-4724-af68-89bb170165fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:07.459911 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91ba2299-1f99-4724-af68-89bb170165fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:07.460598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91ba2299-1f99-4724-af68-89bb170165fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:07.461054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91ba2299-1f99-4724-af68-89bb170165fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:07.461517 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91ba2299-1f99-4724-af68-89bb170165fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:07.592676 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-91ba2299-1f99-4724-af68-89bb170165fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:07.600983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-91ba2299-1f99-4724-af68-89bb170165fd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.153207 Oct 28 20:23:07.601585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1217/2418] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:07 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:08.211384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f29f75bb-c77a-446d-b612-03b9dca3616b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:08.211993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f29f75bb-c77a-446d-b612-03b9dca3616b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:08.214480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=52 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:08.219340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f29f75bb-c77a-446d-b612-03b9dca3616b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:08.219816 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f29f75bb-c77a-446d-b612-03b9dca3616b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:08.220249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f29f75bb-c77a-446d-b612-03b9dca3616b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:08.220920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f29f75bb-c77a-446d-b612-03b9dca3616b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:08.221898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f29f75bb-c77a-446d-b612-03b9dca3616b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:08.222562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f29f75bb-c77a-446d-b612-03b9dca3616b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:08.282977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f29f75bb-c77a-446d-b612-03b9dca3616b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:08.291697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f29f75bb-c77a-446d-b612-03b9dca3616b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084150 Oct 28 20:23:08.292251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1202/2419] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:08 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:08.624387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7b7b7d56-32fc-48cf-803e-55a629b3c727 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:08.625183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7b7b7d56-32fc-48cf-803e-55a629b3c727 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:08.632631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b7b7d56-32fc-48cf-803e-55a629b3c727 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:08.633111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b7b7d56-32fc-48cf-803e-55a629b3c727 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:08.633585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b7b7d56-32fc-48cf-803e-55a629b3c727 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:08.634271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b7b7d56-32fc-48cf-803e-55a629b3c727 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:08.634723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b7b7d56-32fc-48cf-803e-55a629b3c727 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:08.635144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b7b7d56-32fc-48cf-803e-55a629b3c727 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:08.762908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7b7b7d56-32fc-48cf-803e-55a629b3c727 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:08.771800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7b7b7d56-32fc-48cf-803e-55a629b3c727 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151321 Oct 28 20:23:08.772369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1218/2420] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:08 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:09.315997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f5bc703a-f646-4706-af9a-0ef0cf6d5629 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:09.316557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f5bc703a-f646-4706-af9a-0ef0cf6d5629 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:09.323061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5bc703a-f646-4706-af9a-0ef0cf6d5629 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:09.323544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5bc703a-f646-4706-af9a-0ef0cf6d5629 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:09.323982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5bc703a-f646-4706-af9a-0ef0cf6d5629 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:09.324661 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5bc703a-f646-4706-af9a-0ef0cf6d5629 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:09.325123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5bc703a-f646-4706-af9a-0ef0cf6d5629 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:09.325576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5bc703a-f646-4706-af9a-0ef0cf6d5629 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:09.386677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f5bc703a-f646-4706-af9a-0ef0cf6d5629 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:09.395059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f5bc703a-f646-4706-af9a-0ef0cf6d5629 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083624 Oct 28 20:23:09.395620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1203/2421] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:09 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:09.794961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5f58f394-d92c-451e-90f1-fa23a67f8145 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:09.795579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5f58f394-d92c-451e-90f1-fa23a67f8145 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:09.802784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f58f394-d92c-451e-90f1-fa23a67f8145 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:09.803288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f58f394-d92c-451e-90f1-fa23a67f8145 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:09.803727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f58f394-d92c-451e-90f1-fa23a67f8145 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:09.804443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f58f394-d92c-451e-90f1-fa23a67f8145 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:09.804899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f58f394-d92c-451e-90f1-fa23a67f8145 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:09.805344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f58f394-d92c-451e-90f1-fa23a67f8145 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:09.931144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5f58f394-d92c-451e-90f1-fa23a67f8145 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:09.939258 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5f58f394-d92c-451e-90f1-fa23a67f8145 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.148166 Oct 28 20:23:09.939822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1219/2422] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:09 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:10.418955 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a5331c19-62c6-4062-9b45-0edc2082becd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:10.419598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a5331c19-62c6-4062-9b45-0edc2082becd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:10.426633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5331c19-62c6-4062-9b45-0edc2082becd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:10.427110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5331c19-62c6-4062-9b45-0edc2082becd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:10.427546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5331c19-62c6-4062-9b45-0edc2082becd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:10.428227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5331c19-62c6-4062-9b45-0edc2082becd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:10.428675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5331c19-62c6-4062-9b45-0edc2082becd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:10.429098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5331c19-62c6-4062-9b45-0edc2082becd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:10.489415 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a5331c19-62c6-4062-9b45-0edc2082becd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:10.497453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a5331c19-62c6-4062-9b45-0edc2082becd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082306 Oct 28 20:23:10.498032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1204/2423] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:10 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:10.962035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-50e65d58-492e-4331-9574-14f89114a0f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:10.962640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-50e65d58-492e-4331-9574-14f89114a0f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:10.965178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=50 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:10.969764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e65d58-492e-4331-9574-14f89114a0f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:10.970239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e65d58-492e-4331-9574-14f89114a0f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:10.970672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e65d58-492e-4331-9574-14f89114a0f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:10.971899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e65d58-492e-4331-9574-14f89114a0f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:10.972597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e65d58-492e-4331-9574-14f89114a0f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:10.973013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e65d58-492e-4331-9574-14f89114a0f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:11.104970 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-50e65d58-492e-4331-9574-14f89114a0f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:11.108109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:11.115731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-50e65d58-492e-4331-9574-14f89114a0f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.157467 Oct 28 20:23:11.116317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1220/2424] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:10 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:11.520686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d9a36856-5e73-4fa2-a322-65819c9e715b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:11.521229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d9a36856-5e73-4fa2-a322-65819c9e715b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:11.527658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9a36856-5e73-4fa2-a322-65819c9e715b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:11.528137 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9a36856-5e73-4fa2-a322-65819c9e715b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:11.528575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9a36856-5e73-4fa2-a322-65819c9e715b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:11.529335 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9a36856-5e73-4fa2-a322-65819c9e715b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:11.529796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9a36856-5e73-4fa2-a322-65819c9e715b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:11.530220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9a36856-5e73-4fa2-a322-65819c9e715b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:11.594315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d9a36856-5e73-4fa2-a322-65819c9e715b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:11.603208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d9a36856-5e73-4fa2-a322-65819c9e715b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087151 Oct 28 20:23:11.603769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1205/2425] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:11 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:12.138746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2450e0cb-d7fc-4a07-9241-2936d0c8b853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:12.139358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2450e0cb-d7fc-4a07-9241-2936d0c8b853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:12.146502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2450e0cb-d7fc-4a07-9241-2936d0c8b853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:12.146981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2450e0cb-d7fc-4a07-9241-2936d0c8b853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:12.147413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2450e0cb-d7fc-4a07-9241-2936d0c8b853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:12.148094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2450e0cb-d7fc-4a07-9241-2936d0c8b853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:12.148541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2450e0cb-d7fc-4a07-9241-2936d0c8b853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:12.148963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2450e0cb-d7fc-4a07-9241-2936d0c8b853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:12.278293 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2450e0cb-d7fc-4a07-9241-2936d0c8b853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:12.286553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2450e0cb-d7fc-4a07-9241-2936d0c8b853 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151565 Oct 28 20:23:12.287064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1221/2426] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:12 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:12.626043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0198e36-5cc2-44b0-a3aa-6c84ef18db7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:12.626694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0198e36-5cc2-44b0-a3aa-6c84ef18db7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:12.632928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0198e36-5cc2-44b0-a3aa-6c84ef18db7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:12.633427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0198e36-5cc2-44b0-a3aa-6c84ef18db7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:12.633866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0198e36-5cc2-44b0-a3aa-6c84ef18db7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:12.634537 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0198e36-5cc2-44b0-a3aa-6c84ef18db7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:12.634983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0198e36-5cc2-44b0-a3aa-6c84ef18db7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:12.635400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0198e36-5cc2-44b0-a3aa-6c84ef18db7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:12.652588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:12.695665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0198e36-5cc2-44b0-a3aa-6c84ef18db7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:12.703873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0198e36-5cc2-44b0-a3aa-6c84ef18db7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.081704 Oct 28 20:23:12.704442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1206/2427] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:12 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:13.309859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-74c12060-bcd4-4f06-85ee-a008d6925d42 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:13.311397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-74c12060-bcd4-4f06-85ee-a008d6925d42 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:13.317780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74c12060-bcd4-4f06-85ee-a008d6925d42 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:13.318269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74c12060-bcd4-4f06-85ee-a008d6925d42 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:13.318716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74c12060-bcd4-4f06-85ee-a008d6925d42 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:13.319406 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74c12060-bcd4-4f06-85ee-a008d6925d42 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:13.319865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74c12060-bcd4-4f06-85ee-a008d6925d42 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:13.320322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74c12060-bcd4-4f06-85ee-a008d6925d42 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:13.448528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-74c12060-bcd4-4f06-85ee-a008d6925d42 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:13.457540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-74c12060-bcd4-4f06-85ee-a008d6925d42 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151464 Oct 28 20:23:13.458124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1222/2428] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:13 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:13.727337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bf5ccccc-a663-485c-ab4b-ea7606d70529 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:13.727935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bf5ccccc-a663-485c-ab4b-ea7606d70529 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:13.734220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf5ccccc-a663-485c-ab4b-ea7606d70529 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:13.734693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf5ccccc-a663-485c-ab4b-ea7606d70529 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:13.735125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf5ccccc-a663-485c-ab4b-ea7606d70529 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:13.735800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf5ccccc-a663-485c-ab4b-ea7606d70529 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:13.736245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf5ccccc-a663-485c-ab4b-ea7606d70529 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:13.736662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf5ccccc-a663-485c-ab4b-ea7606d70529 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:13.797057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bf5ccccc-a663-485c-ab4b-ea7606d70529 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:13.806151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bf5ccccc-a663-485c-ab4b-ea7606d70529 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082596 Oct 28 20:23:13.806713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1207/2429] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:13 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:14.480819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3969e292-33d0-4563-a8cc-96321e128365 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:14.481527 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3969e292-33d0-4563-a8cc-96321e128365 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:14.487928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3969e292-33d0-4563-a8cc-96321e128365 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:14.488402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3969e292-33d0-4563-a8cc-96321e128365 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:14.488837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3969e292-33d0-4563-a8cc-96321e128365 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:14.489551 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3969e292-33d0-4563-a8cc-96321e128365 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:14.490006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3969e292-33d0-4563-a8cc-96321e128365 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:14.490430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3969e292-33d0-4563-a8cc-96321e128365 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:14.619842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3969e292-33d0-4563-a8cc-96321e128365 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:14.628441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3969e292-33d0-4563-a8cc-96321e128365 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150883 Oct 28 20:23:14.629015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1223/2430] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:14 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:14.829753 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b021b2b9-dca7-418a-9ca1-1415fdcc8327 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:14.830316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b021b2b9-dca7-418a-9ca1-1415fdcc8327 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:14.836745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b021b2b9-dca7-418a-9ca1-1415fdcc8327 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:14.837250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b021b2b9-dca7-418a-9ca1-1415fdcc8327 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:14.837761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b021b2b9-dca7-418a-9ca1-1415fdcc8327 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:14.838436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b021b2b9-dca7-418a-9ca1-1415fdcc8327 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:14.838883 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b021b2b9-dca7-418a-9ca1-1415fdcc8327 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:14.839302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b021b2b9-dca7-418a-9ca1-1415fdcc8327 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:14.900304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b021b2b9-dca7-418a-9ca1-1415fdcc8327 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:14.908481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b021b2b9-dca7-418a-9ca1-1415fdcc8327 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082814 Oct 28 20:23:14.909041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1208/2431] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:14 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:15.651656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-45b82e64-aa95-4832-acde-f234e5bfafa3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:15.652268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-45b82e64-aa95-4832-acde-f234e5bfafa3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:15.658842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45b82e64-aa95-4832-acde-f234e5bfafa3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:15.659478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45b82e64-aa95-4832-acde-f234e5bfafa3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:15.660063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45b82e64-aa95-4832-acde-f234e5bfafa3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:15.660745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45b82e64-aa95-4832-acde-f234e5bfafa3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:15.661202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45b82e64-aa95-4832-acde-f234e5bfafa3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:15.661652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45b82e64-aa95-4832-acde-f234e5bfafa3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:15.793974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-45b82e64-aa95-4832-acde-f234e5bfafa3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:15.802454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-45b82e64-aa95-4832-acde-f234e5bfafa3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.154683 Oct 28 20:23:15.803008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1224/2432] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:15 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:15.932040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-48db9f5e-7973-44dd-bc87-3297ca4b7e77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:15.932734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-48db9f5e-7973-44dd-bc87-3297ca4b7e77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:15.938905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48db9f5e-7973-44dd-bc87-3297ca4b7e77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:15.939408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48db9f5e-7973-44dd-bc87-3297ca4b7e77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:15.939840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48db9f5e-7973-44dd-bc87-3297ca4b7e77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:15.941140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48db9f5e-7973-44dd-bc87-3297ca4b7e77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:15.941612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48db9f5e-7973-44dd-bc87-3297ca4b7e77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:15.942034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48db9f5e-7973-44dd-bc87-3297ca4b7e77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:16.001342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-48db9f5e-7973-44dd-bc87-3297ca4b7e77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:16.010043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-48db9f5e-7973-44dd-bc87-3297ca4b7e77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.081767 Oct 28 20:23:16.010603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1209/2433] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:15 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:16.826271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5a0653d-0297-4f27-99a6-ea33f5fc9990 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:16.826887 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f5a0653d-0297-4f27-99a6-ea33f5fc9990 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:16.834173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a0653d-0297-4f27-99a6-ea33f5fc9990 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:16.834663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a0653d-0297-4f27-99a6-ea33f5fc9990 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:16.835105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a0653d-0297-4f27-99a6-ea33f5fc9990 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:16.835786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a0653d-0297-4f27-99a6-ea33f5fc9990 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:16.836242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a0653d-0297-4f27-99a6-ea33f5fc9990 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:16.836669 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a0653d-0297-4f27-99a6-ea33f5fc9990 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:16.963764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f5a0653d-0297-4f27-99a6-ea33f5fc9990 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:16.972531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5a0653d-0297-4f27-99a6-ea33f5fc9990 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149726 Oct 28 20:23:16.973093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1225/2434] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:16 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:17.032232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-54b64400-96f2-45bd-a042-bb5576cb7649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:17.032879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-54b64400-96f2-45bd-a042-bb5576cb7649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:17.039291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54b64400-96f2-45bd-a042-bb5576cb7649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:17.039778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54b64400-96f2-45bd-a042-bb5576cb7649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:17.040216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54b64400-96f2-45bd-a042-bb5576cb7649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:17.040900 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54b64400-96f2-45bd-a042-bb5576cb7649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:17.041390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54b64400-96f2-45bd-a042-bb5576cb7649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:17.041819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54b64400-96f2-45bd-a042-bb5576cb7649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:17.102160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-54b64400-96f2-45bd-a042-bb5576cb7649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:17.110303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-54b64400-96f2-45bd-a042-bb5576cb7649 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.081952 Oct 28 20:23:17.110872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1210/2435] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:17 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:17.996167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3a343a51-6c2d-4b65-8936-927a76fb204d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:17.996817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3a343a51-6c2d-4b65-8936-927a76fb204d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:18.003285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a343a51-6c2d-4b65-8936-927a76fb204d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:18.003765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a343a51-6c2d-4b65-8936-927a76fb204d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:18.004205 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a343a51-6c2d-4b65-8936-927a76fb204d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:18.004890 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a343a51-6c2d-4b65-8936-927a76fb204d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:18.005363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a343a51-6c2d-4b65-8936-927a76fb204d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:18.005795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a343a51-6c2d-4b65-8936-927a76fb204d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:18.132754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7024908d-63e0-4ace-b9a0-ae5f9e14cbfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:18.133165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7024908d-63e0-4ace-b9a0-ae5f9e14cbfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:18.134596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3a343a51-6c2d-4b65-8936-927a76fb204d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:18.139347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7024908d-63e0-4ace-b9a0-ae5f9e14cbfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:18.139826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7024908d-63e0-4ace-b9a0-ae5f9e14cbfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:18.140259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7024908d-63e0-4ace-b9a0-ae5f9e14cbfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:18.140938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7024908d-63e0-4ace-b9a0-ae5f9e14cbfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:18.141410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7024908d-63e0-4ace-b9a0-ae5f9e14cbfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:18.141830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7024908d-63e0-4ace-b9a0-ae5f9e14cbfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:18.142905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3a343a51-6c2d-4b65-8936-927a76fb204d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150625 Oct 28 20:23:18.144014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1226/2436] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:17 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:18.202174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7024908d-63e0-4ace-b9a0-ae5f9e14cbfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:18.210735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7024908d-63e0-4ace-b9a0-ae5f9e14cbfe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082210 Oct 28 20:23:18.211291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1211/2437] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:18 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:19.166172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-850c730c-d9c1-42bc-b0ac-e45b8fe5bcb4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:19.166781 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-850c730c-d9c1-42bc-b0ac-e45b8fe5bcb4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:19.173036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-850c730c-d9c1-42bc-b0ac-e45b8fe5bcb4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:19.173546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-850c730c-d9c1-42bc-b0ac-e45b8fe5bcb4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:19.173974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-850c730c-d9c1-42bc-b0ac-e45b8fe5bcb4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:19.174670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-850c730c-d9c1-42bc-b0ac-e45b8fe5bcb4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:19.175131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-850c730c-d9c1-42bc-b0ac-e45b8fe5bcb4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:19.175542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-850c730c-d9c1-42bc-b0ac-e45b8fe5bcb4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:19.233727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c65d995-7f00-4016-8dec-bec083427abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:19.234989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7c65d995-7f00-4016-8dec-bec083427abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:19.242090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c65d995-7f00-4016-8dec-bec083427abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:19.242577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c65d995-7f00-4016-8dec-bec083427abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:19.243022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c65d995-7f00-4016-8dec-bec083427abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:19.243710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c65d995-7f00-4016-8dec-bec083427abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:19.244168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c65d995-7f00-4016-8dec-bec083427abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:19.244591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c65d995-7f00-4016-8dec-bec083427abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:19.322055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7c65d995-7f00-4016-8dec-bec083427abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:19.328981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-850c730c-d9c1-42bc-b0ac-e45b8fe5bcb4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:19.330301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c65d995-7f00-4016-8dec-bec083427abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.100737 Oct 28 20:23:19.331992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1212/2438] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:19 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:19.337749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-850c730c-d9c1-42bc-b0ac-e45b8fe5bcb4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.175333 Oct 28 20:23:19.338302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1227/2439] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:19 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:20.354785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c559c5e8-e44a-4774-88aa-077dcabff633 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:20.355341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c559c5e8-e44a-4774-88aa-077dcabff633 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:20.359658 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-203f041a-09da-4467-8f9c-c38479a0708f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:20.360278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-203f041a-09da-4467-8f9c-c38479a0708f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:20.361779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c559c5e8-e44a-4774-88aa-077dcabff633 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:20.362804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c559c5e8-e44a-4774-88aa-077dcabff633 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:20.363499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c559c5e8-e44a-4774-88aa-077dcabff633 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:20.364001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c559c5e8-e44a-4774-88aa-077dcabff633 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:20.364445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c559c5e8-e44a-4774-88aa-077dcabff633 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:20.364858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c559c5e8-e44a-4774-88aa-077dcabff633 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:20.367548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-203f041a-09da-4467-8f9c-c38479a0708f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:20.368030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-203f041a-09da-4467-8f9c-c38479a0708f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:20.368465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-203f041a-09da-4467-8f9c-c38479a0708f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:20.369155 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-203f041a-09da-4467-8f9c-c38479a0708f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:20.369632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-203f041a-09da-4467-8f9c-c38479a0708f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:20.370062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-203f041a-09da-4467-8f9c-c38479a0708f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:20.430697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c559c5e8-e44a-4774-88aa-077dcabff633 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:20.439532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c559c5e8-e44a-4774-88aa-077dcabff633 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.088595 Oct 28 20:23:20.440208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1213/2440] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:20 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:20.525760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-203f041a-09da-4467-8f9c-c38479a0708f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:20.534775 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-203f041a-09da-4467-8f9c-c38479a0708f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.178175 Oct 28 20:23:20.535339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1228/2441] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:20 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:21.464140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d554d2c-6f29-4933-8d16-a8ba8e9d84f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:21.464758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3d554d2c-6f29-4933-8d16-a8ba8e9d84f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:21.471485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d554d2c-6f29-4933-8d16-a8ba8e9d84f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:21.471962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d554d2c-6f29-4933-8d16-a8ba8e9d84f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:21.472581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d554d2c-6f29-4933-8d16-a8ba8e9d84f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:21.473328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d554d2c-6f29-4933-8d16-a8ba8e9d84f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:21.473805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d554d2c-6f29-4933-8d16-a8ba8e9d84f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:21.474231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d554d2c-6f29-4933-8d16-a8ba8e9d84f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:21.558300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c5d197c3-3a9c-4108-8094-144af2bbebc0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:21.558921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c5d197c3-3a9c-4108-8094-144af2bbebc0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:21.565595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5d197c3-3a9c-4108-8094-144af2bbebc0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:21.566697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5d197c3-3a9c-4108-8094-144af2bbebc0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:21.567109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5d197c3-3a9c-4108-8094-144af2bbebc0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:21.567846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5d197c3-3a9c-4108-8094-144af2bbebc0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:21.568295 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5d197c3-3a9c-4108-8094-144af2bbebc0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:21.568718 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5d197c3-3a9c-4108-8094-144af2bbebc0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:21.793290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3d554d2c-6f29-4933-8d16-a8ba8e9d84f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:21.801906 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3d554d2c-6f29-4933-8d16-a8ba8e9d84f7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.341661 Oct 28 20:23:21.802490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1214/2442] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:21 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:21.884557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c5d197c3-3a9c-4108-8094-144af2bbebc0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:21.892610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c5d197c3-3a9c-4108-8094-144af2bbebc0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.338227 Oct 28 20:23:21.893186 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1229/2443] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:21 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:22.824048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4043f9a8-c90d-4f84-bf66-d7a15401b811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:22.824655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4043f9a8-c90d-4f84-bf66-d7a15401b811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:22.831100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4043f9a8-c90d-4f84-bf66-d7a15401b811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:22.832151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4043f9a8-c90d-4f84-bf66-d7a15401b811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:22.832636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4043f9a8-c90d-4f84-bf66-d7a15401b811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:22.833334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4043f9a8-c90d-4f84-bf66-d7a15401b811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:22.833921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4043f9a8-c90d-4f84-bf66-d7a15401b811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:22.834352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4043f9a8-c90d-4f84-bf66-d7a15401b811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:22.895484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4043f9a8-c90d-4f84-bf66-d7a15401b811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:22.903490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4043f9a8-c90d-4f84-bf66-d7a15401b811 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083327 Oct 28 20:23:22.904060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1215/2444] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:22 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:22.916036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3666d518-d0b5-42ec-8bc1-0a1dfcb1e15c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:22.916649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3666d518-d0b5-42ec-8bc1-0a1dfcb1e15c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:22.923098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3666d518-d0b5-42ec-8bc1-0a1dfcb1e15c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:22.923579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3666d518-d0b5-42ec-8bc1-0a1dfcb1e15c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:22.924016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3666d518-d0b5-42ec-8bc1-0a1dfcb1e15c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:22.924698 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3666d518-d0b5-42ec-8bc1-0a1dfcb1e15c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:22.925244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3666d518-d0b5-42ec-8bc1-0a1dfcb1e15c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:22.925740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3666d518-d0b5-42ec-8bc1-0a1dfcb1e15c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:23.055953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3666d518-d0b5-42ec-8bc1-0a1dfcb1e15c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:23.064139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3666d518-d0b5-42ec-8bc1-0a1dfcb1e15c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151933 Oct 28 20:23:23.064706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1230/2445] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:22 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:23.927163 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0c1a9782-1ddf-412c-a0fc-d161e450b98e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:23.927713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0c1a9782-1ddf-412c-a0fc-d161e450b98e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:23.934050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c1a9782-1ddf-412c-a0fc-d161e450b98e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:23.934531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c1a9782-1ddf-412c-a0fc-d161e450b98e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:23.934966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c1a9782-1ddf-412c-a0fc-d161e450b98e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:23.935644 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c1a9782-1ddf-412c-a0fc-d161e450b98e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:23.936091 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c1a9782-1ddf-412c-a0fc-d161e450b98e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:23.936508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c1a9782-1ddf-412c-a0fc-d161e450b98e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:23.997916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0c1a9782-1ddf-412c-a0fc-d161e450b98e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:24.006498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0c1a9782-1ddf-412c-a0fc-d161e450b98e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083418 Oct 28 20:23:24.007053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1216/2446] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:23 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:24.087836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-752b7673-9aaf-4bf9-9115-f4a3cc1db620 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:24.088483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-752b7673-9aaf-4bf9-9115-f4a3cc1db620 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:24.095146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-752b7673-9aaf-4bf9-9115-f4a3cc1db620 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:24.095631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-752b7673-9aaf-4bf9-9115-f4a3cc1db620 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:24.096072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-752b7673-9aaf-4bf9-9115-f4a3cc1db620 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:24.096763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-752b7673-9aaf-4bf9-9115-f4a3cc1db620 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:24.097220 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-752b7673-9aaf-4bf9-9115-f4a3cc1db620 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:24.097674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-752b7673-9aaf-4bf9-9115-f4a3cc1db620 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:24.225656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-752b7673-9aaf-4bf9-9115-f4a3cc1db620 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:24.233687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-752b7673-9aaf-4bf9-9115-f4a3cc1db620 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149650 Oct 28 20:23:24.234244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1231/2447] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:24 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:25.029210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6dc544f8-3fd1-4498-9d93-77360438b0f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:25.029855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6dc544f8-3fd1-4498-9d93-77360438b0f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:25.036743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc544f8-3fd1-4498-9d93-77360438b0f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:25.037227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc544f8-3fd1-4498-9d93-77360438b0f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:25.037691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc544f8-3fd1-4498-9d93-77360438b0f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:25.038370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc544f8-3fd1-4498-9d93-77360438b0f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:25.038823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc544f8-3fd1-4498-9d93-77360438b0f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:25.039240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc544f8-3fd1-4498-9d93-77360438b0f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:25.103119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6dc544f8-3fd1-4498-9d93-77360438b0f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:25.111072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6dc544f8-3fd1-4498-9d93-77360438b0f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085758 Oct 28 20:23:25.111631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1217/2448] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:25 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:25.258074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b4f80b99-215a-49cf-b464-28d21d5ee011 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:25.258708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b4f80b99-215a-49cf-b464-28d21d5ee011 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:25.265016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4f80b99-215a-49cf-b464-28d21d5ee011 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:25.265532 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4f80b99-215a-49cf-b464-28d21d5ee011 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:25.265963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4f80b99-215a-49cf-b464-28d21d5ee011 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:25.266637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4f80b99-215a-49cf-b464-28d21d5ee011 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:25.267080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4f80b99-215a-49cf-b464-28d21d5ee011 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:25.267498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4f80b99-215a-49cf-b464-28d21d5ee011 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:25.397042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b4f80b99-215a-49cf-b464-28d21d5ee011 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:25.405091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b4f80b99-215a-49cf-b464-28d21d5ee011 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151374 Oct 28 20:23:25.405698 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1232/2449] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:25 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:26.134342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-093d75c6-3927-4ac9-a082-23ea4202fead tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:26.134961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-093d75c6-3927-4ac9-a082-23ea4202fead tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:26.141302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-093d75c6-3927-4ac9-a082-23ea4202fead tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:26.141820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-093d75c6-3927-4ac9-a082-23ea4202fead tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:26.142263 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-093d75c6-3927-4ac9-a082-23ea4202fead tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:26.142949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-093d75c6-3927-4ac9-a082-23ea4202fead tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:26.143409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-093d75c6-3927-4ac9-a082-23ea4202fead tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:26.143843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-093d75c6-3927-4ac9-a082-23ea4202fead tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:26.204250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-093d75c6-3927-4ac9-a082-23ea4202fead tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:26.213011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-093d75c6-3927-4ac9-a082-23ea4202fead tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082547 Oct 28 20:23:26.213605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1218/2450] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:26 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:26.433742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a976c7ad-f5f0-4622-9644-c9e69036079b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:26.433742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a976c7ad-f5f0-4622-9644-c9e69036079b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:26.435645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a976c7ad-f5f0-4622-9644-c9e69036079b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:26.436129 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a976c7ad-f5f0-4622-9644-c9e69036079b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:26.436577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a976c7ad-f5f0-4622-9644-c9e69036079b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:26.437263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a976c7ad-f5f0-4622-9644-c9e69036079b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:26.437754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a976c7ad-f5f0-4622-9644-c9e69036079b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:26.438182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a976c7ad-f5f0-4622-9644-c9e69036079b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:26.571218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a976c7ad-f5f0-4622-9644-c9e69036079b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:26.579344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a976c7ad-f5f0-4622-9644-c9e69036079b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.155046 Oct 28 20:23:26.579905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1233/2451] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:26 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:27.235303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-592e4104-e07b-4a97-8298-4b1fdbf6b48b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:27.235919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-592e4104-e07b-4a97-8298-4b1fdbf6b48b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:27.242555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-592e4104-e07b-4a97-8298-4b1fdbf6b48b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:27.243043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-592e4104-e07b-4a97-8298-4b1fdbf6b48b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:27.243482 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-592e4104-e07b-4a97-8298-4b1fdbf6b48b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:27.244161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-592e4104-e07b-4a97-8298-4b1fdbf6b48b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:27.244615 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-592e4104-e07b-4a97-8298-4b1fdbf6b48b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:27.245039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-592e4104-e07b-4a97-8298-4b1fdbf6b48b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:27.308901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-592e4104-e07b-4a97-8298-4b1fdbf6b48b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:27.318160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-592e4104-e07b-4a97-8298-4b1fdbf6b48b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086541 Oct 28 20:23:27.318733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1219/2452] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:27 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:27.603601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-208a55c8-d9b1-49b5-b364-fa6398917f0f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:27.604167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-208a55c8-d9b1-49b5-b364-fa6398917f0f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:27.610503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-208a55c8-d9b1-49b5-b364-fa6398917f0f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:27.610998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-208a55c8-d9b1-49b5-b364-fa6398917f0f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:27.611435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-208a55c8-d9b1-49b5-b364-fa6398917f0f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:27.612117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-208a55c8-d9b1-49b5-b364-fa6398917f0f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:27.612569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-208a55c8-d9b1-49b5-b364-fa6398917f0f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:27.612995 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-208a55c8-d9b1-49b5-b364-fa6398917f0f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:27.737589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-208a55c8-d9b1-49b5-b364-fa6398917f0f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:27.746253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-208a55c8-d9b1-49b5-b364-fa6398917f0f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.146716 Oct 28 20:23:27.746827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1234/2453] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:27 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:28.342288 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cd05b7d8-0338-4dc6-895a-a871d6ee6dbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:28.342829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cd05b7d8-0338-4dc6-895a-a871d6ee6dbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:28.349450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd05b7d8-0338-4dc6-895a-a871d6ee6dbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:28.349953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd05b7d8-0338-4dc6-895a-a871d6ee6dbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:28.350372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd05b7d8-0338-4dc6-895a-a871d6ee6dbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:28.351053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd05b7d8-0338-4dc6-895a-a871d6ee6dbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:28.351511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd05b7d8-0338-4dc6-895a-a871d6ee6dbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:28.351937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd05b7d8-0338-4dc6-895a-a871d6ee6dbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:28.415759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-cd05b7d8-0338-4dc6-895a-a871d6ee6dbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:28.423812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cd05b7d8-0338-4dc6-895a-a871d6ee6dbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086010 Oct 28 20:23:28.424367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1220/2454] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:28 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:28.769392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8dee7536-7609-4aa7-ae19-e52a5a72d31a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:28.770287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8dee7536-7609-4aa7-ae19-e52a5a72d31a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:28.776149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8dee7536-7609-4aa7-ae19-e52a5a72d31a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:28.776627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8dee7536-7609-4aa7-ae19-e52a5a72d31a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:28.777058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8dee7536-7609-4aa7-ae19-e52a5a72d31a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:28.777770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8dee7536-7609-4aa7-ae19-e52a5a72d31a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:28.778213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8dee7536-7609-4aa7-ae19-e52a5a72d31a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:28.778641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8dee7536-7609-4aa7-ae19-e52a5a72d31a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:28.908630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8dee7536-7609-4aa7-ae19-e52a5a72d31a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:28.916838 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8dee7536-7609-4aa7-ae19-e52a5a72d31a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151292 Oct 28 20:23:28.917433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1235/2455] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:28 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:29.446962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-497be612-aa47-43d4-929b-2ba65267d330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:29.447572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-497be612-aa47-43d4-929b-2ba65267d330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:29.454015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-497be612-aa47-43d4-929b-2ba65267d330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:29.454489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-497be612-aa47-43d4-929b-2ba65267d330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:29.454919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-497be612-aa47-43d4-929b-2ba65267d330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:29.455590 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-497be612-aa47-43d4-929b-2ba65267d330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:29.456037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-497be612-aa47-43d4-929b-2ba65267d330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:29.456455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-497be612-aa47-43d4-929b-2ba65267d330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:29.517305 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-497be612-aa47-43d4-929b-2ba65267d330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:29.525465 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-497be612-aa47-43d4-929b-2ba65267d330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082295 Oct 28 20:23:29.526027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1221/2456] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:29 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:29.939985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5cfb2cb7-96d3-4bc1-b140-cff42b23d36f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:29.940561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5cfb2cb7-96d3-4bc1-b140-cff42b23d36f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:29.947151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cfb2cb7-96d3-4bc1-b140-cff42b23d36f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:29.947632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cfb2cb7-96d3-4bc1-b140-cff42b23d36f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:29.948106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cfb2cb7-96d3-4bc1-b140-cff42b23d36f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:29.948788 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cfb2cb7-96d3-4bc1-b140-cff42b23d36f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:29.949269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cfb2cb7-96d3-4bc1-b140-cff42b23d36f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:29.949713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cfb2cb7-96d3-4bc1-b140-cff42b23d36f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:30.085066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5cfb2cb7-96d3-4bc1-b140-cff42b23d36f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:30.093637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5cfb2cb7-96d3-4bc1-b140-cff42b23d36f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.157576 Oct 28 20:23:30.095860 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1236/2457] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:29 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:30.548452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d8e7f875-14f9-446d-873d-7938466a6ec7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:30.548998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d8e7f875-14f9-446d-873d-7938466a6ec7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:30.555971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8e7f875-14f9-446d-873d-7938466a6ec7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:30.556449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8e7f875-14f9-446d-873d-7938466a6ec7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:30.556882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8e7f875-14f9-446d-873d-7938466a6ec7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:30.557592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8e7f875-14f9-446d-873d-7938466a6ec7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:30.558042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8e7f875-14f9-446d-873d-7938466a6ec7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:30.558458 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8e7f875-14f9-446d-873d-7938466a6ec7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:30.619334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d8e7f875-14f9-446d-873d-7938466a6ec7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:30.627345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d8e7f875-14f9-446d-873d-7938466a6ec7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082808 Oct 28 20:23:30.627896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1222/2458] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:30 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:31.116314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b01b1d33-d65d-498a-8627-f1b21de8a36d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:31.116926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b01b1d33-d65d-498a-8627-f1b21de8a36d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:31.123290 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b01b1d33-d65d-498a-8627-f1b21de8a36d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:31.123766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b01b1d33-d65d-498a-8627-f1b21de8a36d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:31.124197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b01b1d33-d65d-498a-8627-f1b21de8a36d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:31.124866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b01b1d33-d65d-498a-8627-f1b21de8a36d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:31.125313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b01b1d33-d65d-498a-8627-f1b21de8a36d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:31.125752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b01b1d33-d65d-498a-8627-f1b21de8a36d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:31.141063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:31.256702 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b01b1d33-d65d-498a-8627-f1b21de8a36d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:31.264686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b01b1d33-d65d-498a-8627-f1b21de8a36d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152255 Oct 28 20:23:31.265245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1237/2459] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:31 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:31.651243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-72da02b6-9e27-45f5-b7f8-56fdc23a6d20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:31.651860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-72da02b6-9e27-45f5-b7f8-56fdc23a6d20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:31.658302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72da02b6-9e27-45f5-b7f8-56fdc23a6d20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:31.658788 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72da02b6-9e27-45f5-b7f8-56fdc23a6d20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:31.662448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72da02b6-9e27-45f5-b7f8-56fdc23a6d20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:31.662448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72da02b6-9e27-45f5-b7f8-56fdc23a6d20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:31.662448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72da02b6-9e27-45f5-b7f8-56fdc23a6d20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:31.662448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72da02b6-9e27-45f5-b7f8-56fdc23a6d20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:31.665584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:31.726791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-72da02b6-9e27-45f5-b7f8-56fdc23a6d20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:31.734853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-72da02b6-9e27-45f5-b7f8-56fdc23a6d20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087532 Oct 28 20:23:31.735412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1223/2460] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:31 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:32.288933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f130fb60-2b98-4d35-a994-58700aaa8040 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:32.289518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f130fb60-2b98-4d35-a994-58700aaa8040 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:32.295867 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f130fb60-2b98-4d35-a994-58700aaa8040 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:32.296350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f130fb60-2b98-4d35-a994-58700aaa8040 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:32.296790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f130fb60-2b98-4d35-a994-58700aaa8040 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:32.297510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f130fb60-2b98-4d35-a994-58700aaa8040 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:32.297967 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f130fb60-2b98-4d35-a994-58700aaa8040 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:32.298385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f130fb60-2b98-4d35-a994-58700aaa8040 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:32.429981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f130fb60-2b98-4d35-a994-58700aaa8040 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:32.438226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f130fb60-2b98-4d35-a994-58700aaa8040 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.154359 Oct 28 20:23:32.438796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1238/2461] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:32 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:32.757888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a9d13a33-cf1c-4f82-8a87-268633ad275a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:32.758481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a9d13a33-cf1c-4f82-8a87-268633ad275a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:32.764838 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9d13a33-cf1c-4f82-8a87-268633ad275a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:32.765335 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9d13a33-cf1c-4f82-8a87-268633ad275a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:32.765775 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9d13a33-cf1c-4f82-8a87-268633ad275a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:32.766447 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9d13a33-cf1c-4f82-8a87-268633ad275a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:32.766895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9d13a33-cf1c-4f82-8a87-268633ad275a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:32.767310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9d13a33-cf1c-4f82-8a87-268633ad275a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:32.828108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a9d13a33-cf1c-4f82-8a87-268633ad275a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:32.836631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a9d13a33-cf1c-4f82-8a87-268633ad275a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083136 Oct 28 20:23:32.837190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1224/2462] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:32 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:33.460502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5c8247c9-ceea-4d87-99cc-456379337d35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:33.461111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5c8247c9-ceea-4d87-99cc-456379337d35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:33.468206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8247c9-ceea-4d87-99cc-456379337d35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:33.468683 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8247c9-ceea-4d87-99cc-456379337d35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:33.469110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8247c9-ceea-4d87-99cc-456379337d35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:33.469869 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8247c9-ceea-4d87-99cc-456379337d35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:33.470316 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8247c9-ceea-4d87-99cc-456379337d35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:33.474050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8247c9-ceea-4d87-99cc-456379337d35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:33.603909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5c8247c9-ceea-4d87-99cc-456379337d35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:33.612006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5c8247c9-ceea-4d87-99cc-456379337d35 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.155546 Oct 28 20:23:33.612577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1239/2463] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:33 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:33.860386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f186f81a-aeb0-4ac1-b4a4-8c472e5f04a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:33.860924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f186f81a-aeb0-4ac1-b4a4-8c472e5f04a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:33.868136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f186f81a-aeb0-4ac1-b4a4-8c472e5f04a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:33.868650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f186f81a-aeb0-4ac1-b4a4-8c472e5f04a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:33.869095 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f186f81a-aeb0-4ac1-b4a4-8c472e5f04a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:33.869814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f186f81a-aeb0-4ac1-b4a4-8c472e5f04a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:33.870272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f186f81a-aeb0-4ac1-b4a4-8c472e5f04a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:33.870697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f186f81a-aeb0-4ac1-b4a4-8c472e5f04a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:33.933299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f186f81a-aeb0-4ac1-b4a4-8c472e5f04a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:33.941352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f186f81a-aeb0-4ac1-b4a4-8c472e5f04a0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084890 Oct 28 20:23:33.942562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1225/2464] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:33 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:34.636396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3902dcf1-48eb-46eb-a2bd-0dac157d6f65 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:34.637016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3902dcf1-48eb-46eb-a2bd-0dac157d6f65 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:34.643433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3902dcf1-48eb-46eb-a2bd-0dac157d6f65 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:34.643912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3902dcf1-48eb-46eb-a2bd-0dac157d6f65 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:34.644353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3902dcf1-48eb-46eb-a2bd-0dac157d6f65 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:34.645687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3902dcf1-48eb-46eb-a2bd-0dac157d6f65 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:34.646148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3902dcf1-48eb-46eb-a2bd-0dac157d6f65 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:34.646573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3902dcf1-48eb-46eb-a2bd-0dac157d6f65 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:34.775688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3902dcf1-48eb-46eb-a2bd-0dac157d6f65 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:34.783724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3902dcf1-48eb-46eb-a2bd-0dac157d6f65 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151173 Oct 28 20:23:34.784285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1240/2465] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:34 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:34.964347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1ba5915c-ce8f-4327-8d3f-6c11e83ebaec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:34.964944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1ba5915c-ce8f-4327-8d3f-6c11e83ebaec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:34.971571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ba5915c-ce8f-4327-8d3f-6c11e83ebaec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:34.977354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ba5915c-ce8f-4327-8d3f-6c11e83ebaec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:34.977354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ba5915c-ce8f-4327-8d3f-6c11e83ebaec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:34.977354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ba5915c-ce8f-4327-8d3f-6c11e83ebaec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:34.977354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ba5915c-ce8f-4327-8d3f-6c11e83ebaec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:34.977782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ba5915c-ce8f-4327-8d3f-6c11e83ebaec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:35.038589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1ba5915c-ce8f-4327-8d3f-6c11e83ebaec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:35.046701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1ba5915c-ce8f-4327-8d3f-6c11e83ebaec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086201 Oct 28 20:23:35.047238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1226/2466] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:34 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:35.810168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a1205e3f-3d02-4920-8f8f-2a54dee01400 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:35.810734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a1205e3f-3d02-4920-8f8f-2a54dee01400 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:35.818075 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1205e3f-3d02-4920-8f8f-2a54dee01400 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:35.818550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1205e3f-3d02-4920-8f8f-2a54dee01400 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:35.818989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1205e3f-3d02-4920-8f8f-2a54dee01400 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:35.819682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1205e3f-3d02-4920-8f8f-2a54dee01400 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:35.820131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1205e3f-3d02-4920-8f8f-2a54dee01400 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:35.820555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1205e3f-3d02-4920-8f8f-2a54dee01400 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:35.952651 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a1205e3f-3d02-4920-8f8f-2a54dee01400 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:35.961927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a1205e3f-3d02-4920-8f8f-2a54dee01400 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.157479 Oct 28 20:23:35.962494 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1241/2467] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:35 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:36.069369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7eabe3f-29dd-413e-ad49-caec3327f026 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:36.069909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7eabe3f-29dd-413e-ad49-caec3327f026 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:36.076221 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7eabe3f-29dd-413e-ad49-caec3327f026 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:36.076703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7eabe3f-29dd-413e-ad49-caec3327f026 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:36.077140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7eabe3f-29dd-413e-ad49-caec3327f026 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:36.077848 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7eabe3f-29dd-413e-ad49-caec3327f026 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:36.078298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7eabe3f-29dd-413e-ad49-caec3327f026 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:36.078722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7eabe3f-29dd-413e-ad49-caec3327f026 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:36.139800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7eabe3f-29dd-413e-ad49-caec3327f026 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:36.148448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7eabe3f-29dd-413e-ad49-caec3327f026 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083020 Oct 28 20:23:36.149011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1227/2468] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:36 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:36.985863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2de538ff-6ec9-4fa2-afca-7db7518b0131 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:36.986476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2de538ff-6ec9-4fa2-afca-7db7518b0131 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:36.993006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de538ff-6ec9-4fa2-afca-7db7518b0131 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:36.993526 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de538ff-6ec9-4fa2-afca-7db7518b0131 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:36.993969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de538ff-6ec9-4fa2-afca-7db7518b0131 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:36.994652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de538ff-6ec9-4fa2-afca-7db7518b0131 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:36.995103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de538ff-6ec9-4fa2-afca-7db7518b0131 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:36.995525 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de538ff-6ec9-4fa2-afca-7db7518b0131 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:37.127684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2de538ff-6ec9-4fa2-afca-7db7518b0131 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:37.136172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2de538ff-6ec9-4fa2-afca-7db7518b0131 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.154158 Oct 28 20:23:37.136775 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1242/2469] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:36 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:37.171746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a4dc5445-97fd-45bf-8528-ac6ab9c99821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:37.172353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a4dc5445-97fd-45bf-8528-ac6ab9c99821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:37.178776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4dc5445-97fd-45bf-8528-ac6ab9c99821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:37.179253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4dc5445-97fd-45bf-8528-ac6ab9c99821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:37.179689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4dc5445-97fd-45bf-8528-ac6ab9c99821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:37.180367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4dc5445-97fd-45bf-8528-ac6ab9c99821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:37.180817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4dc5445-97fd-45bf-8528-ac6ab9c99821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:37.181260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4dc5445-97fd-45bf-8528-ac6ab9c99821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:37.241966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a4dc5445-97fd-45bf-8528-ac6ab9c99821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:37.249967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a4dc5445-97fd-45bf-8528-ac6ab9c99821 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082053 Oct 28 20:23:37.250526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1228/2470] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:37 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:38.159749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a396f1c5-8f12-47d3-b248-86c37d6d4da1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:38.160547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a396f1c5-8f12-47d3-b248-86c37d6d4da1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:38.166929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a396f1c5-8f12-47d3-b248-86c37d6d4da1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:38.167414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a396f1c5-8f12-47d3-b248-86c37d6d4da1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:38.167855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a396f1c5-8f12-47d3-b248-86c37d6d4da1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:38.168544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a396f1c5-8f12-47d3-b248-86c37d6d4da1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:38.168998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a396f1c5-8f12-47d3-b248-86c37d6d4da1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:38.169456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a396f1c5-8f12-47d3-b248-86c37d6d4da1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:38.273683 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-36894310-adbd-4771-a2a9-dc3e1a0f9d78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:38.274505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-36894310-adbd-4771-a2a9-dc3e1a0f9d78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:38.276820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=54 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:38.281629 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36894310-adbd-4771-a2a9-dc3e1a0f9d78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:38.282037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36894310-adbd-4771-a2a9-dc3e1a0f9d78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:38.282673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36894310-adbd-4771-a2a9-dc3e1a0f9d78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:38.283363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36894310-adbd-4771-a2a9-dc3e1a0f9d78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:38.283811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36894310-adbd-4771-a2a9-dc3e1a0f9d78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:38.284234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36894310-adbd-4771-a2a9-dc3e1a0f9d78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:38.300397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a396f1c5-8f12-47d3-b248-86c37d6d4da1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:38.309465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a396f1c5-8f12-47d3-b248-86c37d6d4da1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.153497 Oct 28 20:23:38.310046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1243/2471] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:38 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:38.349372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-36894310-adbd-4771-a2a9-dc3e1a0f9d78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:38.357360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-36894310-adbd-4771-a2a9-dc3e1a0f9d78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087751 Oct 28 20:23:38.357905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1229/2472] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:38 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:39.333802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed09de28-f2df-4744-b2c4-37078e57cfb7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:39.334328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ed09de28-f2df-4744-b2c4-37078e57cfb7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:39.340943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed09de28-f2df-4744-b2c4-37078e57cfb7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:39.341452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed09de28-f2df-4744-b2c4-37078e57cfb7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:39.341885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed09de28-f2df-4744-b2c4-37078e57cfb7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:39.342567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed09de28-f2df-4744-b2c4-37078e57cfb7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:39.343016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed09de28-f2df-4744-b2c4-37078e57cfb7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:39.343435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed09de28-f2df-4744-b2c4-37078e57cfb7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:39.380392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-660aea19-dc84-483a-98b9-d6ff77178695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:39.381109 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-660aea19-dc84-483a-98b9-d6ff77178695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:39.387742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-660aea19-dc84-483a-98b9-d6ff77178695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:39.388227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-660aea19-dc84-483a-98b9-d6ff77178695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:39.388666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-660aea19-dc84-483a-98b9-d6ff77178695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:39.389381 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-660aea19-dc84-483a-98b9-d6ff77178695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:39.389839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-660aea19-dc84-483a-98b9-d6ff77178695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:39.390263 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-660aea19-dc84-483a-98b9-d6ff77178695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:39.461236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-660aea19-dc84-483a-98b9-d6ff77178695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:39.469696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-660aea19-dc84-483a-98b9-d6ff77178695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.093431 Oct 28 20:23:39.470273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1230/2473] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:39 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:39.494227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ed09de28-f2df-4744-b2c4-37078e57cfb7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:39.502349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ed09de28-f2df-4744-b2c4-37078e57cfb7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.172794 Oct 28 20:23:39.502906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1244/2474] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:39 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:40.494307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d89d264f-a1e7-4d55-98b6-ac63fed2581c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:40.494932 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d89d264f-a1e7-4d55-98b6-ac63fed2581c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:40.501476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d89d264f-a1e7-4d55-98b6-ac63fed2581c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:40.501958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d89d264f-a1e7-4d55-98b6-ac63fed2581c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:40.502397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d89d264f-a1e7-4d55-98b6-ac63fed2581c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:40.503076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d89d264f-a1e7-4d55-98b6-ac63fed2581c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:40.503528 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d89d264f-a1e7-4d55-98b6-ac63fed2581c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:40.504637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d89d264f-a1e7-4d55-98b6-ac63fed2581c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:40.525268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4108b2c4-0123-4a6b-88a3-60f0e51598d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:40.525984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4108b2c4-0123-4a6b-88a3-60f0e51598d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:40.532242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4108b2c4-0123-4a6b-88a3-60f0e51598d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:40.532724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4108b2c4-0123-4a6b-88a3-60f0e51598d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:40.533149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4108b2c4-0123-4a6b-88a3-60f0e51598d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:40.533856 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4108b2c4-0123-4a6b-88a3-60f0e51598d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:40.534309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4108b2c4-0123-4a6b-88a3-60f0e51598d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:40.534728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4108b2c4-0123-4a6b-88a3-60f0e51598d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:40.565937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d89d264f-a1e7-4d55-98b6-ac63fed2581c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:40.575130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d89d264f-a1e7-4d55-98b6-ac63fed2581c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084582 Oct 28 20:23:40.575795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1231/2475] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:40 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:40.665298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4108b2c4-0123-4a6b-88a3-60f0e51598d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:40.673313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4108b2c4-0123-4a6b-88a3-60f0e51598d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151858 Oct 28 20:23:40.673893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1245/2476] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:40 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:41.598240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7ef3f06a-51cf-4a50-8f7d-0325add08a31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:41.598899 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7ef3f06a-51cf-4a50-8f7d-0325add08a31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:41.605235 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ef3f06a-51cf-4a50-8f7d-0325add08a31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:41.605754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ef3f06a-51cf-4a50-8f7d-0325add08a31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:41.606197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ef3f06a-51cf-4a50-8f7d-0325add08a31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:41.606883 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ef3f06a-51cf-4a50-8f7d-0325add08a31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:41.607339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ef3f06a-51cf-4a50-8f7d-0325add08a31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:41.607769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ef3f06a-51cf-4a50-8f7d-0325add08a31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:41.671311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7ef3f06a-51cf-4a50-8f7d-0325add08a31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:41.679985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7ef3f06a-51cf-4a50-8f7d-0325add08a31 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086083 Oct 28 20:23:41.680554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1232/2477] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:41 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:41.696497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e1a6b376-fd2e-4b75-8a6f-bfd7551edd5e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:41.697113 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e1a6b376-fd2e-4b75-8a6f-bfd7551edd5e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:41.699495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=52 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:41.704268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1a6b376-fd2e-4b75-8a6f-bfd7551edd5e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:41.704756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1a6b376-fd2e-4b75-8a6f-bfd7551edd5e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:41.705197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1a6b376-fd2e-4b75-8a6f-bfd7551edd5e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:41.705926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1a6b376-fd2e-4b75-8a6f-bfd7551edd5e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:41.706384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1a6b376-fd2e-4b75-8a6f-bfd7551edd5e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:41.706852 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1a6b376-fd2e-4b75-8a6f-bfd7551edd5e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:41.837022 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e1a6b376-fd2e-4b75-8a6f-bfd7551edd5e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:41.852286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e1a6b376-fd2e-4b75-8a6f-bfd7551edd5e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.159293 Oct 28 20:23:41.853184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1246/2478] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:41 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:42.703768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0b7df0f-90f0-4889-ae2a-915f88cbc51f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:42.704386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0b7df0f-90f0-4889-ae2a-915f88cbc51f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:42.711453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0b7df0f-90f0-4889-ae2a-915f88cbc51f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:42.711931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0b7df0f-90f0-4889-ae2a-915f88cbc51f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:42.712365 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0b7df0f-90f0-4889-ae2a-915f88cbc51f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:42.713044 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0b7df0f-90f0-4889-ae2a-915f88cbc51f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:42.713529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0b7df0f-90f0-4889-ae2a-915f88cbc51f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:42.713954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0b7df0f-90f0-4889-ae2a-915f88cbc51f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:42.777642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c0b7df0f-90f0-4889-ae2a-915f88cbc51f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:42.786428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c0b7df0f-90f0-4889-ae2a-915f88cbc51f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086632 Oct 28 20:23:42.786979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1233/2479] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:42 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:42.877339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-81ef9a7c-84b5-453e-8713-18961eddcb7d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:42.877965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-81ef9a7c-84b5-453e-8713-18961eddcb7d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:42.884464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81ef9a7c-84b5-453e-8713-18961eddcb7d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:42.884949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81ef9a7c-84b5-453e-8713-18961eddcb7d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:42.885420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81ef9a7c-84b5-453e-8713-18961eddcb7d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:42.886116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81ef9a7c-84b5-453e-8713-18961eddcb7d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:42.886571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81ef9a7c-84b5-453e-8713-18961eddcb7d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:42.886996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81ef9a7c-84b5-453e-8713-18961eddcb7d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:43.020232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-81ef9a7c-84b5-453e-8713-18961eddcb7d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:43.029094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-81ef9a7c-84b5-453e-8713-18961eddcb7d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.156985 Oct 28 20:23:43.029707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1247/2480] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:42 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:43.809887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7548b470-7529-43af-ad57-a306b65886e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:43.810536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7548b470-7529-43af-ad57-a306b65886e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:43.818104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7548b470-7529-43af-ad57-a306b65886e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:43.818591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7548b470-7529-43af-ad57-a306b65886e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:43.819034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7548b470-7529-43af-ad57-a306b65886e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:43.819719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7548b470-7529-43af-ad57-a306b65886e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:43.820217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7548b470-7529-43af-ad57-a306b65886e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:43.820644 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7548b470-7529-43af-ad57-a306b65886e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:43.884345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7548b470-7529-43af-ad57-a306b65886e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:43.892768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7548b470-7529-43af-ad57-a306b65886e0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086700 Oct 28 20:23:43.893348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1234/2481] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:43 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:44.055076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48cac760-7dcf-4d2f-b234-325ae9d80df8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:44.056560 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48cac760-7dcf-4d2f-b234-325ae9d80df8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:44.063344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48cac760-7dcf-4d2f-b234-325ae9d80df8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:44.063766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48cac760-7dcf-4d2f-b234-325ae9d80df8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:44.064207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48cac760-7dcf-4d2f-b234-325ae9d80df8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:44.064891 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48cac760-7dcf-4d2f-b234-325ae9d80df8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:44.065429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48cac760-7dcf-4d2f-b234-325ae9d80df8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:44.065882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48cac760-7dcf-4d2f-b234-325ae9d80df8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:44.202142 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-48cac760-7dcf-4d2f-b234-325ae9d80df8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:44.211165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48cac760-7dcf-4d2f-b234-325ae9d80df8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.162185 Oct 28 20:23:44.211765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1248/2482] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:44 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:44.915763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bdcfa0c6-5bb9-4f2e-8fec-4951c35b5878 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:44.916363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bdcfa0c6-5bb9-4f2e-8fec-4951c35b5878 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:44.922673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdcfa0c6-5bb9-4f2e-8fec-4951c35b5878 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:44.923152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdcfa0c6-5bb9-4f2e-8fec-4951c35b5878 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:44.923589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdcfa0c6-5bb9-4f2e-8fec-4951c35b5878 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:44.924273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdcfa0c6-5bb9-4f2e-8fec-4951c35b5878 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:44.924724 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdcfa0c6-5bb9-4f2e-8fec-4951c35b5878 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:44.925152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdcfa0c6-5bb9-4f2e-8fec-4951c35b5878 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:44.986177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bdcfa0c6-5bb9-4f2e-8fec-4951c35b5878 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:44.995324 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bdcfa0c6-5bb9-4f2e-8fec-4951c35b5878 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083468 Oct 28 20:23:44.995894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1235/2483] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:44 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:45.234937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-76c224a4-7452-4cd5-996e-f3f900f26504 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:45.235562 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-76c224a4-7452-4cd5-996e-f3f900f26504 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:45.242808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76c224a4-7452-4cd5-996e-f3f900f26504 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:45.243290 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76c224a4-7452-4cd5-996e-f3f900f26504 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:45.243727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76c224a4-7452-4cd5-996e-f3f900f26504 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:45.244406 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76c224a4-7452-4cd5-996e-f3f900f26504 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:45.244859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76c224a4-7452-4cd5-996e-f3f900f26504 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:45.245281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76c224a4-7452-4cd5-996e-f3f900f26504 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:45.376548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-76c224a4-7452-4cd5-996e-f3f900f26504 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:45.385524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-76c224a4-7452-4cd5-996e-f3f900f26504 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.154397 Oct 28 20:23:45.386114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1249/2484] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:45 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:46.018898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-91ee3e42-a7fb-415e-bdb6-83baf4a11e27 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:46.019561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-91ee3e42-a7fb-415e-bdb6-83baf4a11e27 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:46.026641 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91ee3e42-a7fb-415e-bdb6-83baf4a11e27 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:46.028479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91ee3e42-a7fb-415e-bdb6-83baf4a11e27 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:46.028479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91ee3e42-a7fb-415e-bdb6-83baf4a11e27 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:46.028479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91ee3e42-a7fb-415e-bdb6-83baf4a11e27 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:46.028796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91ee3e42-a7fb-415e-bdb6-83baf4a11e27 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:46.029112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91ee3e42-a7fb-415e-bdb6-83baf4a11e27 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:46.093899 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-91ee3e42-a7fb-415e-bdb6-83baf4a11e27 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:46.102914 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-91ee3e42-a7fb-415e-bdb6-83baf4a11e27 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087840 Oct 28 20:23:46.103475 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1236/2485] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:46 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:46.409058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e5f013c9-c10c-4e59-b9e1-0876ef0a7543 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:46.409647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e5f013c9-c10c-4e59-b9e1-0876ef0a7543 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:46.415986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5f013c9-c10c-4e59-b9e1-0876ef0a7543 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:46.416465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5f013c9-c10c-4e59-b9e1-0876ef0a7543 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:46.416899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5f013c9-c10c-4e59-b9e1-0876ef0a7543 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:46.417599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5f013c9-c10c-4e59-b9e1-0876ef0a7543 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:46.418051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5f013c9-c10c-4e59-b9e1-0876ef0a7543 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:46.418581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5f013c9-c10c-4e59-b9e1-0876ef0a7543 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:46.708179 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e5f013c9-c10c-4e59-b9e1-0876ef0a7543 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:46.716843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e5f013c9-c10c-4e59-b9e1-0876ef0a7543 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.311680 Oct 28 20:23:46.717429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1250/2486] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:46 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:47.126048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7786adfc-d16f-4759-bc08-e286b16359bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:47.126659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7786adfc-d16f-4759-bc08-e286b16359bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:47.133068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7786adfc-d16f-4759-bc08-e286b16359bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:47.133572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7786adfc-d16f-4759-bc08-e286b16359bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:47.134000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7786adfc-d16f-4759-bc08-e286b16359bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:47.134670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7786adfc-d16f-4759-bc08-e286b16359bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:47.135116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7786adfc-d16f-4759-bc08-e286b16359bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:47.135532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7786adfc-d16f-4759-bc08-e286b16359bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:47.195885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7786adfc-d16f-4759-bc08-e286b16359bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:47.203943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7786adfc-d16f-4759-bc08-e286b16359bf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.081748 Oct 28 20:23:47.204500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1237/2487] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:47 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:47.741381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4fe1d2c4-bdb3-4cea-b65e-914bc4ac950a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:47.741918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4fe1d2c4-bdb3-4cea-b65e-914bc4ac950a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:47.748231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fe1d2c4-bdb3-4cea-b65e-914bc4ac950a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:47.748714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fe1d2c4-bdb3-4cea-b65e-914bc4ac950a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:47.749151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fe1d2c4-bdb3-4cea-b65e-914bc4ac950a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:47.749860 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fe1d2c4-bdb3-4cea-b65e-914bc4ac950a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:47.750322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fe1d2c4-bdb3-4cea-b65e-914bc4ac950a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:47.750738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fe1d2c4-bdb3-4cea-b65e-914bc4ac950a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:47.893112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4fe1d2c4-bdb3-4cea-b65e-914bc4ac950a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:47.901659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4fe1d2c4-bdb3-4cea-b65e-914bc4ac950a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.165115 Oct 28 20:23:47.902222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1251/2488] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:47 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:48.228198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-53a271b6-ef2d-42f3-8ca5-a81084910aa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:48.228814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-53a271b6-ef2d-42f3-8ca5-a81084910aa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:48.235228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53a271b6-ef2d-42f3-8ca5-a81084910aa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:48.235708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53a271b6-ef2d-42f3-8ca5-a81084910aa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:48.236141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53a271b6-ef2d-42f3-8ca5-a81084910aa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:48.236821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53a271b6-ef2d-42f3-8ca5-a81084910aa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:48.237270 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53a271b6-ef2d-42f3-8ca5-a81084910aa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:48.237715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53a271b6-ef2d-42f3-8ca5-a81084910aa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:48.301300 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-53a271b6-ef2d-42f3-8ca5-a81084910aa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:48.309436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-53a271b6-ef2d-42f3-8ca5-a81084910aa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085075 Oct 28 20:23:48.310002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1238/2489] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:48 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:48.924085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f74a6841-27f3-4d90-8017-685bcde8a4c7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:48.924752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f74a6841-27f3-4d90-8017-685bcde8a4c7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:48.931167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f74a6841-27f3-4d90-8017-685bcde8a4c7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:48.931647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f74a6841-27f3-4d90-8017-685bcde8a4c7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:48.933807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f74a6841-27f3-4d90-8017-685bcde8a4c7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:48.933807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f74a6841-27f3-4d90-8017-685bcde8a4c7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:48.933807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f74a6841-27f3-4d90-8017-685bcde8a4c7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:48.933807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f74a6841-27f3-4d90-8017-685bcde8a4c7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:49.061216 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f74a6841-27f3-4d90-8017-685bcde8a4c7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:49.069916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f74a6841-27f3-4d90-8017-685bcde8a4c7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149863 Oct 28 20:23:49.070465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1252/2490] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:48 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:49.332080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-87737b06-9abd-4449-b6be-ba4eaf3781ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:49.332849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-87737b06-9abd-4449-b6be-ba4eaf3781ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:49.339329 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87737b06-9abd-4449-b6be-ba4eaf3781ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:49.339813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87737b06-9abd-4449-b6be-ba4eaf3781ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:49.340249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87737b06-9abd-4449-b6be-ba4eaf3781ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:49.341256 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87737b06-9abd-4449-b6be-ba4eaf3781ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:49.341750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87737b06-9abd-4449-b6be-ba4eaf3781ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:49.342159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87737b06-9abd-4449-b6be-ba4eaf3781ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:49.407135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-87737b06-9abd-4449-b6be-ba4eaf3781ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:49.411751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:49.416693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-87737b06-9abd-4449-b6be-ba4eaf3781ad tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.088598 Oct 28 20:23:49.417265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1239/2491] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:49 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:50.094041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0ed1d90e-59a3-45b8-950c-23a9cec95703 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:50.094646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0ed1d90e-59a3-45b8-950c-23a9cec95703 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:50.101099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed1d90e-59a3-45b8-950c-23a9cec95703 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:50.101607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed1d90e-59a3-45b8-950c-23a9cec95703 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:50.102039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed1d90e-59a3-45b8-950c-23a9cec95703 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:50.102712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed1d90e-59a3-45b8-950c-23a9cec95703 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:50.103158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed1d90e-59a3-45b8-950c-23a9cec95703 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:50.103574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed1d90e-59a3-45b8-950c-23a9cec95703 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:50.234734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0ed1d90e-59a3-45b8-950c-23a9cec95703 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:50.239504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0ed1d90e-59a3-45b8-950c-23a9cec95703 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149607 Oct 28 20:23:50.240060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1253/2492] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:50 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:50.439847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-22270f3b-0611-4b77-8d85-c8f8ffc1f223 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:50.440384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22270f3b-0611-4b77-8d85-c8f8ffc1f223 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:50.447801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22270f3b-0611-4b77-8d85-c8f8ffc1f223 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:50.448277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22270f3b-0611-4b77-8d85-c8f8ffc1f223 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:50.448713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22270f3b-0611-4b77-8d85-c8f8ffc1f223 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:50.449407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22270f3b-0611-4b77-8d85-c8f8ffc1f223 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:50.449856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22270f3b-0611-4b77-8d85-c8f8ffc1f223 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:50.450274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22270f3b-0611-4b77-8d85-c8f8ffc1f223 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:50.511519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-22270f3b-0611-4b77-8d85-c8f8ffc1f223 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:50.520766 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-22270f3b-0611-4b77-8d85-c8f8ffc1f223 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084871 Oct 28 20:23:50.521352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1240/2493] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:50 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:51.262580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-edb0ba22-7cb4-4481-af8e-3399816b541d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:51.263183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-edb0ba22-7cb4-4481-af8e-3399816b541d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:51.270074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edb0ba22-7cb4-4481-af8e-3399816b541d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:51.270487 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edb0ba22-7cb4-4481-af8e-3399816b541d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:51.270925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edb0ba22-7cb4-4481-af8e-3399816b541d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:51.271624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edb0ba22-7cb4-4481-af8e-3399816b541d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:51.272066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edb0ba22-7cb4-4481-af8e-3399816b541d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:51.272479 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edb0ba22-7cb4-4481-af8e-3399816b541d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:51.274983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:51.403808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-edb0ba22-7cb4-4481-af8e-3399816b541d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:51.411926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-edb0ba22-7cb4-4481-af8e-3399816b541d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.153166 Oct 28 20:23:51.412486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1254/2494] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:51 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:51.543981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd4c80b5-fe7f-44a0-a60b-a75a32e87776 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:51.544636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd4c80b5-fe7f-44a0-a60b-a75a32e87776 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:51.552148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd4c80b5-fe7f-44a0-a60b-a75a32e87776 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:51.552629 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd4c80b5-fe7f-44a0-a60b-a75a32e87776 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:51.553070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd4c80b5-fe7f-44a0-a60b-a75a32e87776 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:51.553795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd4c80b5-fe7f-44a0-a60b-a75a32e87776 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:51.554254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd4c80b5-fe7f-44a0-a60b-a75a32e87776 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:51.554685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd4c80b5-fe7f-44a0-a60b-a75a32e87776 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:51.617399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fd4c80b5-fe7f-44a0-a60b-a75a32e87776 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:51.625474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd4c80b5-fe7f-44a0-a60b-a75a32e87776 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085378 Oct 28 20:23:51.629779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1241/2495] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:51 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:52.435069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d8f9078e-ce17-401d-a74c-7ac997ce28d4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:52.435617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d8f9078e-ce17-401d-a74c-7ac997ce28d4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:52.442136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8f9078e-ce17-401d-a74c-7ac997ce28d4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:52.442612 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8f9078e-ce17-401d-a74c-7ac997ce28d4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:52.443047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8f9078e-ce17-401d-a74c-7ac997ce28d4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:52.443723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8f9078e-ce17-401d-a74c-7ac997ce28d4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:52.444169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8f9078e-ce17-401d-a74c-7ac997ce28d4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:52.444587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8f9078e-ce17-401d-a74c-7ac997ce28d4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:52.572745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d8f9078e-ce17-401d-a74c-7ac997ce28d4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:52.580745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d8f9078e-ce17-401d-a74c-7ac997ce28d4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149576 Oct 28 20:23:52.581302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1255/2496] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:52 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:52.648933 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c8eb24cd-9566-4b00-bd41-2b4f13e3c673 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:52.649633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c8eb24cd-9566-4b00-bd41-2b4f13e3c673 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:52.656055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8eb24cd-9566-4b00-bd41-2b4f13e3c673 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:52.656542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8eb24cd-9566-4b00-bd41-2b4f13e3c673 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:52.656983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8eb24cd-9566-4b00-bd41-2b4f13e3c673 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:52.657706 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8eb24cd-9566-4b00-bd41-2b4f13e3c673 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:52.658162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8eb24cd-9566-4b00-bd41-2b4f13e3c673 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:52.658591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8eb24cd-9566-4b00-bd41-2b4f13e3c673 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:52.722982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c8eb24cd-9566-4b00-bd41-2b4f13e3c673 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:52.731101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c8eb24cd-9566-4b00-bd41-2b4f13e3c673 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085991 Oct 28 20:23:52.731665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1242/2497] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:52 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:53.608841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6c25fca3-2e59-497a-a578-fce3d0c30288 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:53.609978 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6c25fca3-2e59-497a-a578-fce3d0c30288 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:53.619904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c25fca3-2e59-497a-a578-fce3d0c30288 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:53.620686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c25fca3-2e59-497a-a578-fce3d0c30288 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:53.621433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c25fca3-2e59-497a-a578-fce3d0c30288 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:53.622548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c25fca3-2e59-497a-a578-fce3d0c30288 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:53.623379 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c25fca3-2e59-497a-a578-fce3d0c30288 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:53.624139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c25fca3-2e59-497a-a578-fce3d0c30288 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:53.755608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9bc1ece5-65f2-43db-a40a-40470aa7ecf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:53.756572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9bc1ece5-65f2-43db-a40a-40470aa7ecf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:53.764203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bc1ece5-65f2-43db-a40a-40470aa7ecf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:53.764690 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bc1ece5-65f2-43db-a40a-40470aa7ecf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:53.765376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bc1ece5-65f2-43db-a40a-40470aa7ecf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:53.766083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bc1ece5-65f2-43db-a40a-40470aa7ecf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:53.766536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bc1ece5-65f2-43db-a40a-40470aa7ecf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:53.766961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bc1ece5-65f2-43db-a40a-40470aa7ecf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:53.802547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6c25fca3-2e59-497a-a578-fce3d0c30288 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:53.812723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6c25fca3-2e59-497a-a578-fce3d0c30288 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.209000 Oct 28 20:23:53.812723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1256/2498] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:53 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:53.837666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9bc1ece5-65f2-43db-a40a-40470aa7ecf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:53.847804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9bc1ece5-65f2-43db-a40a-40470aa7ecf7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.098178 Oct 28 20:23:53.848842 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1243/2499] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:53 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:54.840019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3ee3f875-478e-4019-adae-12b10836d8f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:54.840876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3ee3f875-478e-4019-adae-12b10836d8f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:54.848103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ee3f875-478e-4019-adae-12b10836d8f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:54.848618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ee3f875-478e-4019-adae-12b10836d8f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:54.849054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ee3f875-478e-4019-adae-12b10836d8f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:54.849770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ee3f875-478e-4019-adae-12b10836d8f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:54.850222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ee3f875-478e-4019-adae-12b10836d8f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:54.850644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ee3f875-478e-4019-adae-12b10836d8f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:54.872083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1d99dd2c-a7b8-4bff-ab21-3a8307078bb7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:54.872696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1d99dd2c-a7b8-4bff-ab21-3a8307078bb7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:54.878698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d99dd2c-a7b8-4bff-ab21-3a8307078bb7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:54.879184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d99dd2c-a7b8-4bff-ab21-3a8307078bb7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:54.879611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d99dd2c-a7b8-4bff-ab21-3a8307078bb7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:54.880289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d99dd2c-a7b8-4bff-ab21-3a8307078bb7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:54.880737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d99dd2c-a7b8-4bff-ab21-3a8307078bb7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:54.881159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d99dd2c-a7b8-4bff-ab21-3a8307078bb7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:54.951594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1d99dd2c-a7b8-4bff-ab21-3a8307078bb7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:54.960003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1d99dd2c-a7b8-4bff-ab21-3a8307078bb7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.091885 Oct 28 20:23:54.960687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1244/2500] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:54 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:55.007422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3ee3f875-478e-4019-adae-12b10836d8f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:55.015654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3ee3f875-478e-4019-adae-12b10836d8f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.179891 Oct 28 20:23:55.016209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1257/2501] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:54 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:55.983273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b8a11817-9eb3-41c1-9e7e-73573c42c9eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:55.983894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b8a11817-9eb3-41c1-9e7e-73573c42c9eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:55.991190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8a11817-9eb3-41c1-9e7e-73573c42c9eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:55.991680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8a11817-9eb3-41c1-9e7e-73573c42c9eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:55.992124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8a11817-9eb3-41c1-9e7e-73573c42c9eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:55.992813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8a11817-9eb3-41c1-9e7e-73573c42c9eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:55.993271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8a11817-9eb3-41c1-9e7e-73573c42c9eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:55.993729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8a11817-9eb3-41c1-9e7e-73573c42c9eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:56.039488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1a6d087-61d7-455a-9d79-5b00c6684f68 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:56.040133 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f1a6d087-61d7-455a-9d79-5b00c6684f68 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:56.046704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1a6d087-61d7-455a-9d79-5b00c6684f68 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:56.047186 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1a6d087-61d7-455a-9d79-5b00c6684f68 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:56.047625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1a6d087-61d7-455a-9d79-5b00c6684f68 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:56.048313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1a6d087-61d7-455a-9d79-5b00c6684f68 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:56.048770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1a6d087-61d7-455a-9d79-5b00c6684f68 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:56.049196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1a6d087-61d7-455a-9d79-5b00c6684f68 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:56.058043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b8a11817-9eb3-41c1-9e7e-73573c42c9eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:56.066828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b8a11817-9eb3-41c1-9e7e-73573c42c9eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086870 Oct 28 20:23:56.067707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1245/2502] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:55 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:56.188211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1a6d087-61d7-455a-9d79-5b00c6684f68 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:56.196603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1a6d087-61d7-455a-9d79-5b00c6684f68 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.160970 Oct 28 20:23:56.197168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1258/2503] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:56 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:57.093905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-994f0e0a-160a-41c0-8e1a-2a50e388a390 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:57.094524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-994f0e0a-160a-41c0-8e1a-2a50e388a390 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:57.101484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-994f0e0a-160a-41c0-8e1a-2a50e388a390 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:57.101970 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-994f0e0a-160a-41c0-8e1a-2a50e388a390 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:57.102410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-994f0e0a-160a-41c0-8e1a-2a50e388a390 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:57.103094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-994f0e0a-160a-41c0-8e1a-2a50e388a390 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:57.103548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-994f0e0a-160a-41c0-8e1a-2a50e388a390 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:57.103971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-994f0e0a-160a-41c0-8e1a-2a50e388a390 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:57.168359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-994f0e0a-160a-41c0-8e1a-2a50e388a390 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:57.177070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-994f0e0a-160a-41c0-8e1a-2a50e388a390 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087344 Oct 28 20:23:57.177680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1246/2504] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:57 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:57.220459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8c00822e-2c49-452d-8d9f-e605186c737a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:57.221086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8c00822e-2c49-452d-8d9f-e605186c737a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:57.227912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c00822e-2c49-452d-8d9f-e605186c737a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:57.228384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c00822e-2c49-452d-8d9f-e605186c737a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:57.228811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c00822e-2c49-452d-8d9f-e605186c737a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:57.229511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c00822e-2c49-452d-8d9f-e605186c737a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:57.229955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c00822e-2c49-452d-8d9f-e605186c737a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:57.230410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c00822e-2c49-452d-8d9f-e605186c737a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:57.359115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8c00822e-2c49-452d-8d9f-e605186c737a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:57.368274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8c00822e-2c49-452d-8d9f-e605186c737a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151553 Oct 28 20:23:57.368894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1259/2505] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:57 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:58.199784 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fcbff378-1b02-49d4-abe9-b4ff6022b557 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:58.200402 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fcbff378-1b02-49d4-abe9-b4ff6022b557 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:58.202388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:23:58.202536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:23:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 (ip 10.222.0.66) !!! Oct 28 20:23:58.209830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcbff378-1b02-49d4-abe9-b4ff6022b557 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:58.210323 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcbff378-1b02-49d4-abe9-b4ff6022b557 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:58.210763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcbff378-1b02-49d4-abe9-b4ff6022b557 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:58.211453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcbff378-1b02-49d4-abe9-b4ff6022b557 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:58.211911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcbff378-1b02-49d4-abe9-b4ff6022b557 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:58.212339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcbff378-1b02-49d4-abe9-b4ff6022b557 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:58.276039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fcbff378-1b02-49d4-abe9-b4ff6022b557 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:58.284135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fcbff378-1b02-49d4-abe9-b4ff6022b557 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.088238 Oct 28 20:23:58.284703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1247/2506] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:58 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:58.391222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-38328100-e055-49ff-8d9b-e0d53c2c635a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:58.391862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-38328100-e055-49ff-8d9b-e0d53c2c635a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:58.398168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38328100-e055-49ff-8d9b-e0d53c2c635a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:58.398642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38328100-e055-49ff-8d9b-e0d53c2c635a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:58.399074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38328100-e055-49ff-8d9b-e0d53c2c635a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:58.399758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38328100-e055-49ff-8d9b-e0d53c2c635a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:58.400203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38328100-e055-49ff-8d9b-e0d53c2c635a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:58.400617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38328100-e055-49ff-8d9b-e0d53c2c635a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:58.530301 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-38328100-e055-49ff-8d9b-e0d53c2c635a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:58.538570 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-38328100-e055-49ff-8d9b-e0d53c2c635a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151179 Oct 28 20:23:58.539132 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1260/2507] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:58 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:59.306754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d59e3ce-2fe6-4456-b89e-7603405265eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:59.307367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6d59e3ce-2fe6-4456-b89e-7603405265eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:59.313821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d59e3ce-2fe6-4456-b89e-7603405265eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:59.314302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d59e3ce-2fe6-4456-b89e-7603405265eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:59.314737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d59e3ce-2fe6-4456-b89e-7603405265eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:59.315423 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d59e3ce-2fe6-4456-b89e-7603405265eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:59.316643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d59e3ce-2fe6-4456-b89e-7603405265eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:59.317121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d59e3ce-2fe6-4456-b89e-7603405265eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:59.377271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6d59e3ce-2fe6-4456-b89e-7603405265eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:59.385911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6d59e3ce-2fe6-4456-b89e-7603405265eb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082990 Oct 28 20:23:59.386472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1248/2508] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:59 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:59.562288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2e643e01-cbf6-41ae-8efd-0c69c1de9ddd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:59.562907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2e643e01-cbf6-41ae-8efd-0c69c1de9ddd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:59.570217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e643e01-cbf6-41ae-8efd-0c69c1de9ddd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:59.570702 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e643e01-cbf6-41ae-8efd-0c69c1de9ddd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:59.571143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e643e01-cbf6-41ae-8efd-0c69c1de9ddd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:59.571833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e643e01-cbf6-41ae-8efd-0c69c1de9ddd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:59.572288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e643e01-cbf6-41ae-8efd-0c69c1de9ddd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:59.572713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e643e01-cbf6-41ae-8efd-0c69c1de9ddd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:59.700814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2e643e01-cbf6-41ae-8efd-0c69c1de9ddd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:59.709569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2e643e01-cbf6-41ae-8efd-0c69c1de9ddd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151053 Oct 28 20:23:59.710124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1261/2509] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:59 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:24:00.409055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-21a91243-dc76-43d9-a69b-4fcaca5ef757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:00.409761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-21a91243-dc76-43d9-a69b-4fcaca5ef757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:00.416041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21a91243-dc76-43d9-a69b-4fcaca5ef757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:00.416521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21a91243-dc76-43d9-a69b-4fcaca5ef757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:00.416953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21a91243-dc76-43d9-a69b-4fcaca5ef757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:00.417661 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21a91243-dc76-43d9-a69b-4fcaca5ef757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:00.418117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21a91243-dc76-43d9-a69b-4fcaca5ef757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:00.418534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21a91243-dc76-43d9-a69b-4fcaca5ef757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:00.482795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-21a91243-dc76-43d9-a69b-4fcaca5ef757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:00.491416 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-21a91243-dc76-43d9-a69b-4fcaca5ef757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086160 Oct 28 20:24:00.491972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1249/2510] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:00 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:00.733597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ddfcbea-03ad-4649-96a3-06ae647b67a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:00.734234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ddfcbea-03ad-4649-96a3-06ae647b67a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:00.741207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ddfcbea-03ad-4649-96a3-06ae647b67a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:00.741731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ddfcbea-03ad-4649-96a3-06ae647b67a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:00.742174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ddfcbea-03ad-4649-96a3-06ae647b67a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:00.742868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ddfcbea-03ad-4649-96a3-06ae647b67a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:00.743323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ddfcbea-03ad-4649-96a3-06ae647b67a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:00.743751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ddfcbea-03ad-4649-96a3-06ae647b67a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:00.873239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ddfcbea-03ad-4649-96a3-06ae647b67a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:00.881523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ddfcbea-03ad-4649-96a3-06ae647b67a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151755 Oct 28 20:24:00.882082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1262/2511] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:00 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:01.514859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b055e3da-eda2-4234-a985-331d60711fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:01.515478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b055e3da-eda2-4234-a985-331d60711fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:01.522257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b055e3da-eda2-4234-a985-331d60711fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:01.522745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b055e3da-eda2-4234-a985-331d60711fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:01.523192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b055e3da-eda2-4234-a985-331d60711fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:01.524148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b055e3da-eda2-4234-a985-331d60711fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:01.524611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b055e3da-eda2-4234-a985-331d60711fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:01.525038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b055e3da-eda2-4234-a985-331d60711fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:01.586368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b055e3da-eda2-4234-a985-331d60711fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:01.594595 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b055e3da-eda2-4234-a985-331d60711fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083661 Oct 28 20:24:01.601369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1250/2512] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:01 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:01.904486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-017b4ddb-3c4e-4cb4-938f-8228930d0baf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:01.905017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-017b4ddb-3c4e-4cb4-938f-8228930d0baf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:01.911609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-017b4ddb-3c4e-4cb4-938f-8228930d0baf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:01.912095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-017b4ddb-3c4e-4cb4-938f-8228930d0baf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:01.912553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-017b4ddb-3c4e-4cb4-938f-8228930d0baf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:01.913245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-017b4ddb-3c4e-4cb4-938f-8228930d0baf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:01.913725 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-017b4ddb-3c4e-4cb4-938f-8228930d0baf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:01.914147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-017b4ddb-3c4e-4cb4-938f-8228930d0baf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:02.055259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-017b4ddb-3c4e-4cb4-938f-8228930d0baf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:02.063276 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-017b4ddb-3c4e-4cb4-938f-8228930d0baf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.162731 Oct 28 20:24:02.063825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1263/2513] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:01 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:02.622447 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-442b95a8-d019-47d7-9bc4-cae31e33cdd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:02.623099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-442b95a8-d019-47d7-9bc4-cae31e33cdd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:02.630610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-442b95a8-d019-47d7-9bc4-cae31e33cdd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:02.631099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-442b95a8-d019-47d7-9bc4-cae31e33cdd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:02.631543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-442b95a8-d019-47d7-9bc4-cae31e33cdd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:02.632230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-442b95a8-d019-47d7-9bc4-cae31e33cdd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:02.632691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-442b95a8-d019-47d7-9bc4-cae31e33cdd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:02.633121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-442b95a8-d019-47d7-9bc4-cae31e33cdd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:02.694997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-442b95a8-d019-47d7-9bc4-cae31e33cdd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:02.703000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-442b95a8-d019-47d7-9bc4-cae31e33cdd9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084445 Oct 28 20:24:02.703568 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1251/2514] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:02 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:24:03.088083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a7a753e8-720e-4adb-b4d5-3d1ecda6d7b0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:03.088703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a7a753e8-720e-4adb-b4d5-3d1ecda6d7b0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:03.095886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7a753e8-720e-4adb-b4d5-3d1ecda6d7b0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:03.096367 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7a753e8-720e-4adb-b4d5-3d1ecda6d7b0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:03.096886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7a753e8-720e-4adb-b4d5-3d1ecda6d7b0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:03.097614 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7a753e8-720e-4adb-b4d5-3d1ecda6d7b0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:03.098069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7a753e8-720e-4adb-b4d5-3d1ecda6d7b0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:03.098495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7a753e8-720e-4adb-b4d5-3d1ecda6d7b0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:03.228098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a7a753e8-720e-4adb-b4d5-3d1ecda6d7b0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:03.236236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a7a753e8-720e-4adb-b4d5-3d1ecda6d7b0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152050 Oct 28 20:24:03.236796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1264/2515] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:03 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:03.727435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-33b6b6c0-43da-44bd-a622-4091a9ae68f9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:03.728056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-33b6b6c0-43da-44bd-a622-4091a9ae68f9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:03.735070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b6b6c0-43da-44bd-a622-4091a9ae68f9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:03.735537 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b6b6c0-43da-44bd-a622-4091a9ae68f9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:03.735970 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b6b6c0-43da-44bd-a622-4091a9ae68f9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:03.736650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b6b6c0-43da-44bd-a622-4091a9ae68f9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:03.737105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b6b6c0-43da-44bd-a622-4091a9ae68f9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:03.737616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b6b6c0-43da-44bd-a622-4091a9ae68f9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:03.804269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-33b6b6c0-43da-44bd-a622-4091a9ae68f9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:03.812408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-33b6b6c0-43da-44bd-a622-4091a9ae68f9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.088904 Oct 28 20:24:03.812967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1252/2516] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:03 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:04.259825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a05c1552-63ec-4352-93ca-4bda2b65eeaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:04.260442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a05c1552-63ec-4352-93ca-4bda2b65eeaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:04.266877 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a05c1552-63ec-4352-93ca-4bda2b65eeaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:04.267374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a05c1552-63ec-4352-93ca-4bda2b65eeaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:04.267799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a05c1552-63ec-4352-93ca-4bda2b65eeaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:04.268486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a05c1552-63ec-4352-93ca-4bda2b65eeaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:04.268973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a05c1552-63ec-4352-93ca-4bda2b65eeaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:04.269419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a05c1552-63ec-4352-93ca-4bda2b65eeaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:04.394698 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a05c1552-63ec-4352-93ca-4bda2b65eeaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:04.402821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a05c1552-63ec-4352-93ca-4bda2b65eeaf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.146853 Oct 28 20:24:04.403455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1265/2517] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:04 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:04.835949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c01856dc-25cd-491a-8006-1a4839fe22dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:04.836631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c01856dc-25cd-491a-8006-1a4839fe22dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:04.843408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c01856dc-25cd-491a-8006-1a4839fe22dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:04.843890 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c01856dc-25cd-491a-8006-1a4839fe22dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:04.844329 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c01856dc-25cd-491a-8006-1a4839fe22dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:04.845012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c01856dc-25cd-491a-8006-1a4839fe22dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:04.845497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c01856dc-25cd-491a-8006-1a4839fe22dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:04.845923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c01856dc-25cd-491a-8006-1a4839fe22dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:05.059581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c01856dc-25cd-491a-8006-1a4839fe22dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:05.067673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c01856dc-25cd-491a-8006-1a4839fe22dd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.235723 Oct 28 20:24:05.068224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1253/2518] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:04 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:05.427097 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0fe9d995-9fef-4640-824b-dca47c23150a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:05.427715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0fe9d995-9fef-4640-824b-dca47c23150a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:05.434162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fe9d995-9fef-4640-824b-dca47c23150a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:05.434646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fe9d995-9fef-4640-824b-dca47c23150a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:05.435086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fe9d995-9fef-4640-824b-dca47c23150a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:05.435770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fe9d995-9fef-4640-824b-dca47c23150a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:05.436226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fe9d995-9fef-4640-824b-dca47c23150a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:05.436648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fe9d995-9fef-4640-824b-dca47c23150a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:05.569727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0fe9d995-9fef-4640-824b-dca47c23150a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:05.577756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0fe9d995-9fef-4640-824b-dca47c23150a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.155167 Oct 28 20:24:05.578308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1266/2519] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:05 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:06.091322 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1f4bc1fd-527b-46a6-97b1-0920ecfa36c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:06.091936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1f4bc1fd-527b-46a6-97b1-0920ecfa36c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:06.098474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f4bc1fd-527b-46a6-97b1-0920ecfa36c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:06.098960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f4bc1fd-527b-46a6-97b1-0920ecfa36c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:06.099397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f4bc1fd-527b-46a6-97b1-0920ecfa36c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:06.100079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f4bc1fd-527b-46a6-97b1-0920ecfa36c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:06.100533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f4bc1fd-527b-46a6-97b1-0920ecfa36c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:06.100955 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f4bc1fd-527b-46a6-97b1-0920ecfa36c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:06.160994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1f4bc1fd-527b-46a6-97b1-0920ecfa36c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:06.169093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1f4bc1fd-527b-46a6-97b1-0920ecfa36c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.081816 Oct 28 20:24:06.169664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1254/2520] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:06 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:06.601189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-457b6d4f-dfc3-4346-863a-3e7b7003b3dc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:06.601834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-457b6d4f-dfc3-4346-863a-3e7b7003b3dc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:06.608165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-457b6d4f-dfc3-4346-863a-3e7b7003b3dc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:06.608646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-457b6d4f-dfc3-4346-863a-3e7b7003b3dc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:06.609087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-457b6d4f-dfc3-4346-863a-3e7b7003b3dc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:06.609813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-457b6d4f-dfc3-4346-863a-3e7b7003b3dc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:06.610268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-457b6d4f-dfc3-4346-863a-3e7b7003b3dc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:06.610694 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-457b6d4f-dfc3-4346-863a-3e7b7003b3dc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:06.738051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-457b6d4f-dfc3-4346-863a-3e7b7003b3dc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:06.746253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-457b6d4f-dfc3-4346-863a-3e7b7003b3dc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149137 Oct 28 20:24:06.746829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1267/2521] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:06 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:07.192915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-71196b5f-0597-4992-990c-a992693bfcd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:07.193573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-71196b5f-0597-4992-990c-a992693bfcd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:07.199969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71196b5f-0597-4992-990c-a992693bfcd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:07.200452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71196b5f-0597-4992-990c-a992693bfcd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:07.200892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71196b5f-0597-4992-990c-a992693bfcd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:07.201606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71196b5f-0597-4992-990c-a992693bfcd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:07.202064 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71196b5f-0597-4992-990c-a992693bfcd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:07.202488 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71196b5f-0597-4992-990c-a992693bfcd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:07.266589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-71196b5f-0597-4992-990c-a992693bfcd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:07.274911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-71196b5f-0597-4992-990c-a992693bfcd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086876 Oct 28 20:24:07.275463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1255/2522] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:07 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:07.769415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c955709d-07da-4b69-9393-40a84749cff5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:07.769965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c955709d-07da-4b69-9393-40a84749cff5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:07.776333 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c955709d-07da-4b69-9393-40a84749cff5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:07.776805 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c955709d-07da-4b69-9393-40a84749cff5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:07.777231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c955709d-07da-4b69-9393-40a84749cff5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:07.777929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c955709d-07da-4b69-9393-40a84749cff5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:07.778375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c955709d-07da-4b69-9393-40a84749cff5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:07.779202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c955709d-07da-4b69-9393-40a84749cff5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:07.912888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c955709d-07da-4b69-9393-40a84749cff5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:07.920895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c955709d-07da-4b69-9393-40a84749cff5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.155384 Oct 28 20:24:07.921470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1268/2523] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:07 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:08.297062 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2e345be0-74ab-4c3b-9193-2473a3d274bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:08.298278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2e345be0-74ab-4c3b-9193-2473a3d274bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:08.305462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e345be0-74ab-4c3b-9193-2473a3d274bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:08.305958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e345be0-74ab-4c3b-9193-2473a3d274bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:08.306402 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e345be0-74ab-4c3b-9193-2473a3d274bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:08.307102 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e345be0-74ab-4c3b-9193-2473a3d274bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:08.307613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e345be0-74ab-4c3b-9193-2473a3d274bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:08.308048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e345be0-74ab-4c3b-9193-2473a3d274bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:08.326210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:08.370200 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2e345be0-74ab-4c3b-9193-2473a3d274bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:08.378533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2e345be0-74ab-4c3b-9193-2473a3d274bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085210 Oct 28 20:24:08.379119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1256/2524] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:08 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:08.943683 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7f3058bc-6427-403f-84ba-8a971b3dee3b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:08.944294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7f3058bc-6427-403f-84ba-8a971b3dee3b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:08.950747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f3058bc-6427-403f-84ba-8a971b3dee3b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:08.951227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f3058bc-6427-403f-84ba-8a971b3dee3b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:08.951668 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f3058bc-6427-403f-84ba-8a971b3dee3b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:08.952381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f3058bc-6427-403f-84ba-8a971b3dee3b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:08.952836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f3058bc-6427-403f-84ba-8a971b3dee3b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:08.953261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f3058bc-6427-403f-84ba-8a971b3dee3b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:09.085678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7f3058bc-6427-403f-84ba-8a971b3dee3b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:09.094180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7f3058bc-6427-403f-84ba-8a971b3dee3b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.154359 Oct 28 20:24:09.094741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1269/2525] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:08 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:09.401136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a8e7b87-ccde-468c-8cd1-f181e1ffc062 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:09.401737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3a8e7b87-ccde-468c-8cd1-f181e1ffc062 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:09.403933 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=56 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:09.408532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a8e7b87-ccde-468c-8cd1-f181e1ffc062 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:09.409038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a8e7b87-ccde-468c-8cd1-f181e1ffc062 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:09.409473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a8e7b87-ccde-468c-8cd1-f181e1ffc062 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:09.410159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a8e7b87-ccde-468c-8cd1-f181e1ffc062 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:09.410603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a8e7b87-ccde-468c-8cd1-f181e1ffc062 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:09.411022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a8e7b87-ccde-468c-8cd1-f181e1ffc062 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:09.472917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a8e7b87-ccde-468c-8cd1-f181e1ffc062 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:09.481375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a8e7b87-ccde-468c-8cd1-f181e1ffc062 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083778 Oct 28 20:24:09.481495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1257/2526] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:09 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:10.118335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9278730c-db86-4ea4-93f4-75b96b66d396 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:10.118949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9278730c-db86-4ea4-93f4-75b96b66d396 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:10.125560 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9278730c-db86-4ea4-93f4-75b96b66d396 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:10.126046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9278730c-db86-4ea4-93f4-75b96b66d396 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:10.126488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9278730c-db86-4ea4-93f4-75b96b66d396 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:10.127180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9278730c-db86-4ea4-93f4-75b96b66d396 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:10.127644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9278730c-db86-4ea4-93f4-75b96b66d396 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:10.128118 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9278730c-db86-4ea4-93f4-75b96b66d396 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:10.257313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9278730c-db86-4ea4-93f4-75b96b66d396 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:10.259537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:10.266099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9278730c-db86-4ea4-93f4-75b96b66d396 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151646 Oct 28 20:24:10.266655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1270/2527] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:10 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:10.504287 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-779e5241-4807-4936-aa78-48592b07d8dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:10.504912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-779e5241-4807-4936-aa78-48592b07d8dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:10.511387 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-779e5241-4807-4936-aa78-48592b07d8dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:10.511877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-779e5241-4807-4936-aa78-48592b07d8dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:10.512318 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-779e5241-4807-4936-aa78-48592b07d8dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:10.513010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-779e5241-4807-4936-aa78-48592b07d8dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:10.513496 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-779e5241-4807-4936-aa78-48592b07d8dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:10.513929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-779e5241-4807-4936-aa78-48592b07d8dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:10.577565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-779e5241-4807-4936-aa78-48592b07d8dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:10.586441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-779e5241-4807-4936-aa78-48592b07d8dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086121 Oct 28 20:24:10.586997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1258/2528] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:10 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:11.290435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-70fb06fa-d3f4-424b-9676-d1ce9d18a607 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:11.291001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-70fb06fa-d3f4-424b-9676-d1ce9d18a607 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:11.297442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fb06fa-d3f4-424b-9676-d1ce9d18a607 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:11.297924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fb06fa-d3f4-424b-9676-d1ce9d18a607 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:11.298361 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fb06fa-d3f4-424b-9676-d1ce9d18a607 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:11.299050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fb06fa-d3f4-424b-9676-d1ce9d18a607 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:11.299500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fb06fa-d3f4-424b-9676-d1ce9d18a607 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:11.300842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fb06fa-d3f4-424b-9676-d1ce9d18a607 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:11.426584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-70fb06fa-d3f4-424b-9676-d1ce9d18a607 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:11.434689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-70fb06fa-d3f4-424b-9676-d1ce9d18a607 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.148618 Oct 28 20:24:11.435260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1271/2529] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:11 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:11.609608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-69a99110-d14c-49e2-820f-47bd44e42836 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:11.610155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-69a99110-d14c-49e2-820f-47bd44e42836 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:11.616637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69a99110-d14c-49e2-820f-47bd44e42836 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:11.617136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69a99110-d14c-49e2-820f-47bd44e42836 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:11.617592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69a99110-d14c-49e2-820f-47bd44e42836 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:11.618278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69a99110-d14c-49e2-820f-47bd44e42836 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:11.618731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69a99110-d14c-49e2-820f-47bd44e42836 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:11.619157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69a99110-d14c-49e2-820f-47bd44e42836 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:11.682533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-69a99110-d14c-49e2-820f-47bd44e42836 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:11.689450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-69a99110-d14c-49e2-820f-47bd44e42836 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083828 Oct 28 20:24:11.690004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1259/2530] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:11 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:24:12.459480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-73968184-85d6-4e2b-9553-7b5db9c0f101 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:12.460115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-73968184-85d6-4e2b-9553-7b5db9c0f101 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:12.462124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:24:12.462287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:24:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a (ip 10.222.0.66) !!! Oct 28 20:24:12.463621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=52 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:12.469419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73968184-85d6-4e2b-9553-7b5db9c0f101 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:12.469901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73968184-85d6-4e2b-9553-7b5db9c0f101 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:12.470330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73968184-85d6-4e2b-9553-7b5db9c0f101 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:12.481632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73968184-85d6-4e2b-9553-7b5db9c0f101 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:12.481632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73968184-85d6-4e2b-9553-7b5db9c0f101 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:12.481632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73968184-85d6-4e2b-9553-7b5db9c0f101 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:12.605501 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-73968184-85d6-4e2b-9553-7b5db9c0f101 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:12.614190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-73968184-85d6-4e2b-9553-7b5db9c0f101 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.159212 Oct 28 20:24:12.614759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1272/2531] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:12 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:12.712219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03f3acc1-2724-4f36-950d-2973f62c1648 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:12.712745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-03f3acc1-2724-4f36-950d-2973f62c1648 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:12.714832 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:24:12.714980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:24:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 (ip 10.222.0.66) !!! Oct 28 20:24:12.721692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03f3acc1-2724-4f36-950d-2973f62c1648 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:12.722217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03f3acc1-2724-4f36-950d-2973f62c1648 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:12.722724 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03f3acc1-2724-4f36-950d-2973f62c1648 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:12.723423 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03f3acc1-2724-4f36-950d-2973f62c1648 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:12.723877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03f3acc1-2724-4f36-950d-2973f62c1648 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:12.724305 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03f3acc1-2724-4f36-950d-2973f62c1648 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:12.786081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-03f3acc1-2724-4f36-950d-2973f62c1648 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:12.794219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-03f3acc1-2724-4f36-950d-2973f62c1648 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085888 Oct 28 20:24:12.794786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1260/2532] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:12 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:13.638185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-da3bd139-565e-4a22-bf46-0af62d0c8831 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:13.638723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-da3bd139-565e-4a22-bf46-0af62d0c8831 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:13.645882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da3bd139-565e-4a22-bf46-0af62d0c8831 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:13.646363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da3bd139-565e-4a22-bf46-0af62d0c8831 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:13.646802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da3bd139-565e-4a22-bf46-0af62d0c8831 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:13.647489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da3bd139-565e-4a22-bf46-0af62d0c8831 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:13.647949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da3bd139-565e-4a22-bf46-0af62d0c8831 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:13.648369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da3bd139-565e-4a22-bf46-0af62d0c8831 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:13.776073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-da3bd139-565e-4a22-bf46-0af62d0c8831 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:13.784166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-da3bd139-565e-4a22-bf46-0af62d0c8831 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149903 Oct 28 20:24:13.784814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1273/2533] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:13 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:13.818269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2cbf2288-6e8c-4679-935b-c388d16c6e9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:13.818914 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2cbf2288-6e8c-4679-935b-c388d16c6e9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:13.825241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cbf2288-6e8c-4679-935b-c388d16c6e9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:13.825761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cbf2288-6e8c-4679-935b-c388d16c6e9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:13.826199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cbf2288-6e8c-4679-935b-c388d16c6e9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:13.826885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cbf2288-6e8c-4679-935b-c388d16c6e9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:13.827343 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cbf2288-6e8c-4679-935b-c388d16c6e9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:13.827772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cbf2288-6e8c-4679-935b-c388d16c6e9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:13.891168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2cbf2288-6e8c-4679-935b-c388d16c6e9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:13.899964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2cbf2288-6e8c-4679-935b-c388d16c6e9c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086079 Oct 28 20:24:13.900529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1261/2534] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:13 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:14.806846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-92647f19-e14d-4e6c-9e3f-bc9938b35310 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:14.807499 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-92647f19-e14d-4e6c-9e3f-bc9938b35310 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:14.814099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92647f19-e14d-4e6c-9e3f-bc9938b35310 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:14.814635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92647f19-e14d-4e6c-9e3f-bc9938b35310 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:14.815131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92647f19-e14d-4e6c-9e3f-bc9938b35310 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:14.815816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92647f19-e14d-4e6c-9e3f-bc9938b35310 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:14.816334 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92647f19-e14d-4e6c-9e3f-bc9938b35310 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:14.816762 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92647f19-e14d-4e6c-9e3f-bc9938b35310 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:14.922749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a4711e57-15bf-409e-b75d-a536398bd8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:14.923300 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a4711e57-15bf-409e-b75d-a536398bd8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:14.930370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4711e57-15bf-409e-b75d-a536398bd8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:14.930862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4711e57-15bf-409e-b75d-a536398bd8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:14.931340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4711e57-15bf-409e-b75d-a536398bd8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:14.932043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4711e57-15bf-409e-b75d-a536398bd8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:14.932502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4711e57-15bf-409e-b75d-a536398bd8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:14.932931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4711e57-15bf-409e-b75d-a536398bd8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:14.947487 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-92647f19-e14d-4e6c-9e3f-bc9938b35310 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:14.955590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-92647f19-e14d-4e6c-9e3f-bc9938b35310 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152666 Oct 28 20:24:14.961484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1274/2535] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:14 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:14.995711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a4711e57-15bf-409e-b75d-a536398bd8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:15.005027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a4711e57-15bf-409e-b75d-a536398bd8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086352 Oct 28 20:24:15.005629 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1262/2536] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:14 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:24:15.979513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fea68d51-c7f0-4956-95db-b7971f532392 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:15.980127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fea68d51-c7f0-4956-95db-b7971f532392 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:15.986507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fea68d51-c7f0-4956-95db-b7971f532392 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:15.986984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fea68d51-c7f0-4956-95db-b7971f532392 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:15.988135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fea68d51-c7f0-4956-95db-b7971f532392 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:15.988894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fea68d51-c7f0-4956-95db-b7971f532392 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:15.989368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fea68d51-c7f0-4956-95db-b7971f532392 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:15.989797 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fea68d51-c7f0-4956-95db-b7971f532392 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:16.028460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ba497cb4-a482-43c9-b9ad-e83ac947562b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:16.029147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ba497cb4-a482-43c9-b9ad-e83ac947562b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:16.036806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba497cb4-a482-43c9-b9ad-e83ac947562b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:16.037296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba497cb4-a482-43c9-b9ad-e83ac947562b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:16.037759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba497cb4-a482-43c9-b9ad-e83ac947562b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:16.038453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba497cb4-a482-43c9-b9ad-e83ac947562b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:16.038901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba497cb4-a482-43c9-b9ad-e83ac947562b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:16.039322 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba497cb4-a482-43c9-b9ad-e83ac947562b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:16.112321 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ba497cb4-a482-43c9-b9ad-e83ac947562b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:16.121019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ba497cb4-a482-43c9-b9ad-e83ac947562b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.096367 Oct 28 20:24:16.121612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1263/2537] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:16 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:24:16.141730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fea68d51-c7f0-4956-95db-b7971f532392 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:16.149776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fea68d51-c7f0-4956-95db-b7971f532392 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.174119 Oct 28 20:24:16.150331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1275/2538] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:15 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:17.143968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2b6fcaf5-ad0f-4ed8-a624-031a129fb42b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:17.144620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2b6fcaf5-ad0f-4ed8-a624-031a129fb42b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:17.151941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b6fcaf5-ad0f-4ed8-a624-031a129fb42b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:17.152427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b6fcaf5-ad0f-4ed8-a624-031a129fb42b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:17.152866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b6fcaf5-ad0f-4ed8-a624-031a129fb42b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:17.153586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b6fcaf5-ad0f-4ed8-a624-031a129fb42b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:17.154046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b6fcaf5-ad0f-4ed8-a624-031a129fb42b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:17.154474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b6fcaf5-ad0f-4ed8-a624-031a129fb42b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:17.174316 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2426e45-32fe-4b68-8856-3e95b596e276 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:17.175047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2426e45-32fe-4b68-8856-3e95b596e276 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:17.181572 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2426e45-32fe-4b68-8856-3e95b596e276 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:17.182049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2426e45-32fe-4b68-8856-3e95b596e276 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:17.182480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2426e45-32fe-4b68-8856-3e95b596e276 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:17.183157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2426e45-32fe-4b68-8856-3e95b596e276 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:17.183605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2426e45-32fe-4b68-8856-3e95b596e276 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:17.184021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2426e45-32fe-4b68-8856-3e95b596e276 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:17.216690 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2b6fcaf5-ad0f-4ed8-a624-031a129fb42b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:17.225575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2b6fcaf5-ad0f-4ed8-a624-031a129fb42b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085416 Oct 28 20:24:17.226150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1264/2539] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:17 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:17.311625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2426e45-32fe-4b68-8856-3e95b596e276 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:17.320175 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2426e45-32fe-4b68-8856-3e95b596e276 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149848 Oct 28 20:24:17.322338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1276/2540] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:17 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:24:18.248033 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fe802e35-8559-4e5e-93fe-d50f624c00cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:18.248652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fe802e35-8559-4e5e-93fe-d50f624c00cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:18.255681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe802e35-8559-4e5e-93fe-d50f624c00cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:18.256167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe802e35-8559-4e5e-93fe-d50f624c00cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:18.256611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe802e35-8559-4e5e-93fe-d50f624c00cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:18.257298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe802e35-8559-4e5e-93fe-d50f624c00cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:18.257777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe802e35-8559-4e5e-93fe-d50f624c00cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:18.258204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe802e35-8559-4e5e-93fe-d50f624c00cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:18.326363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fe802e35-8559-4e5e-93fe-d50f624c00cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:18.334787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fe802e35-8559-4e5e-93fe-d50f624c00cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.090703 Oct 28 20:24:18.335341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1265/2541] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:18 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:18.344016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e885a9fc-40fa-4ff8-a36d-9b563e613fc3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:18.344761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e885a9fc-40fa-4ff8-a36d-9b563e613fc3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:18.351786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e885a9fc-40fa-4ff8-a36d-9b563e613fc3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:18.352257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e885a9fc-40fa-4ff8-a36d-9b563e613fc3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:18.352687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e885a9fc-40fa-4ff8-a36d-9b563e613fc3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:18.353385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e885a9fc-40fa-4ff8-a36d-9b563e613fc3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:18.353832 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e885a9fc-40fa-4ff8-a36d-9b563e613fc3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:18.354244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e885a9fc-40fa-4ff8-a36d-9b563e613fc3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:18.482049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e885a9fc-40fa-4ff8-a36d-9b563e613fc3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:18.490124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e885a9fc-40fa-4ff8-a36d-9b563e613fc3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150293 Oct 28 20:24:18.490695 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1277/2542] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:18 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:19.358031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ac890a61-78cf-4957-afa9-c56317fb4dc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:19.358597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ac890a61-78cf-4957-afa9-c56317fb4dc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:19.365477 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac890a61-78cf-4957-afa9-c56317fb4dc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:19.365963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac890a61-78cf-4957-afa9-c56317fb4dc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:19.366396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac890a61-78cf-4957-afa9-c56317fb4dc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:19.367075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac890a61-78cf-4957-afa9-c56317fb4dc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:19.367525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac890a61-78cf-4957-afa9-c56317fb4dc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:19.367946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac890a61-78cf-4957-afa9-c56317fb4dc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:19.427368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ac890a61-78cf-4957-afa9-c56317fb4dc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:19.435437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ac890a61-78cf-4957-afa9-c56317fb4dc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.081352 Oct 28 20:24:19.435994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1266/2543] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:19 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:19.513033 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c35a972f-86c0-44ac-839d-fde4e2a260d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:19.513681 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c35a972f-86c0-44ac-839d-fde4e2a260d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:19.520187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c35a972f-86c0-44ac-839d-fde4e2a260d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:19.520663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c35a972f-86c0-44ac-839d-fde4e2a260d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:19.521103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c35a972f-86c0-44ac-839d-fde4e2a260d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:19.521824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c35a972f-86c0-44ac-839d-fde4e2a260d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:19.522275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c35a972f-86c0-44ac-839d-fde4e2a260d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:19.522697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c35a972f-86c0-44ac-839d-fde4e2a260d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:19.651745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c35a972f-86c0-44ac-839d-fde4e2a260d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:19.660444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c35a972f-86c0-44ac-839d-fde4e2a260d3 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151182 Oct 28 20:24:19.660998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1278/2544] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:19 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:20.459579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c933730a-849d-42f5-a39c-6f82d97e24e5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:20.460197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c933730a-849d-42f5-a39c-6f82d97e24e5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:20.466881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c933730a-849d-42f5-a39c-6f82d97e24e5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:20.467368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c933730a-849d-42f5-a39c-6f82d97e24e5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:20.467833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c933730a-849d-42f5-a39c-6f82d97e24e5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:20.468516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c933730a-849d-42f5-a39c-6f82d97e24e5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:20.468973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c933730a-849d-42f5-a39c-6f82d97e24e5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:20.469433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c933730a-849d-42f5-a39c-6f82d97e24e5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:20.531372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c933730a-849d-42f5-a39c-6f82d97e24e5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:20.540867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c933730a-849d-42f5-a39c-6f82d97e24e5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085346 Oct 28 20:24:20.541826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1267/2545] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:20 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:20.684493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1459eb49-0d1c-4cb9-ae23-a5f6484ed419 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:20.685103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1459eb49-0d1c-4cb9-ae23-a5f6484ed419 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:20.692175 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1459eb49-0d1c-4cb9-ae23-a5f6484ed419 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:20.692736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1459eb49-0d1c-4cb9-ae23-a5f6484ed419 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:20.693171 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1459eb49-0d1c-4cb9-ae23-a5f6484ed419 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:20.693884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1459eb49-0d1c-4cb9-ae23-a5f6484ed419 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:20.694356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1459eb49-0d1c-4cb9-ae23-a5f6484ed419 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:20.694776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1459eb49-0d1c-4cb9-ae23-a5f6484ed419 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:20.822595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1459eb49-0d1c-4cb9-ae23-a5f6484ed419 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:20.830638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1459eb49-0d1c-4cb9-ae23-a5f6484ed419 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150323 Oct 28 20:24:20.831220 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1279/2546] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:20 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:21.564022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-821a11bc-fcfd-4bae-bbb2-9765b202d31d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:21.564634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-821a11bc-fcfd-4bae-bbb2-9765b202d31d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:21.571141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-821a11bc-fcfd-4bae-bbb2-9765b202d31d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:21.571625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-821a11bc-fcfd-4bae-bbb2-9765b202d31d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:21.572060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-821a11bc-fcfd-4bae-bbb2-9765b202d31d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:21.572744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-821a11bc-fcfd-4bae-bbb2-9765b202d31d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:21.573201 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-821a11bc-fcfd-4bae-bbb2-9765b202d31d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:21.573653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-821a11bc-fcfd-4bae-bbb2-9765b202d31d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:21.636902 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-821a11bc-fcfd-4bae-bbb2-9765b202d31d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:21.646105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-821a11bc-fcfd-4bae-bbb2-9765b202d31d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086000 Oct 28 20:24:21.646674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1268/2547] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:21 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:21.853735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d075d3b2-ffe3-4d9b-9023-881fcc306d86 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:21.854282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d075d3b2-ffe3-4d9b-9023-881fcc306d86 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:21.860646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d075d3b2-ffe3-4d9b-9023-881fcc306d86 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:21.861125 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d075d3b2-ffe3-4d9b-9023-881fcc306d86 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:21.861594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d075d3b2-ffe3-4d9b-9023-881fcc306d86 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:21.875253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d075d3b2-ffe3-4d9b-9023-881fcc306d86 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:21.875253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d075d3b2-ffe3-4d9b-9023-881fcc306d86 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:21.875253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d075d3b2-ffe3-4d9b-9023-881fcc306d86 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:21.986944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d075d3b2-ffe3-4d9b-9023-881fcc306d86 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:21.995237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d075d3b2-ffe3-4d9b-9023-881fcc306d86 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.145451 Oct 28 20:24:21.995792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1280/2548] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:21 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:22.669063 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-11df3fdf-9e4a-4baf-9720-481baa2fa1bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:22.669640 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-11df3fdf-9e4a-4baf-9720-481baa2fa1bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:22.676634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11df3fdf-9e4a-4baf-9720-481baa2fa1bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:22.677110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11df3fdf-9e4a-4baf-9720-481baa2fa1bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:22.677573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11df3fdf-9e4a-4baf-9720-481baa2fa1bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:22.678251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11df3fdf-9e4a-4baf-9720-481baa2fa1bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:22.678697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11df3fdf-9e4a-4baf-9720-481baa2fa1bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:22.679114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11df3fdf-9e4a-4baf-9720-481baa2fa1bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:22.740283 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-11df3fdf-9e4a-4baf-9720-481baa2fa1bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:22.748320 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-11df3fdf-9e4a-4baf-9720-481baa2fa1bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083213 Oct 28 20:24:22.748878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1269/2549] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:22 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:23.019405 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49f93501-4a9d-4e53-b815-08a5474df7ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:23.020044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-49f93501-4a9d-4e53-b815-08a5474df7ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:23.026466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49f93501-4a9d-4e53-b815-08a5474df7ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:23.026950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49f93501-4a9d-4e53-b815-08a5474df7ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:23.027387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49f93501-4a9d-4e53-b815-08a5474df7ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:23.028079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49f93501-4a9d-4e53-b815-08a5474df7ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:23.028535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49f93501-4a9d-4e53-b815-08a5474df7ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:23.028961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49f93501-4a9d-4e53-b815-08a5474df7ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:23.157149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-49f93501-4a9d-4e53-b815-08a5474df7ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:23.165925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-49f93501-4a9d-4e53-b815-08a5474df7ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150930 Oct 28 20:24:23.166491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1281/2550] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:23 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:23.771042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9d14f833-9ced-43c3-9083-a8d36a0e4757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:23.771613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9d14f833-9ced-43c3-9083-a8d36a0e4757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:23.777925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d14f833-9ced-43c3-9083-a8d36a0e4757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:23.778405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d14f833-9ced-43c3-9083-a8d36a0e4757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:23.778838 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d14f833-9ced-43c3-9083-a8d36a0e4757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:23.779513 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d14f833-9ced-43c3-9083-a8d36a0e4757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:23.779962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d14f833-9ced-43c3-9083-a8d36a0e4757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:23.780377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d14f833-9ced-43c3-9083-a8d36a0e4757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:23.842368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9d14f833-9ced-43c3-9083-a8d36a0e4757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:23.850850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9d14f833-9ced-43c3-9083-a8d36a0e4757 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083788 Oct 28 20:24:23.851417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1270/2551] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:23 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:24.189711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-76602aad-562a-45d9-9c1b-c3900771d48a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:24.190344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-76602aad-562a-45d9-9c1b-c3900771d48a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:24.197290 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76602aad-562a-45d9-9c1b-c3900771d48a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:24.197805 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76602aad-562a-45d9-9c1b-c3900771d48a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:24.198243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76602aad-562a-45d9-9c1b-c3900771d48a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:24.198922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76602aad-562a-45d9-9c1b-c3900771d48a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:24.199368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76602aad-562a-45d9-9c1b-c3900771d48a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:24.199791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76602aad-562a-45d9-9c1b-c3900771d48a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:24.328200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-76602aad-562a-45d9-9c1b-c3900771d48a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:24.336981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-76602aad-562a-45d9-9c1b-c3900771d48a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151212 Oct 28 20:24:24.337650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1282/2552] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:24 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:24.873836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-815e0037-a744-4ff0-bdf8-88a4c3c7b6d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:24.874453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-815e0037-a744-4ff0-bdf8-88a4c3c7b6d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:24.880945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-815e0037-a744-4ff0-bdf8-88a4c3c7b6d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:24.881518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-815e0037-a744-4ff0-bdf8-88a4c3c7b6d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:24.881955 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-815e0037-a744-4ff0-bdf8-88a4c3c7b6d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:24.882973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-815e0037-a744-4ff0-bdf8-88a4c3c7b6d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:24.883451 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-815e0037-a744-4ff0-bdf8-88a4c3c7b6d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:24.883871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-815e0037-a744-4ff0-bdf8-88a4c3c7b6d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:24.946346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-815e0037-a744-4ff0-bdf8-88a4c3c7b6d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:24.954492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-815e0037-a744-4ff0-bdf8-88a4c3c7b6d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085031 Oct 28 20:24:24.955059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1271/2553] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:24 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:25.360249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2a57448-6924-41fb-ae6a-4418c2f55a7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:25.360789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2a57448-6924-41fb-ae6a-4418c2f55a7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:25.367339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2a57448-6924-41fb-ae6a-4418c2f55a7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:25.367822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2a57448-6924-41fb-ae6a-4418c2f55a7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:25.368261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2a57448-6924-41fb-ae6a-4418c2f55a7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:25.368948 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2a57448-6924-41fb-ae6a-4418c2f55a7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:25.369429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2a57448-6924-41fb-ae6a-4418c2f55a7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:25.369854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2a57448-6924-41fb-ae6a-4418c2f55a7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:25.493751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2a57448-6924-41fb-ae6a-4418c2f55a7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:25.501849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2a57448-6924-41fb-ae6a-4418c2f55a7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.145569 Oct 28 20:24:25.502417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1283/2554] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:25 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:25.977993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-22339fbd-decd-4955-8f16-f55d24a5fe66 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:25.978606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22339fbd-decd-4955-8f16-f55d24a5fe66 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:25.984946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22339fbd-decd-4955-8f16-f55d24a5fe66 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:25.985463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22339fbd-decd-4955-8f16-f55d24a5fe66 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:25.985905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22339fbd-decd-4955-8f16-f55d24a5fe66 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:25.986587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22339fbd-decd-4955-8f16-f55d24a5fe66 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:25.987043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22339fbd-decd-4955-8f16-f55d24a5fe66 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:25.988015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22339fbd-decd-4955-8f16-f55d24a5fe66 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:26.051936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-22339fbd-decd-4955-8f16-f55d24a5fe66 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:26.060064 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-22339fbd-decd-4955-8f16-f55d24a5fe66 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086360 Oct 28 20:24:26.060626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1272/2555] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:25 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:26.524756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-baaae613-9696-48ac-bb7b-82df91f114f7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:26.534417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-baaae613-9696-48ac-bb7b-82df91f114f7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:26.534417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-baaae613-9696-48ac-bb7b-82df91f114f7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:26.534417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-baaae613-9696-48ac-bb7b-82df91f114f7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:26.534417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-baaae613-9696-48ac-bb7b-82df91f114f7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:26.534955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-baaae613-9696-48ac-bb7b-82df91f114f7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:26.534955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-baaae613-9696-48ac-bb7b-82df91f114f7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:26.534955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-baaae613-9696-48ac-bb7b-82df91f114f7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:26.664309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-baaae613-9696-48ac-bb7b-82df91f114f7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:26.672467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-baaae613-9696-48ac-bb7b-82df91f114f7 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151646 Oct 28 20:24:26.673039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1284/2556] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:26 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:27.083618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-224ee745-93b4-40bb-9906-483827ae503a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:27.084232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-224ee745-93b4-40bb-9906-483827ae503a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:27.090612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-224ee745-93b4-40bb-9906-483827ae503a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:27.091360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-224ee745-93b4-40bb-9906-483827ae503a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:27.091803 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-224ee745-93b4-40bb-9906-483827ae503a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:27.092487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-224ee745-93b4-40bb-9906-483827ae503a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:27.092951 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-224ee745-93b4-40bb-9906-483827ae503a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:27.093403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-224ee745-93b4-40bb-9906-483827ae503a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:27.097865 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:27.155002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-224ee745-93b4-40bb-9906-483827ae503a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:27.163385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-224ee745-93b4-40bb-9906-483827ae503a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083948 Oct 28 20:24:27.163958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1273/2557] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:27 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:27.696955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a95b86e3-e5ae-4ead-996b-540eef9f85f2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:27.697589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a95b86e3-e5ae-4ead-996b-540eef9f85f2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:27.704013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a95b86e3-e5ae-4ead-996b-540eef9f85f2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:27.704487 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a95b86e3-e5ae-4ead-996b-540eef9f85f2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:27.704919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a95b86e3-e5ae-4ead-996b-540eef9f85f2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:27.705627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a95b86e3-e5ae-4ead-996b-540eef9f85f2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:27.706113 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a95b86e3-e5ae-4ead-996b-540eef9f85f2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:27.706537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a95b86e3-e5ae-4ead-996b-540eef9f85f2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:27.833522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a95b86e3-e5ae-4ead-996b-540eef9f85f2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:27.841822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a95b86e3-e5ae-4ead-996b-540eef9f85f2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.148888 Oct 28 20:24:27.842387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1285/2558] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:27 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:28.187102 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63d16e47-4269-42f2-a957-68b7bf2a2a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:28.187714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-63d16e47-4269-42f2-a957-68b7bf2a2a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:28.194264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63d16e47-4269-42f2-a957-68b7bf2a2a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:28.194746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63d16e47-4269-42f2-a957-68b7bf2a2a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:28.195184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63d16e47-4269-42f2-a957-68b7bf2a2a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:28.195864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63d16e47-4269-42f2-a957-68b7bf2a2a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:28.196318 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63d16e47-4269-42f2-a957-68b7bf2a2a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:28.196741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63d16e47-4269-42f2-a957-68b7bf2a2a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:28.260122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-63d16e47-4269-42f2-a957-68b7bf2a2a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:28.268338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-63d16e47-4269-42f2-a957-68b7bf2a2a9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085113 Oct 28 20:24:28.268912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1274/2559] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:28 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:28.865073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a314c8dd-2371-4280-a7e8-c8e83c063653 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:28.865711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a314c8dd-2371-4280-a7e8-c8e83c063653 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:28.871993 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a314c8dd-2371-4280-a7e8-c8e83c063653 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:28.872467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a314c8dd-2371-4280-a7e8-c8e83c063653 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:28.872899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a314c8dd-2371-4280-a7e8-c8e83c063653 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:28.873601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a314c8dd-2371-4280-a7e8-c8e83c063653 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:28.874044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a314c8dd-2371-4280-a7e8-c8e83c063653 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:28.875012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a314c8dd-2371-4280-a7e8-c8e83c063653 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:29.000959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a314c8dd-2371-4280-a7e8-c8e83c063653 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:29.009579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a314c8dd-2371-4280-a7e8-c8e83c063653 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.148404 Oct 28 20:24:29.010139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1286/2560] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:28 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:29.291409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f8b416b2-5d58-4ebb-b284-376e0f2daf6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:29.291966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f8b416b2-5d58-4ebb-b284-376e0f2daf6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:29.298357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b416b2-5d58-4ebb-b284-376e0f2daf6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:29.298838 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b416b2-5d58-4ebb-b284-376e0f2daf6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:29.299276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b416b2-5d58-4ebb-b284-376e0f2daf6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:29.299986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b416b2-5d58-4ebb-b284-376e0f2daf6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:29.300441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b416b2-5d58-4ebb-b284-376e0f2daf6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:29.300870 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b416b2-5d58-4ebb-b284-376e0f2daf6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:29.361739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f8b416b2-5d58-4ebb-b284-376e0f2daf6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:29.370087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f8b416b2-5d58-4ebb-b284-376e0f2daf6a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082597 Oct 28 20:24:29.370649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1275/2561] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:29 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:30.033289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d3006f87-3c3f-4d3b-9efc-d3e78c78864d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:30.033929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d3006f87-3c3f-4d3b-9efc-d3e78c78864d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:30.043627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3006f87-3c3f-4d3b-9efc-d3e78c78864d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:30.044427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3006f87-3c3f-4d3b-9efc-d3e78c78864d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:30.044882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3006f87-3c3f-4d3b-9efc-d3e78c78864d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:30.045626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3006f87-3c3f-4d3b-9efc-d3e78c78864d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:30.046091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3006f87-3c3f-4d3b-9efc-d3e78c78864d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:30.046521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3006f87-3c3f-4d3b-9efc-d3e78c78864d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:30.062502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:30.178802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d3006f87-3c3f-4d3b-9efc-d3e78c78864d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:30.186877 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d3006f87-3c3f-4d3b-9efc-d3e78c78864d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.157655 Oct 28 20:24:30.187441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1287/2562] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:30 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:30.391964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9cd69744-1186-4e48-bd84-98f5699da857 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:30.392575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9cd69744-1186-4e48-bd84-98f5699da857 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:30.399022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cd69744-1186-4e48-bd84-98f5699da857 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:30.399503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cd69744-1186-4e48-bd84-98f5699da857 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:30.399940 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cd69744-1186-4e48-bd84-98f5699da857 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:30.400619 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cd69744-1186-4e48-bd84-98f5699da857 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:30.401074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cd69744-1186-4e48-bd84-98f5699da857 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:30.401530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cd69744-1186-4e48-bd84-98f5699da857 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:30.461829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9cd69744-1186-4e48-bd84-98f5699da857 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:30.470134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9cd69744-1186-4e48-bd84-98f5699da857 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082046 Oct 28 20:24:30.470695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1276/2563] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:30 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:31.210027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3e8e18cd-a941-4b5d-8b11-f9cc0be99375 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:31.210638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3e8e18cd-a941-4b5d-8b11-f9cc0be99375 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:31.217256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e8e18cd-a941-4b5d-8b11-f9cc0be99375 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:31.217768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e8e18cd-a941-4b5d-8b11-f9cc0be99375 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:31.218211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e8e18cd-a941-4b5d-8b11-f9cc0be99375 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:31.218890 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e8e18cd-a941-4b5d-8b11-f9cc0be99375 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:31.219342 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e8e18cd-a941-4b5d-8b11-f9cc0be99375 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:31.219764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e8e18cd-a941-4b5d-8b11-f9cc0be99375 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:31.348066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3e8e18cd-a941-4b5d-8b11-f9cc0be99375 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:31.356131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3e8e18cd-a941-4b5d-8b11-f9cc0be99375 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150702 Oct 28 20:24:31.356688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1288/2564] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:31 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:31.493367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-df44a6b7-cdfb-441c-a87b-8a35c678c57a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:31.493988 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-df44a6b7-cdfb-441c-a87b-8a35c678c57a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:31.500479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df44a6b7-cdfb-441c-a87b-8a35c678c57a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:31.500967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df44a6b7-cdfb-441c-a87b-8a35c678c57a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:31.501431 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df44a6b7-cdfb-441c-a87b-8a35c678c57a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:31.502121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df44a6b7-cdfb-441c-a87b-8a35c678c57a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:31.502576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df44a6b7-cdfb-441c-a87b-8a35c678c57a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:31.503004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df44a6b7-cdfb-441c-a87b-8a35c678c57a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:31.566458 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-df44a6b7-cdfb-441c-a87b-8a35c678c57a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:31.575207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-df44a6b7-cdfb-441c-a87b-8a35c678c57a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085733 Oct 28 20:24:31.575770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1277/2565] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:31 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:32.381004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ccd27090-8648-462c-a7dc-84de283755f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:32.381607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ccd27090-8648-462c-a7dc-84de283755f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:32.388015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccd27090-8648-462c-a7dc-84de283755f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:32.388502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccd27090-8648-462c-a7dc-84de283755f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:32.388940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccd27090-8648-462c-a7dc-84de283755f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:32.389664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccd27090-8648-462c-a7dc-84de283755f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:32.390119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccd27090-8648-462c-a7dc-84de283755f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:32.390547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccd27090-8648-462c-a7dc-84de283755f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:32.525684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ccd27090-8648-462c-a7dc-84de283755f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:32.534037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ccd27090-8648-462c-a7dc-84de283755f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.158711 Oct 28 20:24:32.534607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1289/2566] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:32 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:32.597212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-076d890f-b8af-49ff-ac95-1d95ca0d4b6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:32.597859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-076d890f-b8af-49ff-ac95-1d95ca0d4b6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:32.604784 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-076d890f-b8af-49ff-ac95-1d95ca0d4b6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:32.605282 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-076d890f-b8af-49ff-ac95-1d95ca0d4b6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:32.605762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-076d890f-b8af-49ff-ac95-1d95ca0d4b6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:32.606457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-076d890f-b8af-49ff-ac95-1d95ca0d4b6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:32.606921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-076d890f-b8af-49ff-ac95-1d95ca0d4b6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:32.607353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-076d890f-b8af-49ff-ac95-1d95ca0d4b6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:32.671063 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-076d890f-b8af-49ff-ac95-1d95ca0d4b6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:32.680475 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-076d890f-b8af-49ff-ac95-1d95ca0d4b6c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087289 Oct 28 20:24:32.681049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1278/2567] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:32 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:33.556205 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3bc11b77-68e3-48c3-8aa8-f71b3adb39d2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:33.556842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3bc11b77-68e3-48c3-8aa8-f71b3adb39d2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:33.563258 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bc11b77-68e3-48c3-8aa8-f71b3adb39d2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:33.563739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bc11b77-68e3-48c3-8aa8-f71b3adb39d2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:33.564174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bc11b77-68e3-48c3-8aa8-f71b3adb39d2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:33.564851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bc11b77-68e3-48c3-8aa8-f71b3adb39d2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:33.565307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bc11b77-68e3-48c3-8aa8-f71b3adb39d2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:33.565763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bc11b77-68e3-48c3-8aa8-f71b3adb39d2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:33.697508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3bc11b77-68e3-48c3-8aa8-f71b3adb39d2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:33.703285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-11888592-9d2e-4ae0-ae26-4f08c710dfa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:33.703899 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-11888592-9d2e-4ae0-ae26-4f08c710dfa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:33.705957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3bc11b77-68e3-48c3-8aa8-f71b3adb39d2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.153555 Oct 28 20:24:33.706520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1290/2568] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:33 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:33.711066 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11888592-9d2e-4ae0-ae26-4f08c710dfa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:33.711549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11888592-9d2e-4ae0-ae26-4f08c710dfa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:33.711979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11888592-9d2e-4ae0-ae26-4f08c710dfa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:33.712669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11888592-9d2e-4ae0-ae26-4f08c710dfa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:33.713261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11888592-9d2e-4ae0-ae26-4f08c710dfa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:33.713708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11888592-9d2e-4ae0-ae26-4f08c710dfa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:33.775617 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-11888592-9d2e-4ae0-ae26-4f08c710dfa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:33.783574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-11888592-9d2e-4ae0-ae26-4f08c710dfa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084248 Oct 28 20:24:33.784134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1279/2569] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:33 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:24:34.730512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-45451fd8-6b48-4e8c-86ef-8be78cb0376d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:34.731108 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-45451fd8-6b48-4e8c-86ef-8be78cb0376d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:34.737874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45451fd8-6b48-4e8c-86ef-8be78cb0376d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:34.738355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45451fd8-6b48-4e8c-86ef-8be78cb0376d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:34.738903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45451fd8-6b48-4e8c-86ef-8be78cb0376d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:34.739595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45451fd8-6b48-4e8c-86ef-8be78cb0376d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:34.740178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45451fd8-6b48-4e8c-86ef-8be78cb0376d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:34.740610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45451fd8-6b48-4e8c-86ef-8be78cb0376d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:34.806606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-44af170f-c1df-4693-be27-4a698e415c69 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:34.807240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-44af170f-c1df-4693-be27-4a698e415c69 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:34.813534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44af170f-c1df-4693-be27-4a698e415c69 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:34.814021 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44af170f-c1df-4693-be27-4a698e415c69 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:34.814455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44af170f-c1df-4693-be27-4a698e415c69 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:34.815159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44af170f-c1df-4693-be27-4a698e415c69 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:34.815596 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44af170f-c1df-4693-be27-4a698e415c69 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:34.816021 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44af170f-c1df-4693-be27-4a698e415c69 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:34.891959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-44af170f-c1df-4693-be27-4a698e415c69 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:34.899904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-45451fd8-6b48-4e8c-86ef-8be78cb0376d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:34.901198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-44af170f-c1df-4693-be27-4a698e415c69 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.098450 Oct 28 20:24:34.901895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1280/2570] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:34 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:24:34.908136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-45451fd8-6b48-4e8c-86ef-8be78cb0376d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.181654 Oct 28 20:24:34.908708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1291/2571] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:34 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:35.925556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0fb5465c-85de-4dba-9997-9256c518b911 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:35.926215 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0fb5465c-85de-4dba-9997-9256c518b911 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:35.932413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a36f32f4-869a-409d-8c77-1056c5a4bb69 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:35.933034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a36f32f4-869a-409d-8c77-1056c5a4bb69 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:35.933162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fb5465c-85de-4dba-9997-9256c518b911 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:35.933565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fb5465c-85de-4dba-9997-9256c518b911 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:35.934011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fb5465c-85de-4dba-9997-9256c518b911 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:35.934794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fb5465c-85de-4dba-9997-9256c518b911 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:35.935298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fb5465c-85de-4dba-9997-9256c518b911 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:35.935741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fb5465c-85de-4dba-9997-9256c518b911 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:35.939417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a36f32f4-869a-409d-8c77-1056c5a4bb69 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:35.939892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a36f32f4-869a-409d-8c77-1056c5a4bb69 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:35.940322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a36f32f4-869a-409d-8c77-1056c5a4bb69 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:35.940996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a36f32f4-869a-409d-8c77-1056c5a4bb69 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:35.941466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a36f32f4-869a-409d-8c77-1056c5a4bb69 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:35.941883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a36f32f4-869a-409d-8c77-1056c5a4bb69 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:36.040985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0fb5465c-85de-4dba-9997-9256c518b911 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:36.049087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0fb5465c-85de-4dba-9997-9256c518b911 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.127551 Oct 28 20:24:36.049942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1281/2572] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:35 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:36.114787 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a36f32f4-869a-409d-8c77-1056c5a4bb69 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:36.122957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a36f32f4-869a-409d-8c77-1056c5a4bb69 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.194497 Oct 28 20:24:36.123517 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1292/2573] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:35 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:37.073154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-436ad9ff-40a7-42f9-8db3-016e96f0d65e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:37.073795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-436ad9ff-40a7-42f9-8db3-016e96f0d65e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:37.080300 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436ad9ff-40a7-42f9-8db3-016e96f0d65e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:37.080791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436ad9ff-40a7-42f9-8db3-016e96f0d65e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:37.081231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436ad9ff-40a7-42f9-8db3-016e96f0d65e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:37.081959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436ad9ff-40a7-42f9-8db3-016e96f0d65e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:37.082450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436ad9ff-40a7-42f9-8db3-016e96f0d65e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:37.082884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-436ad9ff-40a7-42f9-8db3-016e96f0d65e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:37.146344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-436ad9ff-40a7-42f9-8db3-016e96f0d65e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:37.146985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4116517-a97e-4ae6-8c46-6b046021c646 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:37.147603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d4116517-a97e-4ae6-8c46-6b046021c646 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:37.154347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4116517-a97e-4ae6-8c46-6b046021c646 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:37.154567 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-436ad9ff-40a7-42f9-8db3-016e96f0d65e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085314 Oct 28 20:24:37.154826 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4116517-a97e-4ae6-8c46-6b046021c646 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:37.155133 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1282/2574] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:37 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:37.155264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4116517-a97e-4ae6-8c46-6b046021c646 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:37.155948 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4116517-a97e-4ae6-8c46-6b046021c646 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:37.156407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4116517-a97e-4ae6-8c46-6b046021c646 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:37.156831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4116517-a97e-4ae6-8c46-6b046021c646 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:37.546341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d4116517-a97e-4ae6-8c46-6b046021c646 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:37.555839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d4116517-a97e-4ae6-8c46-6b046021c646 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.413275 Oct 28 20:24:37.556403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1293/2575] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:37 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:24:38.178877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4365bef5-0a6a-457d-91ed-b0a74ff03f05 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:38.179506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4365bef5-0a6a-457d-91ed-b0a74ff03f05 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:38.186262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4365bef5-0a6a-457d-91ed-b0a74ff03f05 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:38.186749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4365bef5-0a6a-457d-91ed-b0a74ff03f05 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:38.187188 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4365bef5-0a6a-457d-91ed-b0a74ff03f05 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:38.187937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4365bef5-0a6a-457d-91ed-b0a74ff03f05 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:38.188391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4365bef5-0a6a-457d-91ed-b0a74ff03f05 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:38.188815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4365bef5-0a6a-457d-91ed-b0a74ff03f05 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:38.251639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4365bef5-0a6a-457d-91ed-b0a74ff03f05 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:38.261256 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4365bef5-0a6a-457d-91ed-b0a74ff03f05 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086396 Oct 28 20:24:38.262022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1283/2576] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:38 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:38.585725 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-362f4f69-6b8d-446c-8c7e-3ac68fbf0021 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:38.586338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-362f4f69-6b8d-446c-8c7e-3ac68fbf0021 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:38.593003 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-362f4f69-6b8d-446c-8c7e-3ac68fbf0021 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:38.593545 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-362f4f69-6b8d-446c-8c7e-3ac68fbf0021 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:38.593984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-362f4f69-6b8d-446c-8c7e-3ac68fbf0021 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:38.594673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-362f4f69-6b8d-446c-8c7e-3ac68fbf0021 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:38.595123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-362f4f69-6b8d-446c-8c7e-3ac68fbf0021 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:38.595549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-362f4f69-6b8d-446c-8c7e-3ac68fbf0021 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:38.724540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-362f4f69-6b8d-446c-8c7e-3ac68fbf0021 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:38.732616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-362f4f69-6b8d-446c-8c7e-3ac68fbf0021 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150954 Oct 28 20:24:38.733182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1294/2577] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:38 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:39.286321 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7143b7bf-840c-4993-8b66-e91bfec4e1dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:39.286893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7143b7bf-840c-4993-8b66-e91bfec4e1dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:39.293293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7143b7bf-840c-4993-8b66-e91bfec4e1dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:39.293805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7143b7bf-840c-4993-8b66-e91bfec4e1dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:39.294238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7143b7bf-840c-4993-8b66-e91bfec4e1dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:39.294925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7143b7bf-840c-4993-8b66-e91bfec4e1dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:39.295377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7143b7bf-840c-4993-8b66-e91bfec4e1dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:39.295799 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7143b7bf-840c-4993-8b66-e91bfec4e1dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:39.359553 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7143b7bf-840c-4993-8b66-e91bfec4e1dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:39.368566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7143b7bf-840c-4993-8b66-e91bfec4e1dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086330 Oct 28 20:24:39.369132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1284/2578] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:39 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:39.756776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36e15ac3-4fbb-47d5-b5bc-91691c0c44d1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:39.757395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36e15ac3-4fbb-47d5-b5bc-91691c0c44d1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:39.763719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36e15ac3-4fbb-47d5-b5bc-91691c0c44d1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:39.764194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36e15ac3-4fbb-47d5-b5bc-91691c0c44d1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:39.764626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36e15ac3-4fbb-47d5-b5bc-91691c0c44d1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:39.765302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36e15ac3-4fbb-47d5-b5bc-91691c0c44d1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:39.765773 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36e15ac3-4fbb-47d5-b5bc-91691c0c44d1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:39.766195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36e15ac3-4fbb-47d5-b5bc-91691c0c44d1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:39.895215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-36e15ac3-4fbb-47d5-b5bc-91691c0c44d1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:39.903485 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36e15ac3-4fbb-47d5-b5bc-91691c0c44d1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151061 Oct 28 20:24:39.904053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1295/2579] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:39 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:40.412579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9695e61b-133f-40e8-8843-fa6c6317fa52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:40.412579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9695e61b-133f-40e8-8843-fa6c6317fa52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:40.412579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=56 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:40.412579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9695e61b-133f-40e8-8843-fa6c6317fa52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:40.412579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9695e61b-133f-40e8-8843-fa6c6317fa52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:40.413772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9695e61b-133f-40e8-8843-fa6c6317fa52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:40.413772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9695e61b-133f-40e8-8843-fa6c6317fa52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:40.413772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9695e61b-133f-40e8-8843-fa6c6317fa52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:40.413772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9695e61b-133f-40e8-8843-fa6c6317fa52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:40.467479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9695e61b-133f-40e8-8843-fa6c6317fa52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:40.475758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9695e61b-133f-40e8-8843-fa6c6317fa52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087357 Oct 28 20:24:40.476319 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1285/2580] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:40 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:40.927724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7ed6f174-4b2f-4bd7-86b8-002dd0715332 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:40.928318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7ed6f174-4b2f-4bd7-86b8-002dd0715332 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:40.934635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ed6f174-4b2f-4bd7-86b8-002dd0715332 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:40.935109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ed6f174-4b2f-4bd7-86b8-002dd0715332 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:40.935539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ed6f174-4b2f-4bd7-86b8-002dd0715332 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:40.936210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ed6f174-4b2f-4bd7-86b8-002dd0715332 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:40.936653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ed6f174-4b2f-4bd7-86b8-002dd0715332 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:40.937069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ed6f174-4b2f-4bd7-86b8-002dd0715332 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:41.067441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7ed6f174-4b2f-4bd7-86b8-002dd0715332 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:41.075506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7ed6f174-4b2f-4bd7-86b8-002dd0715332 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152181 Oct 28 20:24:41.076060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1296/2581] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:40 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:41.498599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b90d3807-98bb-4bd1-95f4-9d4c3ca604a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:41.498998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b90d3807-98bb-4bd1-95f4-9d4c3ca604a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:41.505124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b90d3807-98bb-4bd1-95f4-9d4c3ca604a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:41.505652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b90d3807-98bb-4bd1-95f4-9d4c3ca604a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:41.506090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b90d3807-98bb-4bd1-95f4-9d4c3ca604a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:41.506777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b90d3807-98bb-4bd1-95f4-9d4c3ca604a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:41.507230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b90d3807-98bb-4bd1-95f4-9d4c3ca604a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:41.507684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b90d3807-98bb-4bd1-95f4-9d4c3ca604a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:41.567824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b90d3807-98bb-4bd1-95f4-9d4c3ca604a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:41.575861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b90d3807-98bb-4bd1-95f4-9d4c3ca604a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.081423 Oct 28 20:24:41.576418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1286/2582] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:41 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:42.100594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40b13f2e-4e0b-45f4-9266-71579a993428 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:42.102513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40b13f2e-4e0b-45f4-9266-71579a993428 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:42.111958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40b13f2e-4e0b-45f4-9266-71579a993428 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:42.112441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40b13f2e-4e0b-45f4-9266-71579a993428 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:42.112896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40b13f2e-4e0b-45f4-9266-71579a993428 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:42.113701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40b13f2e-4e0b-45f4-9266-71579a993428 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:42.114189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40b13f2e-4e0b-45f4-9266-71579a993428 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:42.114616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40b13f2e-4e0b-45f4-9266-71579a993428 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:42.245292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-40b13f2e-4e0b-45f4-9266-71579a993428 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:42.253407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40b13f2e-4e0b-45f4-9266-71579a993428 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.158345 Oct 28 20:24:42.253977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1297/2583] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:42 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:42.599492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4179e5f6-4d5c-4c4f-a90a-cfde41a2d340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:42.600136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4179e5f6-4d5c-4c4f-a90a-cfde41a2d340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:42.606621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4179e5f6-4d5c-4c4f-a90a-cfde41a2d340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:42.607107 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4179e5f6-4d5c-4c4f-a90a-cfde41a2d340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:42.607552 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4179e5f6-4d5c-4c4f-a90a-cfde41a2d340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:42.608241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4179e5f6-4d5c-4c4f-a90a-cfde41a2d340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:42.608758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4179e5f6-4d5c-4c4f-a90a-cfde41a2d340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:42.609184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4179e5f6-4d5c-4c4f-a90a-cfde41a2d340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:42.674079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4179e5f6-4d5c-4c4f-a90a-cfde41a2d340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:42.682506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4179e5f6-4d5c-4c4f-a90a-cfde41a2d340 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087016 Oct 28 20:24:42.683068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1287/2584] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:42 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:43.276439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cb0a59fa-262f-4295-931a-531c8ba0464d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:43.277070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cb0a59fa-262f-4295-931a-531c8ba0464d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:43.279374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=52 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:43.284015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb0a59fa-262f-4295-931a-531c8ba0464d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:43.284429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb0a59fa-262f-4295-931a-531c8ba0464d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:43.284861 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb0a59fa-262f-4295-931a-531c8ba0464d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:43.286128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb0a59fa-262f-4295-931a-531c8ba0464d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:43.286566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb0a59fa-262f-4295-931a-531c8ba0464d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:43.286980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb0a59fa-262f-4295-931a-531c8ba0464d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:43.417908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cb0a59fa-262f-4295-931a-531c8ba0464d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:43.426824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cb0a59fa-262f-4295-931a-531c8ba0464d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.153630 Oct 28 20:24:43.427493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1298/2585] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:43 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:43.705245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-828f9b4d-e098-4dad-89a5-dfd0e55376d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:43.705896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-828f9b4d-e098-4dad-89a5-dfd0e55376d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:43.713072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-828f9b4d-e098-4dad-89a5-dfd0e55376d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:43.713591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-828f9b4d-e098-4dad-89a5-dfd0e55376d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:43.714033 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-828f9b4d-e098-4dad-89a5-dfd0e55376d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:43.714718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-828f9b4d-e098-4dad-89a5-dfd0e55376d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:43.715176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-828f9b4d-e098-4dad-89a5-dfd0e55376d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:43.715602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-828f9b4d-e098-4dad-89a5-dfd0e55376d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:43.776621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-828f9b4d-e098-4dad-89a5-dfd0e55376d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:43.784647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-828f9b4d-e098-4dad-89a5-dfd0e55376d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083298 Oct 28 20:24:43.786034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1288/2586] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:43 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:44.450064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8cd285f8-b3a9-42d3-a7e9-4d9474ee8bd0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:44.450713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8cd285f8-b3a9-42d3-a7e9-4d9474ee8bd0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:44.457072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cd285f8-b3a9-42d3-a7e9-4d9474ee8bd0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:44.457885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cd285f8-b3a9-42d3-a7e9-4d9474ee8bd0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:44.458335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cd285f8-b3a9-42d3-a7e9-4d9474ee8bd0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:44.459123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cd285f8-b3a9-42d3-a7e9-4d9474ee8bd0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:44.459590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cd285f8-b3a9-42d3-a7e9-4d9474ee8bd0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:44.460023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cd285f8-b3a9-42d3-a7e9-4d9474ee8bd0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:44.593531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8cd285f8-b3a9-42d3-a7e9-4d9474ee8bd0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:44.602397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8cd285f8-b3a9-42d3-a7e9-4d9474ee8bd0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.156134 Oct 28 20:24:44.602958 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1299/2587] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:44 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:44.807928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1c55b93b-825b-4371-b039-3a80d91724f5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:44.808548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1c55b93b-825b-4371-b039-3a80d91724f5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:44.814914 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c55b93b-825b-4371-b039-3a80d91724f5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:44.815401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c55b93b-825b-4371-b039-3a80d91724f5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:44.815843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c55b93b-825b-4371-b039-3a80d91724f5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:44.817100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c55b93b-825b-4371-b039-3a80d91724f5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:44.817587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c55b93b-825b-4371-b039-3a80d91724f5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:44.818014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c55b93b-825b-4371-b039-3a80d91724f5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:44.878765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1c55b93b-825b-4371-b039-3a80d91724f5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:44.883175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:44.888148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1c55b93b-825b-4371-b039-3a80d91724f5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084136 Oct 28 20:24:44.888714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1289/2588] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:44 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:45.625069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2952426a-fcc7-434f-973e-398a233d7d5b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:45.625713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2952426a-fcc7-434f-973e-398a233d7d5b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:45.632128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2952426a-fcc7-434f-973e-398a233d7d5b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:45.632599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2952426a-fcc7-434f-973e-398a233d7d5b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:45.633027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2952426a-fcc7-434f-973e-398a233d7d5b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:45.633730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2952426a-fcc7-434f-973e-398a233d7d5b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:45.634209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2952426a-fcc7-434f-973e-398a233d7d5b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:45.634632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2952426a-fcc7-434f-973e-398a233d7d5b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:45.759244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2952426a-fcc7-434f-973e-398a233d7d5b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:45.767172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2952426a-fcc7-434f-973e-398a233d7d5b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.145985 Oct 28 20:24:45.767733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1300/2589] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:45 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:45.912876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-696d203d-72ba-4ef9-9c54-301cd4fe8093 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:45.913527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-696d203d-72ba-4ef9-9c54-301cd4fe8093 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:45.920383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-696d203d-72ba-4ef9-9c54-301cd4fe8093 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:45.920903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-696d203d-72ba-4ef9-9c54-301cd4fe8093 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:45.921372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-696d203d-72ba-4ef9-9c54-301cd4fe8093 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:45.922071 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-696d203d-72ba-4ef9-9c54-301cd4fe8093 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:45.922528 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-696d203d-72ba-4ef9-9c54-301cd4fe8093 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:45.922964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-696d203d-72ba-4ef9-9c54-301cd4fe8093 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:45.986390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-696d203d-72ba-4ef9-9c54-301cd4fe8093 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:45.994795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-696d203d-72ba-4ef9-9c54-301cd4fe8093 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086377 Oct 28 20:24:45.995371 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1290/2590] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:45 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:46.790268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-29d465aa-ea6c-440c-b4ae-70f062b4369d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:46.790909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-29d465aa-ea6c-440c-b4ae-70f062b4369d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:46.797044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29d465aa-ea6c-440c-b4ae-70f062b4369d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:46.797560 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29d465aa-ea6c-440c-b4ae-70f062b4369d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:46.797995 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29d465aa-ea6c-440c-b4ae-70f062b4369d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:46.798675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29d465aa-ea6c-440c-b4ae-70f062b4369d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:46.799131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29d465aa-ea6c-440c-b4ae-70f062b4369d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:46.799550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29d465aa-ea6c-440c-b4ae-70f062b4369d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:46.930358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-29d465aa-ea6c-440c-b4ae-70f062b4369d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:46.938413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-29d465aa-ea6c-440c-b4ae-70f062b4369d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152024 Oct 28 20:24:46.938982 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1301/2591] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:46 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:47.017495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3054539a-5550-456e-8d9a-b0af51e85ef3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:47.018118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3054539a-5550-456e-8d9a-b0af51e85ef3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:47.024549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3054539a-5550-456e-8d9a-b0af51e85ef3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:47.025043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3054539a-5550-456e-8d9a-b0af51e85ef3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:47.025516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3054539a-5550-456e-8d9a-b0af51e85ef3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:47.026239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3054539a-5550-456e-8d9a-b0af51e85ef3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:47.026694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3054539a-5550-456e-8d9a-b0af51e85ef3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:47.027120 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3054539a-5550-456e-8d9a-b0af51e85ef3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:47.089770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3054539a-5550-456e-8d9a-b0af51e85ef3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:47.098043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3054539a-5550-456e-8d9a-b0af51e85ef3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084408 Oct 28 20:24:47.098605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1291/2592] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:47 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:47.962300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b915bf22-0d04-42e3-a958-79d72221e20f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:47.963191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b915bf22-0d04-42e3-a958-79d72221e20f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:47.969889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b915bf22-0d04-42e3-a958-79d72221e20f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:47.970367 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b915bf22-0d04-42e3-a958-79d72221e20f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:47.970802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b915bf22-0d04-42e3-a958-79d72221e20f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:47.971483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b915bf22-0d04-42e3-a958-79d72221e20f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:47.971937 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b915bf22-0d04-42e3-a958-79d72221e20f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:47.972361 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b915bf22-0d04-42e3-a958-79d72221e20f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:48.104213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b915bf22-0d04-42e3-a958-79d72221e20f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:48.112138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b915bf22-0d04-42e3-a958-79d72221e20f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.153872 Oct 28 20:24:48.112723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1302/2593] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:47 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:48.126192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0d439297-2711-4154-b468-fa91fe839a9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:48.126967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0d439297-2711-4154-b468-fa91fe839a9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:48.134558 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d439297-2711-4154-b468-fa91fe839a9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:48.135044 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d439297-2711-4154-b468-fa91fe839a9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:48.135485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d439297-2711-4154-b468-fa91fe839a9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:48.136183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d439297-2711-4154-b468-fa91fe839a9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:48.136641 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d439297-2711-4154-b468-fa91fe839a9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:48.137065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d439297-2711-4154-b468-fa91fe839a9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:48.197155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0d439297-2711-4154-b468-fa91fe839a9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:48.205266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0d439297-2711-4154-b468-fa91fe839a9a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086589 Oct 28 20:24:48.205853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1292/2594] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:48 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:24:49.142613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-405b925a-3cff-4c86-8404-33db0c8c8b6d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:49.143226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-405b925a-3cff-4c86-8404-33db0c8c8b6d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:49.150492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-405b925a-3cff-4c86-8404-33db0c8c8b6d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:49.150974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-405b925a-3cff-4c86-8404-33db0c8c8b6d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:49.151409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-405b925a-3cff-4c86-8404-33db0c8c8b6d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:49.152090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-405b925a-3cff-4c86-8404-33db0c8c8b6d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:49.152540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-405b925a-3cff-4c86-8404-33db0c8c8b6d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:49.152961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-405b925a-3cff-4c86-8404-33db0c8c8b6d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:49.228096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a68f415-9acf-43b6-8c1f-1ad0a61b538c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:49.228708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6a68f415-9acf-43b6-8c1f-1ad0a61b538c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:49.235127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a68f415-9acf-43b6-8c1f-1ad0a61b538c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:49.235606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a68f415-9acf-43b6-8c1f-1ad0a61b538c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:49.236039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a68f415-9acf-43b6-8c1f-1ad0a61b538c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:49.236718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a68f415-9acf-43b6-8c1f-1ad0a61b538c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:49.237168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a68f415-9acf-43b6-8c1f-1ad0a61b538c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:49.237634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a68f415-9acf-43b6-8c1f-1ad0a61b538c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:49.290619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-405b925a-3cff-4c86-8404-33db0c8c8b6d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:49.298953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-405b925a-3cff-4c86-8404-33db0c8c8b6d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.160225 Oct 28 20:24:49.299610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1303/2595] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:49 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:49.309502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a68f415-9acf-43b6-8c1f-1ad0a61b538c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:49.318415 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a68f415-9acf-43b6-8c1f-1ad0a61b538c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.093680 Oct 28 20:24:49.318969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1293/2596] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:49 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:24:50.322997 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6b90420f-4988-4990-a55b-1fdcd5fe3f7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:50.323528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6b90420f-4988-4990-a55b-1fdcd5fe3f7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:50.330074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b90420f-4988-4990-a55b-1fdcd5fe3f7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:50.330558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b90420f-4988-4990-a55b-1fdcd5fe3f7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:50.330998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b90420f-4988-4990-a55b-1fdcd5fe3f7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:50.331810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b90420f-4988-4990-a55b-1fdcd5fe3f7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:50.332260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b90420f-4988-4990-a55b-1fdcd5fe3f7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:50.332690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b90420f-4988-4990-a55b-1fdcd5fe3f7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:50.335888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:50.342846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5a34f13d-fd3a-4c8d-8422-9c6396d2bf04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:50.344701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5a34f13d-fd3a-4c8d-8422-9c6396d2bf04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:50.350834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a34f13d-fd3a-4c8d-8422-9c6396d2bf04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:50.351371 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a34f13d-fd3a-4c8d-8422-9c6396d2bf04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:50.351813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a34f13d-fd3a-4c8d-8422-9c6396d2bf04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:50.352509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a34f13d-fd3a-4c8d-8422-9c6396d2bf04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:50.352973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a34f13d-fd3a-4c8d-8422-9c6396d2bf04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:50.353505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a34f13d-fd3a-4c8d-8422-9c6396d2bf04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:50.429248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5a34f13d-fd3a-4c8d-8422-9c6396d2bf04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:50.437480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5a34f13d-fd3a-4c8d-8422-9c6396d2bf04 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.098794 Oct 28 20:24:50.438057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1294/2597] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:50 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:24:50.486663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6b90420f-4988-4990-a55b-1fdcd5fe3f7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:50.494817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6b90420f-4988-4990-a55b-1fdcd5fe3f7b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.175978 Oct 28 20:24:50.495382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1304/2598] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:50 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:51.459785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a6ec728-349a-4870-94c3-54665729f8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:51.460397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9a6ec728-349a-4870-94c3-54665729f8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:51.467105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a6ec728-349a-4870-94c3-54665729f8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:51.467585 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a6ec728-349a-4870-94c3-54665729f8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:51.468025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a6ec728-349a-4870-94c3-54665729f8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:51.468703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a6ec728-349a-4870-94c3-54665729f8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:51.469154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a6ec728-349a-4870-94c3-54665729f8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:51.469609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a6ec728-349a-4870-94c3-54665729f8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:51.518116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf8dcb80-d891-4951-89b3-1f1a3406e5c8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:51.518735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cf8dcb80-d891-4951-89b3-1f1a3406e5c8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:51.525110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf8dcb80-d891-4951-89b3-1f1a3406e5c8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:51.527777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf8dcb80-d891-4951-89b3-1f1a3406e5c8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:51.527777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf8dcb80-d891-4951-89b3-1f1a3406e5c8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:51.527777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf8dcb80-d891-4951-89b3-1f1a3406e5c8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:51.527777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf8dcb80-d891-4951-89b3-1f1a3406e5c8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:51.528149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf8dcb80-d891-4951-89b3-1f1a3406e5c8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:51.532340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9a6ec728-349a-4870-94c3-54665729f8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:51.541031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9a6ec728-349a-4870-94c3-54665729f8cd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085071 Oct 28 20:24:51.541552 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1295/2599] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:51 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:51.659671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cf8dcb80-d891-4951-89b3-1f1a3406e5c8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:51.668417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cf8dcb80-d891-4951-89b3-1f1a3406e5c8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.154201 Oct 28 20:24:51.668975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1305/2600] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:51 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:24:52.565284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-89697e50-4c57-4960-b9ee-2d2ab1239e1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:52.565923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-89697e50-4c57-4960-b9ee-2d2ab1239e1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:52.573246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89697e50-4c57-4960-b9ee-2d2ab1239e1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:52.573799 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89697e50-4c57-4960-b9ee-2d2ab1239e1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:52.574247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89697e50-4c57-4960-b9ee-2d2ab1239e1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:52.574937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89697e50-4c57-4960-b9ee-2d2ab1239e1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:52.575396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89697e50-4c57-4960-b9ee-2d2ab1239e1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:52.575819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89697e50-4c57-4960-b9ee-2d2ab1239e1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:52.637959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-89697e50-4c57-4960-b9ee-2d2ab1239e1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:52.646295 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-89697e50-4c57-4960-b9ee-2d2ab1239e1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084951 Oct 28 20:24:52.646889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1296/2601] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:52 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:52.691698 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ca9ddc83-9b23-4a68-aef7-51894edd7008 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:52.692300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ca9ddc83-9b23-4a68-aef7-51894edd7008 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:52.699483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9ddc83-9b23-4a68-aef7-51894edd7008 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:52.699957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9ddc83-9b23-4a68-aef7-51894edd7008 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:52.700381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9ddc83-9b23-4a68-aef7-51894edd7008 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:52.701056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9ddc83-9b23-4a68-aef7-51894edd7008 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:52.701547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9ddc83-9b23-4a68-aef7-51894edd7008 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:52.701959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9ddc83-9b23-4a68-aef7-51894edd7008 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:52.830298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ca9ddc83-9b23-4a68-aef7-51894edd7008 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:52.839259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ca9ddc83-9b23-4a68-aef7-51894edd7008 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151308 Oct 28 20:24:52.839832 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1306/2602] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:52 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:53.668968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bbb5d08d-2798-4308-ab14-2cb58a84bb5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:53.669556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bbb5d08d-2798-4308-ab14-2cb58a84bb5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:53.675834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbb5d08d-2798-4308-ab14-2cb58a84bb5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:53.676326 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbb5d08d-2798-4308-ab14-2cb58a84bb5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:53.676768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbb5d08d-2798-4308-ab14-2cb58a84bb5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:53.678142 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbb5d08d-2798-4308-ab14-2cb58a84bb5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:53.678602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbb5d08d-2798-4308-ab14-2cb58a84bb5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:53.679028 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbb5d08d-2798-4308-ab14-2cb58a84bb5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:53.740409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bbb5d08d-2798-4308-ab14-2cb58a84bb5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:53.748490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bbb5d08d-2798-4308-ab14-2cb58a84bb5a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083453 Oct 28 20:24:53.749063 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1297/2603] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:53 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:53.862302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b2523cd4-ba59-4807-a072-f633ff4fe593 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:53.862913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b2523cd4-ba59-4807-a072-f633ff4fe593 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:53.869920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2523cd4-ba59-4807-a072-f633ff4fe593 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:53.870396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2523cd4-ba59-4807-a072-f633ff4fe593 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:53.870825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2523cd4-ba59-4807-a072-f633ff4fe593 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:53.871503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2523cd4-ba59-4807-a072-f633ff4fe593 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:53.871950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2523cd4-ba59-4807-a072-f633ff4fe593 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:53.872369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2523cd4-ba59-4807-a072-f633ff4fe593 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:53.999495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b2523cd4-ba59-4807-a072-f633ff4fe593 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:54.007604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b2523cd4-ba59-4807-a072-f633ff4fe593 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149044 Oct 28 20:24:54.008162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1307/2604] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:53 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:54.772740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-64ad74ec-2168-46c2-aafc-08bc99f291d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:54.773406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-64ad74ec-2168-46c2-aafc-08bc99f291d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:54.779373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ad74ec-2168-46c2-aafc-08bc99f291d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:54.779943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ad74ec-2168-46c2-aafc-08bc99f291d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:54.780392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ad74ec-2168-46c2-aafc-08bc99f291d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:54.781086 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ad74ec-2168-46c2-aafc-08bc99f291d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:54.781584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ad74ec-2168-46c2-aafc-08bc99f291d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:54.782017 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64ad74ec-2168-46c2-aafc-08bc99f291d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:54.845545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-64ad74ec-2168-46c2-aafc-08bc99f291d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:54.853601 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-64ad74ec-2168-46c2-aafc-08bc99f291d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086342 Oct 28 20:24:54.854165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1298/2605] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:54 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:55.031716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e8002f18-7230-432f-a4c9-79a792d3f3e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:55.032334 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e8002f18-7230-432f-a4c9-79a792d3f3e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:55.039039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8002f18-7230-432f-a4c9-79a792d3f3e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:55.039518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8002f18-7230-432f-a4c9-79a792d3f3e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:55.039955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8002f18-7230-432f-a4c9-79a792d3f3e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:55.040639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8002f18-7230-432f-a4c9-79a792d3f3e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:55.041091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8002f18-7230-432f-a4c9-79a792d3f3e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:55.041546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8002f18-7230-432f-a4c9-79a792d3f3e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:55.180177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e8002f18-7230-432f-a4c9-79a792d3f3e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:55.188250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e8002f18-7230-432f-a4c9-79a792d3f3e6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.160398 Oct 28 20:24:55.188813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1308/2606] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:55 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:55.876926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bb47e630-8268-4f0b-9c59-431306450d5e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:55.878827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bb47e630-8268-4f0b-9c59-431306450d5e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:55.885182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb47e630-8268-4f0b-9c59-431306450d5e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:55.885713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb47e630-8268-4f0b-9c59-431306450d5e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:55.886153 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb47e630-8268-4f0b-9c59-431306450d5e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:55.886940 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb47e630-8268-4f0b-9c59-431306450d5e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:55.888050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb47e630-8268-4f0b-9c59-431306450d5e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:55.888050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb47e630-8268-4f0b-9c59-431306450d5e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:55.951731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bb47e630-8268-4f0b-9c59-431306450d5e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:55.960544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bb47e630-8268-4f0b-9c59-431306450d5e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087579 Oct 28 20:24:55.961103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1299/2607] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:55 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:56.216381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8e71944e-a987-4bc2-ac0e-fb64abf85c46 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:56.217257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8e71944e-a987-4bc2-ac0e-fb64abf85c46 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:56.223933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e71944e-a987-4bc2-ac0e-fb64abf85c46 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:56.225008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e71944e-a987-4bc2-ac0e-fb64abf85c46 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:56.225480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e71944e-a987-4bc2-ac0e-fb64abf85c46 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:56.226197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e71944e-a987-4bc2-ac0e-fb64abf85c46 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:56.226652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e71944e-a987-4bc2-ac0e-fb64abf85c46 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:56.227077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e71944e-a987-4bc2-ac0e-fb64abf85c46 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:56.360084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8e71944e-a987-4bc2-ac0e-fb64abf85c46 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:56.368629 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8e71944e-a987-4bc2-ac0e-fb64abf85c46 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.156162 Oct 28 20:24:56.369195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1309/2608] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:56 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:56.983410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5099c724-68d9-4dd2-b1a2-48b5bb1191bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:56.984027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5099c724-68d9-4dd2-b1a2-48b5bb1191bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:56.990510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5099c724-68d9-4dd2-b1a2-48b5bb1191bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:56.990987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5099c724-68d9-4dd2-b1a2-48b5bb1191bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:56.991423 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5099c724-68d9-4dd2-b1a2-48b5bb1191bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:56.992103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5099c724-68d9-4dd2-b1a2-48b5bb1191bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:56.992555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5099c724-68d9-4dd2-b1a2-48b5bb1191bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:56.992978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5099c724-68d9-4dd2-b1a2-48b5bb1191bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:57.054415 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5099c724-68d9-4dd2-b1a2-48b5bb1191bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:57.062541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5099c724-68d9-4dd2-b1a2-48b5bb1191bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082999 Oct 28 20:24:57.063109 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1300/2609] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:56 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:57.392391 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e4e740f8-1e42-4dd1-9a52-a2fca6250d01 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:57.392949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e4e740f8-1e42-4dd1-9a52-a2fca6250d01 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:57.399596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4e740f8-1e42-4dd1-9a52-a2fca6250d01 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:57.400101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4e740f8-1e42-4dd1-9a52-a2fca6250d01 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:57.405935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4e740f8-1e42-4dd1-9a52-a2fca6250d01 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:57.405935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4e740f8-1e42-4dd1-9a52-a2fca6250d01 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:57.405935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4e740f8-1e42-4dd1-9a52-a2fca6250d01 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:57.405935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4e740f8-1e42-4dd1-9a52-a2fca6250d01 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:57.531832 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e4e740f8-1e42-4dd1-9a52-a2fca6250d01 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:57.540489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e4e740f8-1e42-4dd1-9a52-a2fca6250d01 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152087 Oct 28 20:24:57.541049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1310/2610] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:57 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:58.086184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2427c706-965e-46b7-8c15-ece353050acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:58.086843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2427c706-965e-46b7-8c15-ece353050acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:58.093600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2427c706-965e-46b7-8c15-ece353050acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:58.094113 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2427c706-965e-46b7-8c15-ece353050acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:58.094555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2427c706-965e-46b7-8c15-ece353050acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:58.095272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2427c706-965e-46b7-8c15-ece353050acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:58.095730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2427c706-965e-46b7-8c15-ece353050acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:58.096160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2427c706-965e-46b7-8c15-ece353050acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:58.157787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2427c706-965e-46b7-8c15-ece353050acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:58.172671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2427c706-965e-46b7-8c15-ece353050acd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.090451 Oct 28 20:24:58.173261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1301/2611] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:58 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:58.563961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-23b8950c-4f99-4383-8411-b115a863c424 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:58.564568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-23b8950c-4f99-4383-8411-b115a863c424 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:58.571191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23b8950c-4f99-4383-8411-b115a863c424 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:58.571677 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23b8950c-4f99-4383-8411-b115a863c424 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:58.572114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23b8950c-4f99-4383-8411-b115a863c424 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:58.572808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23b8950c-4f99-4383-8411-b115a863c424 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:58.573281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23b8950c-4f99-4383-8411-b115a863c424 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:58.573731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23b8950c-4f99-4383-8411-b115a863c424 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:58.704240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-23b8950c-4f99-4383-8411-b115a863c424 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:58.713064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-23b8950c-4f99-4383-8411-b115a863c424 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152943 Oct 28 20:24:58.713671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1311/2612] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:58 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:59.197076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0072cabd-2194-46eb-bbe2-8c3b3e874d03 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:59.197736 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0072cabd-2194-46eb-bbe2-8c3b3e874d03 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:59.204215 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0072cabd-2194-46eb-bbe2-8c3b3e874d03 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:59.204705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0072cabd-2194-46eb-bbe2-8c3b3e874d03 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:59.205145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0072cabd-2194-46eb-bbe2-8c3b3e874d03 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:59.205868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0072cabd-2194-46eb-bbe2-8c3b3e874d03 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:59.206325 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0072cabd-2194-46eb-bbe2-8c3b3e874d03 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:59.206752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0072cabd-2194-46eb-bbe2-8c3b3e874d03 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:59.267570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0072cabd-2194-46eb-bbe2-8c3b3e874d03 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:59.276510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0072cabd-2194-46eb-bbe2-8c3b3e874d03 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083893 Oct 28 20:24:59.277080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1302/2613] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:59 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:59.738055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-24ed7ab1-6f5b-47b5-af3a-6ec1f3894694 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:59.738707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-24ed7ab1-6f5b-47b5-af3a-6ec1f3894694 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:59.745956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24ed7ab1-6f5b-47b5-af3a-6ec1f3894694 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:59.746572 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24ed7ab1-6f5b-47b5-af3a-6ec1f3894694 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:59.747023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24ed7ab1-6f5b-47b5-af3a-6ec1f3894694 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:59.747715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24ed7ab1-6f5b-47b5-af3a-6ec1f3894694 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:59.748172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24ed7ab1-6f5b-47b5-af3a-6ec1f3894694 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:59.748599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24ed7ab1-6f5b-47b5-af3a-6ec1f3894694 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:59.889251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-24ed7ab1-6f5b-47b5-af3a-6ec1f3894694 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:59.902176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-24ed7ab1-6f5b-47b5-af3a-6ec1f3894694 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.163352 Oct 28 20:24:59.902176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1312/2614] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:59 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:00.299088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3269b1e2-7fad-46f1-b368-3b7b893b7abf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:00.299735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3269b1e2-7fad-46f1-b368-3b7b893b7abf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:00.307257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3269b1e2-7fad-46f1-b368-3b7b893b7abf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:00.307745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3269b1e2-7fad-46f1-b368-3b7b893b7abf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:00.308187 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3269b1e2-7fad-46f1-b368-3b7b893b7abf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:00.308881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3269b1e2-7fad-46f1-b368-3b7b893b7abf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:00.309365 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3269b1e2-7fad-46f1-b368-3b7b893b7abf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:00.309803 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3269b1e2-7fad-46f1-b368-3b7b893b7abf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:00.372325 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3269b1e2-7fad-46f1-b368-3b7b893b7abf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:00.381201 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3269b1e2-7fad-46f1-b368-3b7b893b7abf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085424 Oct 28 20:25:00.382551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1303/2615] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:00 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:00.920964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-73bf7d30-d751-496b-8cc3-ad78735ec912 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:00.924617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-73bf7d30-d751-496b-8cc3-ad78735ec912 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:00.929946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73bf7d30-d751-496b-8cc3-ad78735ec912 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:00.930440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73bf7d30-d751-496b-8cc3-ad78735ec912 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:00.930880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73bf7d30-d751-496b-8cc3-ad78735ec912 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:00.931579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73bf7d30-d751-496b-8cc3-ad78735ec912 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:00.932029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73bf7d30-d751-496b-8cc3-ad78735ec912 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:00.932778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73bf7d30-d751-496b-8cc3-ad78735ec912 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:00.934446 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-a54a2d86-77eb-45b3-ba3e-8f8a15990915 req-5f409c20-30c6-4b08-ba1a-b60640f5d7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf57f68e-5160-4fec-98e7-a8f9f9480b72", "name": "network-vif-deleted", "tag": "eb535d9c-e24b-43d0-b8b6-bf1d7e7de721"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:25:00.943627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a54a2d86-77eb-45b3-ba3e-8f8a15990915 req-5f409c20-30c6-4b08-ba1a-b60640f5d7a2 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:00.944101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a54a2d86-77eb-45b3-ba3e-8f8a15990915 req-5f409c20-30c6-4b08-ba1a-b60640f5d7a2 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:00.944526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a54a2d86-77eb-45b3-ba3e-8f8a15990915 req-5f409c20-30c6-4b08-ba1a-b60640f5d7a2 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:00.955273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-a54a2d86-77eb-45b3-ba3e-8f8a15990915 req-5f409c20-30c6-4b08-ba1a-b60640f5d7a2 service nova] Creating event network-vif-deleted:eb535d9c-e24b-43d0-b8b6-bf1d7e7de721 for instance cf57f68e-5160-4fec-98e7-a8f9f9480b72 on hv-cinder-86236 Oct 28 20:25:00.960911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-a54a2d86-77eb-45b3-ba3e-8f8a15990915 req-5f409c20-30c6-4b08-ba1a-b60640f5d7a2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030172 Oct 28 20:25:00.961532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1304/2616] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:25:01.065748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-73bf7d30-d751-496b-8cc3-ad78735ec912 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:01.074005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-73bf7d30-d751-496b-8cc3-ad78735ec912 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.157865 Oct 28 20:25:01.074571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1313/2617] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:00 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:01.404829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ad6891d3-7578-4cbc-925d-dcffe7525abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:01.405560 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ad6891d3-7578-4cbc-925d-dcffe7525abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:01.411609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad6891d3-7578-4cbc-925d-dcffe7525abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:01.412092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad6891d3-7578-4cbc-925d-dcffe7525abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:01.412517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad6891d3-7578-4cbc-925d-dcffe7525abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:01.413194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad6891d3-7578-4cbc-925d-dcffe7525abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:01.413668 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad6891d3-7578-4cbc-925d-dcffe7525abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:01.414088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad6891d3-7578-4cbc-925d-dcffe7525abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:01.482050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ad6891d3-7578-4cbc-925d-dcffe7525abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:01.490230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ad6891d3-7578-4cbc-925d-dcffe7525abd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.089964 Oct 28 20:25:01.490795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1305/2618] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:01 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:02.098002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ca24bba5-8fa9-454f-bde4-048436419015 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:02.098625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ca24bba5-8fa9-454f-bde4-048436419015 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:02.106026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca24bba5-8fa9-454f-bde4-048436419015 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:02.106513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca24bba5-8fa9-454f-bde4-048436419015 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:02.106953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca24bba5-8fa9-454f-bde4-048436419015 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:02.107644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca24bba5-8fa9-454f-bde4-048436419015 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:02.108100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca24bba5-8fa9-454f-bde4-048436419015 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:02.108528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca24bba5-8fa9-454f-bde4-048436419015 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:02.252759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ca24bba5-8fa9-454f-bde4-048436419015 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:02.261560 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ca24bba5-8fa9-454f-bde4-048436419015 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.167408 Oct 28 20:25:02.262273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1314/2619] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:02 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:02.513437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ec1805ab-4d75-4b6b-a3ac-581f28f4ffc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:02.513990 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ec1805ab-4d75-4b6b-a3ac-581f28f4ffc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:02.520425 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1805ab-4d75-4b6b-a3ac-581f28f4ffc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:02.521434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1805ab-4d75-4b6b-a3ac-581f28f4ffc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:02.521881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1805ab-4d75-4b6b-a3ac-581f28f4ffc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:02.522563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1805ab-4d75-4b6b-a3ac-581f28f4ffc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:02.523125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1805ab-4d75-4b6b-a3ac-581f28f4ffc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:02.524394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec1805ab-4d75-4b6b-a3ac-581f28f4ffc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:02.586340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ec1805ab-4d75-4b6b-a3ac-581f28f4ffc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:02.594646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ec1805ab-4d75-4b6b-a3ac-581f28f4ffc1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085239 Oct 28 20:25:02.595203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1306/2620] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:02 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:03.285455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fdbcad7f-b071-41ed-80bd-ba54e9b839ad tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:03.285994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fdbcad7f-b071-41ed-80bd-ba54e9b839ad tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:03.292962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdbcad7f-b071-41ed-80bd-ba54e9b839ad tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:03.293481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdbcad7f-b071-41ed-80bd-ba54e9b839ad tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:03.293915 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdbcad7f-b071-41ed-80bd-ba54e9b839ad tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:03.294596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdbcad7f-b071-41ed-80bd-ba54e9b839ad tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:03.295042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdbcad7f-b071-41ed-80bd-ba54e9b839ad tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:03.295483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdbcad7f-b071-41ed-80bd-ba54e9b839ad tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:03.431912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fdbcad7f-b071-41ed-80bd-ba54e9b839ad tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:03.440369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fdbcad7f-b071-41ed-80bd-ba54e9b839ad tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.158802 Oct 28 20:25:03.440927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1315/2621] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:03 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:03.617960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0bb23ea9-4077-4c3b-b380-d6d86e06e80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:03.618505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0bb23ea9-4077-4c3b-b380-d6d86e06e80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:03.624877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bb23ea9-4077-4c3b-b380-d6d86e06e80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:03.625448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bb23ea9-4077-4c3b-b380-d6d86e06e80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:03.625863 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bb23ea9-4077-4c3b-b380-d6d86e06e80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:03.626544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bb23ea9-4077-4c3b-b380-d6d86e06e80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:03.627000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bb23ea9-4077-4c3b-b380-d6d86e06e80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:03.627424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bb23ea9-4077-4c3b-b380-d6d86e06e80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:03.632232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:03.693749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0bb23ea9-4077-4c3b-b380-d6d86e06e80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:03.701952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0bb23ea9-4077-4c3b-b380-d6d86e06e80f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.088013 Oct 28 20:25:03.702517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1307/2622] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:03 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:04.464036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-61d744cf-fc8b-4697-82cc-6a93aa12f87f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:04.464653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-61d744cf-fc8b-4697-82cc-6a93aa12f87f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:04.471461 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61d744cf-fc8b-4697-82cc-6a93aa12f87f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:04.471943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61d744cf-fc8b-4697-82cc-6a93aa12f87f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:04.472384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61d744cf-fc8b-4697-82cc-6a93aa12f87f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:04.473072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61d744cf-fc8b-4697-82cc-6a93aa12f87f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:04.473565 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61d744cf-fc8b-4697-82cc-6a93aa12f87f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:04.474711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61d744cf-fc8b-4697-82cc-6a93aa12f87f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:04.603349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-61d744cf-fc8b-4697-82cc-6a93aa12f87f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:04.611348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-61d744cf-fc8b-4697-82cc-6a93aa12f87f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151173 Oct 28 20:25:04.611914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1316/2623] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:04 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:04.726318 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f1af8fe6-69b5-4638-810a-d5b9e4000b21 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:04.726853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f1af8fe6-69b5-4638-810a-d5b9e4000b21 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:04.733950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1af8fe6-69b5-4638-810a-d5b9e4000b21 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:04.738654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1af8fe6-69b5-4638-810a-d5b9e4000b21 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:04.738654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1af8fe6-69b5-4638-810a-d5b9e4000b21 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:04.738654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1af8fe6-69b5-4638-810a-d5b9e4000b21 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:04.738654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1af8fe6-69b5-4638-810a-d5b9e4000b21 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:04.739077 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1af8fe6-69b5-4638-810a-d5b9e4000b21 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:04.796412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f1af8fe6-69b5-4638-810a-d5b9e4000b21 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:04.805110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f1af8fe6-69b5-4638-810a-d5b9e4000b21 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082774 Oct 28 20:25:04.805844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1308/2624] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:04 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:05.635066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee56a366-9113-4bb2-b219-aa2cca136efc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:05.635614 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee56a366-9113-4bb2-b219-aa2cca136efc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:05.641987 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee56a366-9113-4bb2-b219-aa2cca136efc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:05.642469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee56a366-9113-4bb2-b219-aa2cca136efc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:05.642934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee56a366-9113-4bb2-b219-aa2cca136efc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:05.643618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee56a366-9113-4bb2-b219-aa2cca136efc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:05.644070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee56a366-9113-4bb2-b219-aa2cca136efc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:05.644491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee56a366-9113-4bb2-b219-aa2cca136efc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:05.774225 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee56a366-9113-4bb2-b219-aa2cca136efc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:05.782726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee56a366-9113-4bb2-b219-aa2cca136efc tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152431 Oct 28 20:25:05.783299 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1317/2625] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:05 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:05.828126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-39fe4696-49dc-4e28-8c95-2c2e920c142c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:05.828746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-39fe4696-49dc-4e28-8c95-2c2e920c142c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:05.835955 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39fe4696-49dc-4e28-8c95-2c2e920c142c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:05.836445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39fe4696-49dc-4e28-8c95-2c2e920c142c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:05.836889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39fe4696-49dc-4e28-8c95-2c2e920c142c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:05.837614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39fe4696-49dc-4e28-8c95-2c2e920c142c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:05.838078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39fe4696-49dc-4e28-8c95-2c2e920c142c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:05.838529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39fe4696-49dc-4e28-8c95-2c2e920c142c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:05.900401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-39fe4696-49dc-4e28-8c95-2c2e920c142c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:05.908449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-39fe4696-49dc-4e28-8c95-2c2e920c142c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084148 Oct 28 20:25:05.909012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1309/2626] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:05 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:06.806102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b94dfa71-7620-49a5-b5a2-13cb31af4a0d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:06.806705 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b94dfa71-7620-49a5-b5a2-13cb31af4a0d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:06.813119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b94dfa71-7620-49a5-b5a2-13cb31af4a0d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:06.813637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b94dfa71-7620-49a5-b5a2-13cb31af4a0d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:06.814082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b94dfa71-7620-49a5-b5a2-13cb31af4a0d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:06.814770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b94dfa71-7620-49a5-b5a2-13cb31af4a0d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:06.815226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b94dfa71-7620-49a5-b5a2-13cb31af4a0d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:06.815653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b94dfa71-7620-49a5-b5a2-13cb31af4a0d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:06.931611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01a3ee04-604d-4a4c-aa16-78016a47c13d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:06.932220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-01a3ee04-604d-4a4c-aa16-78016a47c13d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:06.938912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a3ee04-604d-4a4c-aa16-78016a47c13d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:06.939401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a3ee04-604d-4a4c-aa16-78016a47c13d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:06.939847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a3ee04-604d-4a4c-aa16-78016a47c13d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:06.940544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a3ee04-604d-4a4c-aa16-78016a47c13d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:06.941005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a3ee04-604d-4a4c-aa16-78016a47c13d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:06.941453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a3ee04-604d-4a4c-aa16-78016a47c13d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:06.948743 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b94dfa71-7620-49a5-b5a2-13cb31af4a0d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:06.957116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b94dfa71-7620-49a5-b5a2-13cb31af4a0d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.155281 Oct 28 20:25:06.957788 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1318/2627] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:06 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:07.004261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-01a3ee04-604d-4a4c-aa16-78016a47c13d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:07.013150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-01a3ee04-604d-4a4c-aa16-78016a47c13d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085762 Oct 28 20:25:07.013781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1310/2628] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:06 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:25:07.981165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-43b4a009-6951-4fb7-9ab8-43c2154da2f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:07.981807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-43b4a009-6951-4fb7-9ab8-43c2154da2f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:07.988104 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43b4a009-6951-4fb7-9ab8-43c2154da2f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:07.988581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43b4a009-6951-4fb7-9ab8-43c2154da2f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:07.989012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43b4a009-6951-4fb7-9ab8-43c2154da2f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:07.989720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43b4a009-6951-4fb7-9ab8-43c2154da2f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:07.990167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43b4a009-6951-4fb7-9ab8-43c2154da2f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:07.990593 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43b4a009-6951-4fb7-9ab8-43c2154da2f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:08.036930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b3f14a2-b24a-4f21-82cf-e098cf6a07d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:08.037612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9b3f14a2-b24a-4f21-82cf-e098cf6a07d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:08.043772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b3f14a2-b24a-4f21-82cf-e098cf6a07d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:08.044252 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b3f14a2-b24a-4f21-82cf-e098cf6a07d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:08.044689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b3f14a2-b24a-4f21-82cf-e098cf6a07d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:08.045409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b3f14a2-b24a-4f21-82cf-e098cf6a07d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:08.045863 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b3f14a2-b24a-4f21-82cf-e098cf6a07d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:08.046287 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b3f14a2-b24a-4f21-82cf-e098cf6a07d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:08.117871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9b3f14a2-b24a-4f21-82cf-e098cf6a07d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:08.125990 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b3f14a2-b24a-4f21-82cf-e098cf6a07d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.092791 Oct 28 20:25:08.126756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1311/2629] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:08 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:08.144704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-43b4a009-6951-4fb7-9ab8-43c2154da2f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:08.153689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-43b4a009-6951-4fb7-9ab8-43c2154da2f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.176332 Oct 28 20:25:08.154238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1319/2630] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:07 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:09.149887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-393802dd-39b4-47d0-8723-963818d6e876 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:09.150493 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-393802dd-39b4-47d0-8723-963818d6e876 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:09.156727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-393802dd-39b4-47d0-8723-963818d6e876 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:09.157209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-393802dd-39b4-47d0-8723-963818d6e876 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:09.157785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-393802dd-39b4-47d0-8723-963818d6e876 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:09.158461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-393802dd-39b4-47d0-8723-963818d6e876 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:09.158911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-393802dd-39b4-47d0-8723-963818d6e876 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:09.159331 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-393802dd-39b4-47d0-8723-963818d6e876 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:09.175849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3b756f18-a6c9-45e1-90ba-933f69ca2f2d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:09.176467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3b756f18-a6c9-45e1-90ba-933f69ca2f2d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:09.184099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b756f18-a6c9-45e1-90ba-933f69ca2f2d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:09.184584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b756f18-a6c9-45e1-90ba-933f69ca2f2d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:09.185024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b756f18-a6c9-45e1-90ba-933f69ca2f2d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:09.185747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b756f18-a6c9-45e1-90ba-933f69ca2f2d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:09.186206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b756f18-a6c9-45e1-90ba-933f69ca2f2d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:09.186633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b756f18-a6c9-45e1-90ba-933f69ca2f2d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:09.224843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-393802dd-39b4-47d0-8723-963818d6e876 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:09.233269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-393802dd-39b4-47d0-8723-963818d6e876 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087654 Oct 28 20:25:09.233866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1312/2631] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:09 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:09.320170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3b756f18-a6c9-45e1-90ba-933f69ca2f2d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:09.322345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:09.329019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3b756f18-a6c9-45e1-90ba-933f69ca2f2d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.156995 Oct 28 20:25:09.329636 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1320/2632] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:09 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:25:10.256688 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3bb20390-e368-457b-825a-913d2e8b6156 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:10.257249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3bb20390-e368-457b-825a-913d2e8b6156 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:10.264472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bb20390-e368-457b-825a-913d2e8b6156 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:10.265062 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bb20390-e368-457b-825a-913d2e8b6156 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:10.265533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bb20390-e368-457b-825a-913d2e8b6156 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:10.266217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bb20390-e368-457b-825a-913d2e8b6156 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:10.266664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bb20390-e368-457b-825a-913d2e8b6156 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:10.267085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bb20390-e368-457b-825a-913d2e8b6156 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:10.330432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3bb20390-e368-457b-825a-913d2e8b6156 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:10.339389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3bb20390-e368-457b-825a-913d2e8b6156 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087153 Oct 28 20:25:10.340009 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1313/2633] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:10 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:25:10.359135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a10bcf5b-12ad-4425-aafa-c4836d5b50bf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:10.359746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a10bcf5b-12ad-4425-aafa-c4836d5b50bf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:10.366755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a10bcf5b-12ad-4425-aafa-c4836d5b50bf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:10.367226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a10bcf5b-12ad-4425-aafa-c4836d5b50bf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:10.367662 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a10bcf5b-12ad-4425-aafa-c4836d5b50bf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:10.368337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a10bcf5b-12ad-4425-aafa-c4836d5b50bf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:10.368789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a10bcf5b-12ad-4425-aafa-c4836d5b50bf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:10.369212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a10bcf5b-12ad-4425-aafa-c4836d5b50bf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:10.498938 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a10bcf5b-12ad-4425-aafa-c4836d5b50bf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:10.507738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a10bcf5b-12ad-4425-aafa-c4836d5b50bf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152664 Oct 28 20:25:10.508246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1321/2634] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:10 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:11.362613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1af21380-08dc-4782-bd7b-fea5993be712 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:11.363306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1af21380-08dc-4782-bd7b-fea5993be712 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:11.365987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=58 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:11.370639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af21380-08dc-4782-bd7b-fea5993be712 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:11.378809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af21380-08dc-4782-bd7b-fea5993be712 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:11.378809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af21380-08dc-4782-bd7b-fea5993be712 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:11.378809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af21380-08dc-4782-bd7b-fea5993be712 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:11.378809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af21380-08dc-4782-bd7b-fea5993be712 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:11.379265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af21380-08dc-4782-bd7b-fea5993be712 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:11.434074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1af21380-08dc-4782-bd7b-fea5993be712 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:11.442141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1af21380-08dc-4782-bd7b-fea5993be712 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083423 Oct 28 20:25:11.442702 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1314/2635] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:11 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:11.531438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-54eb5237-0b5a-4f18-8a5a-e99cedab5a9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:11.532057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-54eb5237-0b5a-4f18-8a5a-e99cedab5a9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:11.539004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54eb5237-0b5a-4f18-8a5a-e99cedab5a9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:11.539491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54eb5237-0b5a-4f18-8a5a-e99cedab5a9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:11.539931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54eb5237-0b5a-4f18-8a5a-e99cedab5a9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:11.540615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54eb5237-0b5a-4f18-8a5a-e99cedab5a9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:11.541071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54eb5237-0b5a-4f18-8a5a-e99cedab5a9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:11.541530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54eb5237-0b5a-4f18-8a5a-e99cedab5a9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:11.669582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-54eb5237-0b5a-4f18-8a5a-e99cedab5a9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:11.677568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-54eb5237-0b5a-4f18-8a5a-e99cedab5a9a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149960 Oct 28 20:25:11.678774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1322/2636] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:11 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:12.466717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-654ac114-9ffb-4185-84b9-c6d23e38e7b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:12.468891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-654ac114-9ffb-4185-84b9-c6d23e38e7b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:12.474086 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654ac114-9ffb-4185-84b9-c6d23e38e7b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:12.474576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654ac114-9ffb-4185-84b9-c6d23e38e7b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:12.475586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654ac114-9ffb-4185-84b9-c6d23e38e7b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:12.476309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654ac114-9ffb-4185-84b9-c6d23e38e7b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:12.476771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654ac114-9ffb-4185-84b9-c6d23e38e7b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:12.477199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654ac114-9ffb-4185-84b9-c6d23e38e7b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:12.541425 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-654ac114-9ffb-4185-84b9-c6d23e38e7b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:12.549948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-654ac114-9ffb-4185-84b9-c6d23e38e7b8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087245 Oct 28 20:25:12.550501 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1315/2637] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:12 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:12.701528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e2809da4-aad8-4dd8-9ad8-091da2a04a0b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:12.702148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e2809da4-aad8-4dd8-9ad8-091da2a04a0b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:12.708793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2809da4-aad8-4dd8-9ad8-091da2a04a0b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:12.709604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2809da4-aad8-4dd8-9ad8-091da2a04a0b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:12.710058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2809da4-aad8-4dd8-9ad8-091da2a04a0b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:12.710753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2809da4-aad8-4dd8-9ad8-091da2a04a0b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:12.711210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2809da4-aad8-4dd8-9ad8-091da2a04a0b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:12.711638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2809da4-aad8-4dd8-9ad8-091da2a04a0b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:12.839717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e2809da4-aad8-4dd8-9ad8-091da2a04a0b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:12.848148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e2809da4-aad8-4dd8-9ad8-091da2a04a0b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150541 Oct 28 20:25:12.848709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1323/2638] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:12 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:13.573541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-30360f4e-f6cf-4c97-b9ca-bbafd372e2ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:13.574152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-30360f4e-f6cf-4c97-b9ca-bbafd372e2ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:13.580517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30360f4e-f6cf-4c97-b9ca-bbafd372e2ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:13.580995 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30360f4e-f6cf-4c97-b9ca-bbafd372e2ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:13.581453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30360f4e-f6cf-4c97-b9ca-bbafd372e2ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:13.582130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30360f4e-f6cf-4c97-b9ca-bbafd372e2ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:13.582579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30360f4e-f6cf-4c97-b9ca-bbafd372e2ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:13.582998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30360f4e-f6cf-4c97-b9ca-bbafd372e2ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:13.643668 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-30360f4e-f6cf-4c97-b9ca-bbafd372e2ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:13.655490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-30360f4e-f6cf-4c97-b9ca-bbafd372e2ff tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085810 Oct 28 20:25:13.656049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1316/2639] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:13 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:13.872061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-afcd080b-1282-4e4b-a0a1-69d6e76fd12a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:13.872609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-afcd080b-1282-4e4b-a0a1-69d6e76fd12a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:13.874947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=52 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:13.879544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afcd080b-1282-4e4b-a0a1-69d6e76fd12a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:13.884757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afcd080b-1282-4e4b-a0a1-69d6e76fd12a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:13.884757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afcd080b-1282-4e4b-a0a1-69d6e76fd12a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:13.884757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afcd080b-1282-4e4b-a0a1-69d6e76fd12a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:13.884757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afcd080b-1282-4e4b-a0a1-69d6e76fd12a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:13.885275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afcd080b-1282-4e4b-a0a1-69d6e76fd12a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:14.027588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-afcd080b-1282-4e4b-a0a1-69d6e76fd12a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:14.038714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-afcd080b-1282-4e4b-a0a1-69d6e76fd12a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.170458 Oct 28 20:25:14.039554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1324/2640] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:13 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:14.685237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-52183f9e-d23a-4faa-876c-14d6c791a695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:14.685237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-52183f9e-d23a-4faa-876c-14d6c791a695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:14.685237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52183f9e-d23a-4faa-876c-14d6c791a695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:14.686039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52183f9e-d23a-4faa-876c-14d6c791a695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:14.686039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52183f9e-d23a-4faa-876c-14d6c791a695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:14.686549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52183f9e-d23a-4faa-876c-14d6c791a695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:14.687003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52183f9e-d23a-4faa-876c-14d6c791a695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:14.687417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52183f9e-d23a-4faa-876c-14d6c791a695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:14.748213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-52183f9e-d23a-4faa-876c-14d6c791a695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:14.757072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-52183f9e-d23a-4faa-876c-14d6c791a695 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082301 Oct 28 20:25:14.757661 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1317/2641] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:14 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:15.062184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6115178e-e16b-4099-86bb-77dc5a67b342 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:15.062806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6115178e-e16b-4099-86bb-77dc5a67b342 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:15.070096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6115178e-e16b-4099-86bb-77dc5a67b342 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:15.070583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6115178e-e16b-4099-86bb-77dc5a67b342 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:15.071030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6115178e-e16b-4099-86bb-77dc5a67b342 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:15.071718 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6115178e-e16b-4099-86bb-77dc5a67b342 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:15.072174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6115178e-e16b-4099-86bb-77dc5a67b342 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:15.072664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6115178e-e16b-4099-86bb-77dc5a67b342 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:15.198686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6115178e-e16b-4099-86bb-77dc5a67b342 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:15.207486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6115178e-e16b-4099-86bb-77dc5a67b342 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149230 Oct 28 20:25:15.208052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1325/2642] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:15 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:15.780158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d544dda5-1604-4377-811c-5f05b10a8932 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:15.780781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d544dda5-1604-4377-811c-5f05b10a8932 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:15.787158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d544dda5-1604-4377-811c-5f05b10a8932 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:15.788189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d544dda5-1604-4377-811c-5f05b10a8932 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:15.788646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d544dda5-1604-4377-811c-5f05b10a8932 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:15.789347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d544dda5-1604-4377-811c-5f05b10a8932 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:15.789814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d544dda5-1604-4377-811c-5f05b10a8932 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:15.790245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d544dda5-1604-4377-811c-5f05b10a8932 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:15.856688 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d544dda5-1604-4377-811c-5f05b10a8932 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:15.864890 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d544dda5-1604-4377-811c-5f05b10a8932 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.088612 Oct 28 20:25:15.866039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1318/2643] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:15 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:16.230892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf2cb1f2-8af4-45e5-9c8e-dd01bb954b27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:16.231731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bf2cb1f2-8af4-45e5-9c8e-dd01bb954b27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:16.241650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf2cb1f2-8af4-45e5-9c8e-dd01bb954b27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:16.242325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf2cb1f2-8af4-45e5-9c8e-dd01bb954b27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:16.243288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf2cb1f2-8af4-45e5-9c8e-dd01bb954b27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:16.243288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf2cb1f2-8af4-45e5-9c8e-dd01bb954b27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:16.243887 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf2cb1f2-8af4-45e5-9c8e-dd01bb954b27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:16.244320 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf2cb1f2-8af4-45e5-9c8e-dd01bb954b27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:16.374164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bf2cb1f2-8af4-45e5-9c8e-dd01bb954b27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:16.382386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bf2cb1f2-8af4-45e5-9c8e-dd01bb954b27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.155343 Oct 28 20:25:16.382948 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1326/2644] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:16 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:25:16.887783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7710925f-b90a-493b-aac0-e5e9eb383f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:16.888424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7710925f-b90a-493b-aac0-e5e9eb383f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:16.894706 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7710925f-b90a-493b-aac0-e5e9eb383f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:16.895183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7710925f-b90a-493b-aac0-e5e9eb383f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:16.895611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7710925f-b90a-493b-aac0-e5e9eb383f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:16.896283 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7710925f-b90a-493b-aac0-e5e9eb383f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:16.896791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7710925f-b90a-493b-aac0-e5e9eb383f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:16.897217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7710925f-b90a-493b-aac0-e5e9eb383f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:16.957866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7710925f-b90a-493b-aac0-e5e9eb383f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:16.965964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7710925f-b90a-493b-aac0-e5e9eb383f88 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082006 Oct 28 20:25:16.966524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1319/2645] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:16 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:17.405286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c64a6991-572d-4074-9c60-35ccb3d9fd12 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:17.405955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c64a6991-572d-4074-9c60-35ccb3d9fd12 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:17.413061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64a6991-572d-4074-9c60-35ccb3d9fd12 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:17.413614 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64a6991-572d-4074-9c60-35ccb3d9fd12 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:17.414071 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64a6991-572d-4074-9c60-35ccb3d9fd12 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:17.414765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64a6991-572d-4074-9c60-35ccb3d9fd12 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:17.415224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64a6991-572d-4074-9c60-35ccb3d9fd12 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:17.415651 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64a6991-572d-4074-9c60-35ccb3d9fd12 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:17.551429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c64a6991-572d-4074-9c60-35ccb3d9fd12 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:17.559568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c64a6991-572d-4074-9c60-35ccb3d9fd12 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.158137 Oct 28 20:25:17.560126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1327/2646] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:17 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:17.989272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1ef4f7c3-6a27-45fb-8079-6ca7773473f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:17.989907 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1ef4f7c3-6a27-45fb-8079-6ca7773473f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:17.996977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ef4f7c3-6a27-45fb-8079-6ca7773473f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:17.997493 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ef4f7c3-6a27-45fb-8079-6ca7773473f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:17.997928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ef4f7c3-6a27-45fb-8079-6ca7773473f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:17.998606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ef4f7c3-6a27-45fb-8079-6ca7773473f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:17.999053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ef4f7c3-6a27-45fb-8079-6ca7773473f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:17.999473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ef4f7c3-6a27-45fb-8079-6ca7773473f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:18.060437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1ef4f7c3-6a27-45fb-8079-6ca7773473f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:18.068490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1ef4f7c3-6a27-45fb-8079-6ca7773473f0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083052 Oct 28 20:25:18.069031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1320/2647] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:17 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:18.582294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-37e97e4e-2ddb-40fc-9a88-8bad2be3dcfa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:18.582909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-37e97e4e-2ddb-40fc-9a88-8bad2be3dcfa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:18.589973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37e97e4e-2ddb-40fc-9a88-8bad2be3dcfa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:18.590457 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37e97e4e-2ddb-40fc-9a88-8bad2be3dcfa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:18.590897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37e97e4e-2ddb-40fc-9a88-8bad2be3dcfa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:18.591582 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37e97e4e-2ddb-40fc-9a88-8bad2be3dcfa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:18.592279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37e97e4e-2ddb-40fc-9a88-8bad2be3dcfa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:18.592715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37e97e4e-2ddb-40fc-9a88-8bad2be3dcfa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:18.719950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-37e97e4e-2ddb-40fc-9a88-8bad2be3dcfa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:18.728179 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-37e97e4e-2ddb-40fc-9a88-8bad2be3dcfa tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149805 Oct 28 20:25:18.728749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1328/2648] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:18 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:19.091234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-74caa97f-a98a-4a55-9693-cd27cc885ad8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:19.091849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-74caa97f-a98a-4a55-9693-cd27cc885ad8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:19.098473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74caa97f-a98a-4a55-9693-cd27cc885ad8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:19.098954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74caa97f-a98a-4a55-9693-cd27cc885ad8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:19.099397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74caa97f-a98a-4a55-9693-cd27cc885ad8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:19.100656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74caa97f-a98a-4a55-9693-cd27cc885ad8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:19.101191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74caa97f-a98a-4a55-9693-cd27cc885ad8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:19.101642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74caa97f-a98a-4a55-9693-cd27cc885ad8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:19.166026 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-74caa97f-a98a-4a55-9693-cd27cc885ad8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:19.174119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-74caa97f-a98a-4a55-9693-cd27cc885ad8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086776 Oct 28 20:25:19.174685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1321/2649] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:19 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:19.751480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f8989d20-2ce9-4bc7-9e9e-0172b8d2681d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:19.752094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f8989d20-2ce9-4bc7-9e9e-0172b8d2681d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:19.759153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8989d20-2ce9-4bc7-9e9e-0172b8d2681d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:19.759632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8989d20-2ce9-4bc7-9e9e-0172b8d2681d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:19.760069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8989d20-2ce9-4bc7-9e9e-0172b8d2681d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:19.760785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8989d20-2ce9-4bc7-9e9e-0172b8d2681d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:19.761239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8989d20-2ce9-4bc7-9e9e-0172b8d2681d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:19.761686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8989d20-2ce9-4bc7-9e9e-0172b8d2681d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:19.888328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f8989d20-2ce9-4bc7-9e9e-0172b8d2681d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:19.896540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f8989d20-2ce9-4bc7-9e9e-0172b8d2681d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.148978 Oct 28 20:25:19.897213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1329/2650] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:19 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:20.197052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-04de7124-7879-4951-856c-d7eee6684ad6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:20.197693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-04de7124-7879-4951-856c-d7eee6684ad6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:20.205021 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04de7124-7879-4951-856c-d7eee6684ad6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:20.205552 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04de7124-7879-4951-856c-d7eee6684ad6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:20.205991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04de7124-7879-4951-856c-d7eee6684ad6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:20.206697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04de7124-7879-4951-856c-d7eee6684ad6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:20.207154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04de7124-7879-4951-856c-d7eee6684ad6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:20.207586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04de7124-7879-4951-856c-d7eee6684ad6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:20.272241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-04de7124-7879-4951-856c-d7eee6684ad6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:20.281586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-04de7124-7879-4951-856c-d7eee6684ad6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.088347 Oct 28 20:25:20.282696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1322/2651] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:20 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:20.919799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8e22003-9b6d-43ad-bdee-6e9160c04798 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:20.920523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b8e22003-9b6d-43ad-bdee-6e9160c04798 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:20.927308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8e22003-9b6d-43ad-bdee-6e9160c04798 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:20.927880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8e22003-9b6d-43ad-bdee-6e9160c04798 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:20.929032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8e22003-9b6d-43ad-bdee-6e9160c04798 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:20.929935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8e22003-9b6d-43ad-bdee-6e9160c04798 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:20.930389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8e22003-9b6d-43ad-bdee-6e9160c04798 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:20.930815 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8e22003-9b6d-43ad-bdee-6e9160c04798 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:21.066119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8e22003-9b6d-43ad-bdee-6e9160c04798 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:21.074399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b8e22003-9b6d-43ad-bdee-6e9160c04798 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.158450 Oct 28 20:25:21.074962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1330/2652] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:20 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:21.304913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43d3e068-99a9-4cb4-980b-c3afce5eda78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:21.305562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-43d3e068-99a9-4cb4-980b-c3afce5eda78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:21.311906 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d3e068-99a9-4cb4-980b-c3afce5eda78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:21.312387 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d3e068-99a9-4cb4-980b-c3afce5eda78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:21.312823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d3e068-99a9-4cb4-980b-c3afce5eda78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:21.313537 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d3e068-99a9-4cb4-980b-c3afce5eda78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:21.313994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d3e068-99a9-4cb4-980b-c3afce5eda78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:21.314421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d3e068-99a9-4cb4-980b-c3afce5eda78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:21.375141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-43d3e068-99a9-4cb4-980b-c3afce5eda78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:21.378500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:21.383959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-43d3e068-99a9-4cb4-980b-c3afce5eda78 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083046 Oct 28 20:25:21.384515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1323/2653] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:21 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:22.098079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7c109155-b1de-48fd-8d26-211d6731b402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:22.098699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7c109155-b1de-48fd-8d26-211d6731b402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:22.105654 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c109155-b1de-48fd-8d26-211d6731b402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:22.106137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c109155-b1de-48fd-8d26-211d6731b402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:22.106583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c109155-b1de-48fd-8d26-211d6731b402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:22.107262 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c109155-b1de-48fd-8d26-211d6731b402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:22.107712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c109155-b1de-48fd-8d26-211d6731b402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:22.108133 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c109155-b1de-48fd-8d26-211d6731b402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:22.234555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7c109155-b1de-48fd-8d26-211d6731b402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:22.243327 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7c109155-b1de-48fd-8d26-211d6731b402 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149137 Oct 28 20:25:22.243898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1331/2654] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:22 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:22.407793 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-22e1ce87-5ddc-4e91-8743-b8ddd66833e8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:22.408375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22e1ce87-5ddc-4e91-8743-b8ddd66833e8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:22.415715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e1ce87-5ddc-4e91-8743-b8ddd66833e8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:22.416193 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e1ce87-5ddc-4e91-8743-b8ddd66833e8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:22.416632 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e1ce87-5ddc-4e91-8743-b8ddd66833e8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:22.417339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e1ce87-5ddc-4e91-8743-b8ddd66833e8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:22.417796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e1ce87-5ddc-4e91-8743-b8ddd66833e8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:22.418223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e1ce87-5ddc-4e91-8743-b8ddd66833e8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:22.487879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-22e1ce87-5ddc-4e91-8743-b8ddd66833e8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:22.497349 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-22e1ce87-5ddc-4e91-8743-b8ddd66833e8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.093802 Oct 28 20:25:22.497914 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1324/2655] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:22 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:23.267553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ced4295f-1bdf-40d9-b29a-6aa01418bc1a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:23.268168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ced4295f-1bdf-40d9-b29a-6aa01418bc1a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:23.274747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ced4295f-1bdf-40d9-b29a-6aa01418bc1a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:23.275227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ced4295f-1bdf-40d9-b29a-6aa01418bc1a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:23.275666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ced4295f-1bdf-40d9-b29a-6aa01418bc1a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:23.276352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ced4295f-1bdf-40d9-b29a-6aa01418bc1a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:23.276808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ced4295f-1bdf-40d9-b29a-6aa01418bc1a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:23.277238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ced4295f-1bdf-40d9-b29a-6aa01418bc1a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:23.405878 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ced4295f-1bdf-40d9-b29a-6aa01418bc1a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:23.414797 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ced4295f-1bdf-40d9-b29a-6aa01418bc1a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151140 Oct 28 20:25:23.415373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1332/2656] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:23 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:23.520527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-089c26e6-94e9-4eb8-b88e-5b841bd665b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:23.521150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-089c26e6-94e9-4eb8-b88e-5b841bd665b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:23.528451 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-089c26e6-94e9-4eb8-b88e-5b841bd665b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:23.528935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-089c26e6-94e9-4eb8-b88e-5b841bd665b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:23.529398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-089c26e6-94e9-4eb8-b88e-5b841bd665b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:23.530094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-089c26e6-94e9-4eb8-b88e-5b841bd665b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:23.530554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-089c26e6-94e9-4eb8-b88e-5b841bd665b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:23.530978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-089c26e6-94e9-4eb8-b88e-5b841bd665b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:23.592639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-089c26e6-94e9-4eb8-b88e-5b841bd665b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:23.601502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-089c26e6-94e9-4eb8-b88e-5b841bd665b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084795 Oct 28 20:25:23.602063 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1325/2657] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:23 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:24.438754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fb52a517-157f-4d10-8aae-44ebe7e5ea98 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:24.439314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fb52a517-157f-4d10-8aae-44ebe7e5ea98 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:24.445666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb52a517-157f-4d10-8aae-44ebe7e5ea98 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:24.446140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb52a517-157f-4d10-8aae-44ebe7e5ea98 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:24.446572 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb52a517-157f-4d10-8aae-44ebe7e5ea98 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:24.447253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb52a517-157f-4d10-8aae-44ebe7e5ea98 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:24.447733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb52a517-157f-4d10-8aae-44ebe7e5ea98 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:24.448154 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb52a517-157f-4d10-8aae-44ebe7e5ea98 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:24.624024 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d2ab86ad-046d-4980-9cc2-c1a45dee1c07 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:24.624718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d2ab86ad-046d-4980-9cc2-c1a45dee1c07 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:24.631626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2ab86ad-046d-4980-9cc2-c1a45dee1c07 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:24.632282 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2ab86ad-046d-4980-9cc2-c1a45dee1c07 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:24.632544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2ab86ad-046d-4980-9cc2-c1a45dee1c07 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:24.633239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2ab86ad-046d-4980-9cc2-c1a45dee1c07 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:24.633723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2ab86ad-046d-4980-9cc2-c1a45dee1c07 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:24.634171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2ab86ad-046d-4980-9cc2-c1a45dee1c07 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:24.671244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fb52a517-157f-4d10-8aae-44ebe7e5ea98 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:24.679832 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fb52a517-157f-4d10-8aae-44ebe7e5ea98 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.244915 Oct 28 20:25:24.694070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1333/2658] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:24 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:24.700600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d2ab86ad-046d-4980-9cc2-c1a45dee1c07 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:24.708726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d2ab86ad-046d-4980-9cc2-c1a45dee1c07 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.088659 Oct 28 20:25:24.710864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1326/2659] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:24 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:25:25.705052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6f3558e7-30e3-49fa-9900-baa4ede1e750 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:25.705684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6f3558e7-30e3-49fa-9900-baa4ede1e750 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:25.712584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f3558e7-30e3-49fa-9900-baa4ede1e750 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:25.713059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f3558e7-30e3-49fa-9900-baa4ede1e750 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:25.713534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f3558e7-30e3-49fa-9900-baa4ede1e750 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:25.714215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f3558e7-30e3-49fa-9900-baa4ede1e750 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:25.714663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f3558e7-30e3-49fa-9900-baa4ede1e750 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:25.715083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f3558e7-30e3-49fa-9900-baa4ede1e750 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:25.733121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60483251-2ff6-4753-bdf1-92a15a698c2a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:25.733761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60483251-2ff6-4753-bdf1-92a15a698c2a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:25.739981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60483251-2ff6-4753-bdf1-92a15a698c2a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:25.740875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60483251-2ff6-4753-bdf1-92a15a698c2a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:25.741113 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60483251-2ff6-4753-bdf1-92a15a698c2a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:25.741746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60483251-2ff6-4753-bdf1-92a15a698c2a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:25.742185 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60483251-2ff6-4753-bdf1-92a15a698c2a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:25.742605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60483251-2ff6-4753-bdf1-92a15a698c2a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:25.809203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-60483251-2ff6-4753-bdf1-92a15a698c2a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:25.817284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60483251-2ff6-4753-bdf1-92a15a698c2a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087999 Oct 28 20:25:25.817882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1327/2660] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:25 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:25:25.869516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6f3558e7-30e3-49fa-9900-baa4ede1e750 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:25.878038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6f3558e7-30e3-49fa-9900-baa4ede1e750 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.176850 Oct 28 20:25:25.878598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1334/2661] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:25 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:26.840779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aef6040a-6cdb-4272-8d92-7851c9209248 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:26.841426 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aef6040a-6cdb-4272-8d92-7851c9209248 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:26.848027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aef6040a-6cdb-4272-8d92-7851c9209248 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:26.848512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aef6040a-6cdb-4272-8d92-7851c9209248 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:26.848952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aef6040a-6cdb-4272-8d92-7851c9209248 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:26.849704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aef6040a-6cdb-4272-8d92-7851c9209248 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:26.850183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aef6040a-6cdb-4272-8d92-7851c9209248 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:26.850586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aef6040a-6cdb-4272-8d92-7851c9209248 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:26.901983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4393e515-e757-445f-b7d4-96f6d25c9109 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:26.902586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4393e515-e757-445f-b7d4-96f6d25c9109 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:26.908944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4393e515-e757-445f-b7d4-96f6d25c9109 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:26.909464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4393e515-e757-445f-b7d4-96f6d25c9109 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:26.909903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4393e515-e757-445f-b7d4-96f6d25c9109 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:26.910581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4393e515-e757-445f-b7d4-96f6d25c9109 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:26.911042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4393e515-e757-445f-b7d4-96f6d25c9109 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:26.911747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4393e515-e757-445f-b7d4-96f6d25c9109 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:26.913804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-aef6040a-6cdb-4272-8d92-7851c9209248 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:26.922119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aef6040a-6cdb-4272-8d92-7851c9209248 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085222 Oct 28 20:25:26.922694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1328/2662] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:26 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:27.040974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4393e515-e757-445f-b7d4-96f6d25c9109 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:27.049132 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4393e515-e757-445f-b7d4-96f6d25c9109 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151139 Oct 28 20:25:27.049729 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1335/2663] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:26 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:25:27.945665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-275840ab-9df3-4e10-b00d-56549c239429 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:27.946308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-275840ab-9df3-4e10-b00d-56549c239429 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:27.952621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-275840ab-9df3-4e10-b00d-56549c239429 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:27.953101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-275840ab-9df3-4e10-b00d-56549c239429 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:27.953581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-275840ab-9df3-4e10-b00d-56549c239429 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:27.954257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-275840ab-9df3-4e10-b00d-56549c239429 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:27.954718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-275840ab-9df3-4e10-b00d-56549c239429 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:27.955135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-275840ab-9df3-4e10-b00d-56549c239429 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:28.064104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-275840ab-9df3-4e10-b00d-56549c239429 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:28.072633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-61bd387f-22c1-4e41-82bf-91271d838c27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:28.073160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-275840ab-9df3-4e10-b00d-56549c239429 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.131645 Oct 28 20:25:28.073381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-61bd387f-22c1-4e41-82bf-91271d838c27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:28.078209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1329/2664] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:27 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:28.080137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61bd387f-22c1-4e41-82bf-91271d838c27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:28.080616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61bd387f-22c1-4e41-82bf-91271d838c27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:28.081056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61bd387f-22c1-4e41-82bf-91271d838c27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:28.081778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61bd387f-22c1-4e41-82bf-91271d838c27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:28.082237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61bd387f-22c1-4e41-82bf-91271d838c27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:28.082655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61bd387f-22c1-4e41-82bf-91271d838c27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:28.214849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-61bd387f-22c1-4e41-82bf-91271d838c27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:28.223255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-61bd387f-22c1-4e41-82bf-91271d838c27 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.155235 Oct 28 20:25:28.223812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1336/2665] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:28 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:25:29.096198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f1a5569e-2fe5-4421-aaa6-5f0b44bb0949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:29.096749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f1a5569e-2fe5-4421-aaa6-5f0b44bb0949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:29.103257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1a5569e-2fe5-4421-aaa6-5f0b44bb0949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:29.103741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1a5569e-2fe5-4421-aaa6-5f0b44bb0949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:29.104176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1a5569e-2fe5-4421-aaa6-5f0b44bb0949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:29.104869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1a5569e-2fe5-4421-aaa6-5f0b44bb0949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:29.105346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1a5569e-2fe5-4421-aaa6-5f0b44bb0949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:29.105778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1a5569e-2fe5-4421-aaa6-5f0b44bb0949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:29.166217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f1a5569e-2fe5-4421-aaa6-5f0b44bb0949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:29.175074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f1a5569e-2fe5-4421-aaa6-5f0b44bb0949 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083032 Oct 28 20:25:29.175637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1330/2666] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:29 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:29.246675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c85a7876-c4b8-4d94-8ae6-6a698bffdd3f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:29.247317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c85a7876-c4b8-4d94-8ae6-6a698bffdd3f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:29.253702 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c85a7876-c4b8-4d94-8ae6-6a698bffdd3f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:29.254173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c85a7876-c4b8-4d94-8ae6-6a698bffdd3f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:29.254605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c85a7876-c4b8-4d94-8ae6-6a698bffdd3f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:29.255281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c85a7876-c4b8-4d94-8ae6-6a698bffdd3f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:29.255766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c85a7876-c4b8-4d94-8ae6-6a698bffdd3f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:29.256764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c85a7876-c4b8-4d94-8ae6-6a698bffdd3f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:29.271079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:29.383512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c85a7876-c4b8-4d94-8ae6-6a698bffdd3f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:29.391496 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c85a7876-c4b8-4d94-8ae6-6a698bffdd3f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.148707 Oct 28 20:25:29.392038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1337/2667] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:29 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:30.199112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ea5a0dbb-e5ac-4c69-a37a-77fae616bb39 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:30.199761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ea5a0dbb-e5ac-4c69-a37a-77fae616bb39 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:30.206191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea5a0dbb-e5ac-4c69-a37a-77fae616bb39 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:30.206674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea5a0dbb-e5ac-4c69-a37a-77fae616bb39 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:30.207112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea5a0dbb-e5ac-4c69-a37a-77fae616bb39 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:30.207797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea5a0dbb-e5ac-4c69-a37a-77fae616bb39 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:30.208250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea5a0dbb-e5ac-4c69-a37a-77fae616bb39 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:30.208676 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea5a0dbb-e5ac-4c69-a37a-77fae616bb39 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:30.278362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ea5a0dbb-e5ac-4c69-a37a-77fae616bb39 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:30.286975 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ea5a0dbb-e5ac-4c69-a37a-77fae616bb39 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.091584 Oct 28 20:25:30.287808 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1331/2668] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:30 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:25:30.415196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9338277c-801a-49a8-9100-34c06f636e9c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:30.415825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9338277c-801a-49a8-9100-34c06f636e9c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:30.422291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9338277c-801a-49a8-9100-34c06f636e9c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:30.422761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9338277c-801a-49a8-9100-34c06f636e9c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:30.423190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9338277c-801a-49a8-9100-34c06f636e9c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:30.423862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9338277c-801a-49a8-9100-34c06f636e9c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:30.424306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9338277c-801a-49a8-9100-34c06f636e9c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:30.424723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9338277c-801a-49a8-9100-34c06f636e9c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:30.554800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9338277c-801a-49a8-9100-34c06f636e9c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:30.562933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9338277c-801a-49a8-9100-34c06f636e9c tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151662 Oct 28 20:25:30.563502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1338/2669] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:30 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:31.311555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2702dc7e-8540-4da8-99f1-cf177717b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:31.312108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2702dc7e-8540-4da8-99f1-cf177717b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:31.318377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2702dc7e-8540-4da8-99f1-cf177717b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:31.319571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2702dc7e-8540-4da8-99f1-cf177717b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:31.320018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2702dc7e-8540-4da8-99f1-cf177717b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:31.320699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2702dc7e-8540-4da8-99f1-cf177717b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:31.321154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2702dc7e-8540-4da8-99f1-cf177717b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:31.321603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2702dc7e-8540-4da8-99f1-cf177717b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:31.382197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2702dc7e-8540-4da8-99f1-cf177717b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:31.390176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2702dc7e-8540-4da8-99f1-cf177717b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082597 Oct 28 20:25:31.390740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1332/2670] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:31 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:31.587179 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3a47ee04-da18-454a-ae8f-ba0acb22f5a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:31.587735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3a47ee04-da18-454a-ae8f-ba0acb22f5a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:31.594456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a47ee04-da18-454a-ae8f-ba0acb22f5a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:31.594934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a47ee04-da18-454a-ae8f-ba0acb22f5a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:31.595376 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a47ee04-da18-454a-ae8f-ba0acb22f5a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:31.596064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a47ee04-da18-454a-ae8f-ba0acb22f5a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:31.596520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a47ee04-da18-454a-ae8f-ba0acb22f5a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:31.596942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a47ee04-da18-454a-ae8f-ba0acb22f5a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:31.730046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3a47ee04-da18-454a-ae8f-ba0acb22f5a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:31.738142 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3a47ee04-da18-454a-ae8f-ba0acb22f5a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.155035 Oct 28 20:25:31.738706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1339/2671] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:31 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:32.412324 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3ac479cf-e877-45cd-bfc9-614c89a30896 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:32.412902 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3ac479cf-e877-45cd-bfc9-614c89a30896 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:32.419221 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ac479cf-e877-45cd-bfc9-614c89a30896 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:32.419713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ac479cf-e877-45cd-bfc9-614c89a30896 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:32.420148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ac479cf-e877-45cd-bfc9-614c89a30896 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:32.420827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ac479cf-e877-45cd-bfc9-614c89a30896 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:32.421280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ac479cf-e877-45cd-bfc9-614c89a30896 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:32.421730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ac479cf-e877-45cd-bfc9-614c89a30896 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:32.485240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3ac479cf-e877-45cd-bfc9-614c89a30896 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:32.493569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3ac479cf-e877-45cd-bfc9-614c89a30896 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085123 Oct 28 20:25:32.498567 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1333/2672] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:32 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:32.762672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2e2bfe68-6509-4111-be25-df5e312a97e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:32.763286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2e2bfe68-6509-4111-be25-df5e312a97e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:32.769684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e2bfe68-6509-4111-be25-df5e312a97e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:32.770167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e2bfe68-6509-4111-be25-df5e312a97e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:32.770606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e2bfe68-6509-4111-be25-df5e312a97e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:32.771294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e2bfe68-6509-4111-be25-df5e312a97e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:32.771747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e2bfe68-6509-4111-be25-df5e312a97e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:32.772177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e2bfe68-6509-4111-be25-df5e312a97e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:32.897895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2e2bfe68-6509-4111-be25-df5e312a97e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:32.905890 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2e2bfe68-6509-4111-be25-df5e312a97e9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.147125 Oct 28 20:25:32.906447 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1340/2673] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:32 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:33.562305 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9293f1d4-15ae-4d87-97db-805bb21962dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:33.562922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9293f1d4-15ae-4d87-97db-805bb21962dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:33.568805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9293f1d4-15ae-4d87-97db-805bb21962dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:33.569295 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9293f1d4-15ae-4d87-97db-805bb21962dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:33.569766 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9293f1d4-15ae-4d87-97db-805bb21962dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:33.570448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9293f1d4-15ae-4d87-97db-805bb21962dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:33.570903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9293f1d4-15ae-4d87-97db-805bb21962dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:33.571335 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9293f1d4-15ae-4d87-97db-805bb21962dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:33.635749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9293f1d4-15ae-4d87-97db-805bb21962dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:33.643795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9293f1d4-15ae-4d87-97db-805bb21962dc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.131588 Oct 28 20:25:33.644353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1334/2674] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:33 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:33.929240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eff9ebed-8b2e-4ad1-b858-d32be670292f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:33.929829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eff9ebed-8b2e-4ad1-b858-d32be670292f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:33.936199 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eff9ebed-8b2e-4ad1-b858-d32be670292f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:33.936680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eff9ebed-8b2e-4ad1-b858-d32be670292f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:33.937119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eff9ebed-8b2e-4ad1-b858-d32be670292f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:33.937988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eff9ebed-8b2e-4ad1-b858-d32be670292f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:33.938450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eff9ebed-8b2e-4ad1-b858-d32be670292f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:33.938885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eff9ebed-8b2e-4ad1-b858-d32be670292f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:34.065838 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-eff9ebed-8b2e-4ad1-b858-d32be670292f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:34.074488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eff9ebed-8b2e-4ad1-b858-d32be670292f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149332 Oct 28 20:25:34.075048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1341/2675] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:33 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:34.667930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f52fa2dc-79fe-47cc-9f2a-6e27251b7cc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:34.668576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f52fa2dc-79fe-47cc-9f2a-6e27251b7cc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:34.675080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f52fa2dc-79fe-47cc-9f2a-6e27251b7cc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:34.675575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f52fa2dc-79fe-47cc-9f2a-6e27251b7cc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:34.676020 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f52fa2dc-79fe-47cc-9f2a-6e27251b7cc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:34.676732 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f52fa2dc-79fe-47cc-9f2a-6e27251b7cc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:34.677193 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f52fa2dc-79fe-47cc-9f2a-6e27251b7cc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:34.677726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f52fa2dc-79fe-47cc-9f2a-6e27251b7cc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:34.741266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f52fa2dc-79fe-47cc-9f2a-6e27251b7cc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:34.749558 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f52fa2dc-79fe-47cc-9f2a-6e27251b7cc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085562 Oct 28 20:25:34.750167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1335/2676] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:34 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:35.097910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ac3be40-a717-4d02-9fd2-30100b10d403 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:35.098528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1ac3be40-a717-4d02-9fd2-30100b10d403 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:35.105100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ac3be40-a717-4d02-9fd2-30100b10d403 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:35.105608 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ac3be40-a717-4d02-9fd2-30100b10d403 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:35.106041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ac3be40-a717-4d02-9fd2-30100b10d403 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:35.106719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ac3be40-a717-4d02-9fd2-30100b10d403 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:35.107165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ac3be40-a717-4d02-9fd2-30100b10d403 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:35.107578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ac3be40-a717-4d02-9fd2-30100b10d403 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:35.236956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ac3be40-a717-4d02-9fd2-30100b10d403 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:35.245800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1ac3be40-a717-4d02-9fd2-30100b10d403 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151740 Oct 28 20:25:35.246366 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1342/2677] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:35 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:35.773633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4340e31b-82db-4aea-adbd-92b01fe37a5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:35.774165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4340e31b-82db-4aea-adbd-92b01fe37a5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:35.780524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4340e31b-82db-4aea-adbd-92b01fe37a5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:35.780998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4340e31b-82db-4aea-adbd-92b01fe37a5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:35.781448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4340e31b-82db-4aea-adbd-92b01fe37a5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:35.782121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4340e31b-82db-4aea-adbd-92b01fe37a5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:35.782569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4340e31b-82db-4aea-adbd-92b01fe37a5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:35.782987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4340e31b-82db-4aea-adbd-92b01fe37a5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:35.844521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4340e31b-82db-4aea-adbd-92b01fe37a5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:35.853595 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4340e31b-82db-4aea-adbd-92b01fe37a5f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084338 Oct 28 20:25:35.854160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1336/2678] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:35 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:36.268346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-395a7820-34f8-4f68-a503-32923224191b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:36.268959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-395a7820-34f8-4f68-a503-32923224191b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:36.276230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-395a7820-34f8-4f68-a503-32923224191b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:36.276710 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-395a7820-34f8-4f68-a503-32923224191b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:36.277145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-395a7820-34f8-4f68-a503-32923224191b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:36.277863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-395a7820-34f8-4f68-a503-32923224191b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:36.278316 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-395a7820-34f8-4f68-a503-32923224191b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:36.278738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-395a7820-34f8-4f68-a503-32923224191b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:36.412136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-395a7820-34f8-4f68-a503-32923224191b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:36.420929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-395a7820-34f8-4f68-a503-32923224191b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.156489 Oct 28 20:25:36.421524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1343/2679] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:36 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:36.876997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1e89d915-dcdc-4e1f-9245-44f9aabfdb7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:36.877639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1e89d915-dcdc-4e1f-9245-44f9aabfdb7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:36.884462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e89d915-dcdc-4e1f-9245-44f9aabfdb7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:36.884943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e89d915-dcdc-4e1f-9245-44f9aabfdb7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:36.885406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e89d915-dcdc-4e1f-9245-44f9aabfdb7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:36.886090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e89d915-dcdc-4e1f-9245-44f9aabfdb7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:36.886540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e89d915-dcdc-4e1f-9245-44f9aabfdb7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:36.886960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e89d915-dcdc-4e1f-9245-44f9aabfdb7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:36.950519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1e89d915-dcdc-4e1f-9245-44f9aabfdb7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:36.958704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1e89d915-dcdc-4e1f-9245-44f9aabfdb7c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085919 Oct 28 20:25:36.959343 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1337/2680] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:36 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:37.444862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-29f07730-4aa9-4a51-bb86-8bf02985ba64 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:37.445526 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-29f07730-4aa9-4a51-bb86-8bf02985ba64 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:37.451899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29f07730-4aa9-4a51-bb86-8bf02985ba64 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:37.452382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29f07730-4aa9-4a51-bb86-8bf02985ba64 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:37.452819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29f07730-4aa9-4a51-bb86-8bf02985ba64 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:37.453539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29f07730-4aa9-4a51-bb86-8bf02985ba64 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:37.453993 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29f07730-4aa9-4a51-bb86-8bf02985ba64 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:37.454417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29f07730-4aa9-4a51-bb86-8bf02985ba64 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:37.581706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-29f07730-4aa9-4a51-bb86-8bf02985ba64 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:37.590005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-29f07730-4aa9-4a51-bb86-8bf02985ba64 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149909 Oct 28 20:25:37.590571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1344/2681] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:37 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:37.983939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d0e3cc68-8716-4f60-8651-38dd0e274f2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:37.984584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d0e3cc68-8716-4f60-8651-38dd0e274f2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:37.990932 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0e3cc68-8716-4f60-8651-38dd0e274f2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:37.991412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0e3cc68-8716-4f60-8651-38dd0e274f2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:37.991846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0e3cc68-8716-4f60-8651-38dd0e274f2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:37.992535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0e3cc68-8716-4f60-8651-38dd0e274f2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:37.993018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0e3cc68-8716-4f60-8651-38dd0e274f2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:37.993469 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0e3cc68-8716-4f60-8651-38dd0e274f2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:38.056544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d0e3cc68-8716-4f60-8651-38dd0e274f2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:38.064925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d0e3cc68-8716-4f60-8651-38dd0e274f2c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084864 Oct 28 20:25:38.065516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1338/2682] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:37 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:38.613700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-07b68a93-c5e2-4315-955f-ba56eacf7cdf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:38.614319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-07b68a93-c5e2-4315-955f-ba56eacf7cdf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:38.621041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b68a93-c5e2-4315-955f-ba56eacf7cdf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:38.621567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b68a93-c5e2-4315-955f-ba56eacf7cdf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:38.622007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b68a93-c5e2-4315-955f-ba56eacf7cdf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:38.622725 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b68a93-c5e2-4315-955f-ba56eacf7cdf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:38.623177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b68a93-c5e2-4315-955f-ba56eacf7cdf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:38.623607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b68a93-c5e2-4315-955f-ba56eacf7cdf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:38.758745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-07b68a93-c5e2-4315-955f-ba56eacf7cdf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:38.766902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-07b68a93-c5e2-4315-955f-ba56eacf7cdf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.157219 Oct 28 20:25:38.790425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1345/2683] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:38 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:39.088297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2aed5b17-9b25-46c3-a431-d62c643d3fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:39.088916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2aed5b17-9b25-46c3-a431-d62c643d3fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:39.095883 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2aed5b17-9b25-46c3-a431-d62c643d3fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:39.096342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2aed5b17-9b25-46c3-a431-d62c643d3fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:39.096778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2aed5b17-9b25-46c3-a431-d62c643d3fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:39.097494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2aed5b17-9b25-46c3-a431-d62c643d3fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:39.097950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2aed5b17-9b25-46c3-a431-d62c643d3fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:39.098375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2aed5b17-9b25-46c3-a431-d62c643d3fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:39.159989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2aed5b17-9b25-46c3-a431-d62c643d3fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:39.169012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2aed5b17-9b25-46c3-a431-d62c643d3fa8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085010 Oct 28 20:25:39.169884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1339/2684] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:39 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:39.789864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a779eda4-af85-4901-8169-846f60768a83 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:39.790403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a779eda4-af85-4901-8169-846f60768a83 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:39.796703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a779eda4-af85-4901-8169-846f60768a83 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:39.797181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a779eda4-af85-4901-8169-846f60768a83 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:39.797657 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a779eda4-af85-4901-8169-846f60768a83 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:39.798344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a779eda4-af85-4901-8169-846f60768a83 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:39.798793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a779eda4-af85-4901-8169-846f60768a83 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:39.799215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a779eda4-af85-4901-8169-846f60768a83 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:39.925025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a779eda4-af85-4901-8169-846f60768a83 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:39.933117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a779eda4-af85-4901-8169-846f60768a83 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.147297 Oct 28 20:25:39.933728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1346/2685] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:39 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:40.192468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9f26e070-59c8-4108-9073-85b2389a25ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:40.193091 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9f26e070-59c8-4108-9073-85b2389a25ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:40.199492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f26e070-59c8-4108-9073-85b2389a25ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:40.199974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f26e070-59c8-4108-9073-85b2389a25ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:40.200411 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f26e070-59c8-4108-9073-85b2389a25ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:40.201090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f26e070-59c8-4108-9073-85b2389a25ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:40.201572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f26e070-59c8-4108-9073-85b2389a25ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:40.201997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f26e070-59c8-4108-9073-85b2389a25ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:40.220227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:40.266416 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9f26e070-59c8-4108-9073-85b2389a25ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:40.275455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9f26e070-59c8-4108-9073-85b2389a25ea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086800 Oct 28 20:25:40.276024 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1340/2686] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:40 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:40.955985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-761591f4-1560-4637-9288-c070d8c0043f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:40.956609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-761591f4-1560-4637-9288-c070d8c0043f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:40.963402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-761591f4-1560-4637-9288-c070d8c0043f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:40.963883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-761591f4-1560-4637-9288-c070d8c0043f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:40.964319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-761591f4-1560-4637-9288-c070d8c0043f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:40.965002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-761591f4-1560-4637-9288-c070d8c0043f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:40.965486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-761591f4-1560-4637-9288-c070d8c0043f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:40.965913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-761591f4-1560-4637-9288-c070d8c0043f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:41.093777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-761591f4-1560-4637-9288-c070d8c0043f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:41.102555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-761591f4-1560-4637-9288-c070d8c0043f tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150443 Oct 28 20:25:41.103112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1347/2687] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:40 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:41.299383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-79795c06-a2ed-4fe5-a614-ea9ad99a52b9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:41.299975 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-79795c06-a2ed-4fe5-a614-ea9ad99a52b9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:41.307211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79795c06-a2ed-4fe5-a614-ea9ad99a52b9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:41.307706 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79795c06-a2ed-4fe5-a614-ea9ad99a52b9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:41.308143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79795c06-a2ed-4fe5-a614-ea9ad99a52b9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:41.308831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79795c06-a2ed-4fe5-a614-ea9ad99a52b9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:41.309284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79795c06-a2ed-4fe5-a614-ea9ad99a52b9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:41.309763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79795c06-a2ed-4fe5-a614-ea9ad99a52b9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:41.370628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-79795c06-a2ed-4fe5-a614-ea9ad99a52b9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:41.378657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-79795c06-a2ed-4fe5-a614-ea9ad99a52b9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083331 Oct 28 20:25:41.379214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1341/2688] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:41 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:42.127066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bbd24f97-43b8-47d0-b27d-278ed5c9dbe4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:42.127684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bbd24f97-43b8-47d0-b27d-278ed5c9dbe4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:42.134962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbd24f97-43b8-47d0-b27d-278ed5c9dbe4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:42.135443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbd24f97-43b8-47d0-b27d-278ed5c9dbe4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:42.135883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbd24f97-43b8-47d0-b27d-278ed5c9dbe4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:42.136565 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbd24f97-43b8-47d0-b27d-278ed5c9dbe4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:42.137020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbd24f97-43b8-47d0-b27d-278ed5c9dbe4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:42.137481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbd24f97-43b8-47d0-b27d-278ed5c9dbe4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:42.266930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bbd24f97-43b8-47d0-b27d-278ed5c9dbe4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:42.276335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bbd24f97-43b8-47d0-b27d-278ed5c9dbe4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.153129 Oct 28 20:25:42.276920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1348/2689] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:42 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:42.401145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ecc3d6b8-018d-4f54-bae8-de3714861277 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:42.401790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ecc3d6b8-018d-4f54-bae8-de3714861277 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:42.404089 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=56 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:42.408705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecc3d6b8-018d-4f54-bae8-de3714861277 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:42.409193 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecc3d6b8-018d-4f54-bae8-de3714861277 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:42.409663 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecc3d6b8-018d-4f54-bae8-de3714861277 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:42.410360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecc3d6b8-018d-4f54-bae8-de3714861277 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:42.410823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecc3d6b8-018d-4f54-bae8-de3714861277 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:42.411250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecc3d6b8-018d-4f54-bae8-de3714861277 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:42.473964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ecc3d6b8-018d-4f54-bae8-de3714861277 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:42.482829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ecc3d6b8-018d-4f54-bae8-de3714861277 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085619 Oct 28 20:25:42.483435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1342/2690] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:42 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:43.299978 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4743773e-bd09-4dc0-acb4-13a33ec17fed tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:43.300514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4743773e-bd09-4dc0-acb4-13a33ec17fed tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:43.307307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4743773e-bd09-4dc0-acb4-13a33ec17fed tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:43.307790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4743773e-bd09-4dc0-acb4-13a33ec17fed tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:43.308231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4743773e-bd09-4dc0-acb4-13a33ec17fed tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:43.308924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4743773e-bd09-4dc0-acb4-13a33ec17fed tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:43.309404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4743773e-bd09-4dc0-acb4-13a33ec17fed tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:43.309832 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4743773e-bd09-4dc0-acb4-13a33ec17fed tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:43.437199 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4743773e-bd09-4dc0-acb4-13a33ec17fed tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:43.445578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4743773e-bd09-4dc0-acb4-13a33ec17fed tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149527 Oct 28 20:25:43.446138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1349/2691] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:43 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:43.506832 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3ec1d138-8f48-4b59-8441-d2257f606cea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:43.507513 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3ec1d138-8f48-4b59-8441-d2257f606cea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:43.513987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ec1d138-8f48-4b59-8441-d2257f606cea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:43.516291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ec1d138-8f48-4b59-8441-d2257f606cea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:43.516291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ec1d138-8f48-4b59-8441-d2257f606cea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:43.516291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ec1d138-8f48-4b59-8441-d2257f606cea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:43.516291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ec1d138-8f48-4b59-8441-d2257f606cea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:43.516714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ec1d138-8f48-4b59-8441-d2257f606cea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:43.581490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3ec1d138-8f48-4b59-8441-d2257f606cea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:43.590317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3ec1d138-8f48-4b59-8441-d2257f606cea tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087977 Oct 28 20:25:43.590877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1343/2692] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:43 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:44.468717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-616f51a4-74b6-4fe9-ac4c-bf3f40c80706 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:44.469408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-616f51a4-74b6-4fe9-ac4c-bf3f40c80706 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:44.471812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=52 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:44.476965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-616f51a4-74b6-4fe9-ac4c-bf3f40c80706 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:44.477477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-616f51a4-74b6-4fe9-ac4c-bf3f40c80706 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:44.477912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-616f51a4-74b6-4fe9-ac4c-bf3f40c80706 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:44.478598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-616f51a4-74b6-4fe9-ac4c-bf3f40c80706 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:44.479079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-616f51a4-74b6-4fe9-ac4c-bf3f40c80706 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:44.479499 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-616f51a4-74b6-4fe9-ac4c-bf3f40c80706 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:44.607156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-616f51a4-74b6-4fe9-ac4c-bf3f40c80706 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:44.613989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-41478d43-2163-45ee-adb1-f49892ceca54 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:44.614598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-41478d43-2163-45ee-adb1-f49892ceca54 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:44.615431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-616f51a4-74b6-4fe9-ac4c-bf3f40c80706 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150961 Oct 28 20:25:44.616521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1350/2693] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:44 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:44.621018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41478d43-2163-45ee-adb1-f49892ceca54 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:44.621545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41478d43-2163-45ee-adb1-f49892ceca54 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:44.621981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41478d43-2163-45ee-adb1-f49892ceca54 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:44.622665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41478d43-2163-45ee-adb1-f49892ceca54 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:44.623111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41478d43-2163-45ee-adb1-f49892ceca54 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:44.623804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41478d43-2163-45ee-adb1-f49892ceca54 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:44.687984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-41478d43-2163-45ee-adb1-f49892ceca54 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:44.696495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-41478d43-2163-45ee-adb1-f49892ceca54 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086242 Oct 28 20:25:44.697059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1344/2694] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:44 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:25:45.639232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-69d9a30c-4824-4972-a290-44b3d44d265e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:45.639777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-69d9a30c-4824-4972-a290-44b3d44d265e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:45.646132 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69d9a30c-4824-4972-a290-44b3d44d265e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:45.646617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69d9a30c-4824-4972-a290-44b3d44d265e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:45.648072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69d9a30c-4824-4972-a290-44b3d44d265e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:45.648811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69d9a30c-4824-4972-a290-44b3d44d265e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:45.649273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69d9a30c-4824-4972-a290-44b3d44d265e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:45.649733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69d9a30c-4824-4972-a290-44b3d44d265e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:45.720198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8e0b6aef-7dc9-4dfe-946f-cc8de6747fc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:45.720816 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8e0b6aef-7dc9-4dfe-946f-cc8de6747fc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:45.728200 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e0b6aef-7dc9-4dfe-946f-cc8de6747fc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:45.729262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e0b6aef-7dc9-4dfe-946f-cc8de6747fc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:45.729262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e0b6aef-7dc9-4dfe-946f-cc8de6747fc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:45.729828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e0b6aef-7dc9-4dfe-946f-cc8de6747fc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:45.730455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e0b6aef-7dc9-4dfe-946f-cc8de6747fc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:45.730805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e0b6aef-7dc9-4dfe-946f-cc8de6747fc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:45.802636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8e0b6aef-7dc9-4dfe-946f-cc8de6747fc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:45.807314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-69d9a30c-4824-4972-a290-44b3d44d265e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:45.811016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8e0b6aef-7dc9-4dfe-946f-cc8de6747fc3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.094911 Oct 28 20:25:45.811589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1345/2695] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:45 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:25:45.815345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-69d9a30c-4824-4972-a290-44b3d44d265e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.180022 Oct 28 20:25:45.815888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1351/2696] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:45 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:46.835408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ab95e845-f160-495e-92fd-99cae4ce0330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:46.836459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ab95e845-f160-495e-92fd-99cae4ce0330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:46.839337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-70dfe6aa-f4d8-47c7-9f09-bc0930600b23 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:46.843536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-70dfe6aa-f4d8-47c7-9f09-bc0930600b23 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:46.843667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab95e845-f160-495e-92fd-99cae4ce0330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:46.844254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab95e845-f160-495e-92fd-99cae4ce0330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:46.844753 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab95e845-f160-495e-92fd-99cae4ce0330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:46.845541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab95e845-f160-495e-92fd-99cae4ce0330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:46.846260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab95e845-f160-495e-92fd-99cae4ce0330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:46.847092 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70dfe6aa-f4d8-47c7-9f09-bc0930600b23 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:46.847244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab95e845-f160-495e-92fd-99cae4ce0330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:46.847352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70dfe6aa-f4d8-47c7-9f09-bc0930600b23 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:46.847568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70dfe6aa-f4d8-47c7-9f09-bc0930600b23 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:46.849256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70dfe6aa-f4d8-47c7-9f09-bc0930600b23 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:46.849742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70dfe6aa-f4d8-47c7-9f09-bc0930600b23 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:46.850834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70dfe6aa-f4d8-47c7-9f09-bc0930600b23 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:46.938473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ab95e845-f160-495e-92fd-99cae4ce0330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:46.947718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ab95e845-f160-495e-92fd-99cae4ce0330 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.116905 Oct 28 20:25:46.948510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1346/2697] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:46 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:47.006583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-70dfe6aa-f4d8-47c7-9f09-bc0930600b23 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:47.015045 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-70dfe6aa-f4d8-47c7-9f09-bc0930600b23 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.180404 Oct 28 20:25:47.015814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1352/2698] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:46 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:47.971409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-47b64e0a-a94c-4beb-af80-b6ea95bae691 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:47.972057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-47b64e0a-a94c-4beb-af80-b6ea95bae691 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:47.979242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47b64e0a-a94c-4beb-af80-b6ea95bae691 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:47.979724 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47b64e0a-a94c-4beb-af80-b6ea95bae691 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:47.980165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47b64e0a-a94c-4beb-af80-b6ea95bae691 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:47.980849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47b64e0a-a94c-4beb-af80-b6ea95bae691 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:47.981305 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47b64e0a-a94c-4beb-af80-b6ea95bae691 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:47.981756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47b64e0a-a94c-4beb-af80-b6ea95bae691 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:48.039080 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fcf74905-7549-46c1-843f-b635070cf0b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:48.039685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fcf74905-7549-46c1-843f-b635070cf0b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:48.042949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-47b64e0a-a94c-4beb-af80-b6ea95bae691 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:48.046107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcf74905-7549-46c1-843f-b635070cf0b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:48.046585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcf74905-7549-46c1-843f-b635070cf0b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:48.047017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcf74905-7549-46c1-843f-b635070cf0b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:48.047699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcf74905-7549-46c1-843f-b635070cf0b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:48.048145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcf74905-7549-46c1-843f-b635070cf0b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:48.048564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcf74905-7549-46c1-843f-b635070cf0b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:48.051068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-47b64e0a-a94c-4beb-af80-b6ea95bae691 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083821 Oct 28 20:25:48.051628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1347/2699] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:47 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:48.175501 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fcf74905-7549-46c1-843f-b635070cf0b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:48.184188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fcf74905-7549-46c1-843f-b635070cf0b1 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.149416 Oct 28 20:25:48.184760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1353/2700] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:48 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:25:49.074359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4487ceaf-67e0-4f98-8133-3888f8f93cfc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:49.074974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4487ceaf-67e0-4f98-8133-3888f8f93cfc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:49.081311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4487ceaf-67e0-4f98-8133-3888f8f93cfc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:49.081819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4487ceaf-67e0-4f98-8133-3888f8f93cfc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:49.082253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4487ceaf-67e0-4f98-8133-3888f8f93cfc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:49.082938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4487ceaf-67e0-4f98-8133-3888f8f93cfc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:49.083390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4487ceaf-67e0-4f98-8133-3888f8f93cfc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:49.083807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4487ceaf-67e0-4f98-8133-3888f8f93cfc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:49.144993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4487ceaf-67e0-4f98-8133-3888f8f93cfc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:49.153064 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4487ceaf-67e0-4f98-8133-3888f8f93cfc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082788 Oct 28 20:25:49.153650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1348/2701] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:49 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:49.207244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-efae90c7-026e-4ef9-839e-4f43e51f87a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:49.207858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-efae90c7-026e-4ef9-839e-4f43e51f87a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:49.214630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efae90c7-026e-4ef9-839e-4f43e51f87a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:49.215107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efae90c7-026e-4ef9-839e-4f43e51f87a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:49.215543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efae90c7-026e-4ef9-839e-4f43e51f87a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:49.216229 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efae90c7-026e-4ef9-839e-4f43e51f87a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:49.216679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efae90c7-026e-4ef9-839e-4f43e51f87a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:49.217100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efae90c7-026e-4ef9-839e-4f43e51f87a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:49.219919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:49.349553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-efae90c7-026e-4ef9-839e-4f43e51f87a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:49.357761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-efae90c7-026e-4ef9-839e-4f43e51f87a9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.154298 Oct 28 20:25:49.358331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1354/2702] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:49 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:50.175739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f07dfafe-fe79-4b89-81b2-4623a98ae7bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:50.176346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f07dfafe-fe79-4b89-81b2-4623a98ae7bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:50.183356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f07dfafe-fe79-4b89-81b2-4623a98ae7bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:50.183832 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f07dfafe-fe79-4b89-81b2-4623a98ae7bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:50.184264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f07dfafe-fe79-4b89-81b2-4623a98ae7bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:50.184942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f07dfafe-fe79-4b89-81b2-4623a98ae7bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:50.185424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f07dfafe-fe79-4b89-81b2-4623a98ae7bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:50.185847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f07dfafe-fe79-4b89-81b2-4623a98ae7bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:50.247492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f07dfafe-fe79-4b89-81b2-4623a98ae7bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:50.255576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f07dfafe-fe79-4b89-81b2-4623a98ae7bc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083789 Oct 28 20:25:50.256173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1349/2703] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:50 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:50.381957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c0569973-71a7-49c1-af42-3b6ad5665907 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:50.383110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c0569973-71a7-49c1-af42-3b6ad5665907 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:50.391972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0569973-71a7-49c1-af42-3b6ad5665907 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:50.392458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0569973-71a7-49c1-af42-3b6ad5665907 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:50.392902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0569973-71a7-49c1-af42-3b6ad5665907 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:50.393634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0569973-71a7-49c1-af42-3b6ad5665907 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:50.394095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0569973-71a7-49c1-af42-3b6ad5665907 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:50.394522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0569973-71a7-49c1-af42-3b6ad5665907 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:50.527694 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c0569973-71a7-49c1-af42-3b6ad5665907 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:50.535719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c0569973-71a7-49c1-af42-3b6ad5665907 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.158277 Oct 28 20:25:50.536282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1355/2704] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:50 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:51.279563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3dd8b7c-5f00-46a9-934e-ad3f61550f80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:51.280173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b3dd8b7c-5f00-46a9-934e-ad3f61550f80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:51.286607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3dd8b7c-5f00-46a9-934e-ad3f61550f80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:51.287021 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3dd8b7c-5f00-46a9-934e-ad3f61550f80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:51.288048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3dd8b7c-5f00-46a9-934e-ad3f61550f80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:51.288725 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3dd8b7c-5f00-46a9-934e-ad3f61550f80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:51.289175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3dd8b7c-5f00-46a9-934e-ad3f61550f80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:51.289621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3dd8b7c-5f00-46a9-934e-ad3f61550f80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:51.350824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b3dd8b7c-5f00-46a9-934e-ad3f61550f80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:51.358945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b3dd8b7c-5f00-46a9-934e-ad3f61550f80 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083314 Oct 28 20:25:51.359500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1350/2705] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:51 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:51.559289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7181e2b8-3b91-4ecd-a45b-091d7bb1e2cf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:51.559872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7181e2b8-3b91-4ecd-a45b-091d7bb1e2cf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:51.566281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7181e2b8-3b91-4ecd-a45b-091d7bb1e2cf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:51.566758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7181e2b8-3b91-4ecd-a45b-091d7bb1e2cf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:51.567193 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7181e2b8-3b91-4ecd-a45b-091d7bb1e2cf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:51.567870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7181e2b8-3b91-4ecd-a45b-091d7bb1e2cf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:51.568322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7181e2b8-3b91-4ecd-a45b-091d7bb1e2cf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:51.568751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7181e2b8-3b91-4ecd-a45b-091d7bb1e2cf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:51.694135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7181e2b8-3b91-4ecd-a45b-091d7bb1e2cf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:51.702295 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7181e2b8-3b91-4ecd-a45b-091d7bb1e2cf tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.146944 Oct 28 20:25:51.702859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1356/2706] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:51 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:52.382662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-20aea007-767d-4015-90e6-45b035d1d99a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:52.383472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-20aea007-767d-4015-90e6-45b035d1d99a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:52.389960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20aea007-767d-4015-90e6-45b035d1d99a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:52.390499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20aea007-767d-4015-90e6-45b035d1d99a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:52.391007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20aea007-767d-4015-90e6-45b035d1d99a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:52.391719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20aea007-767d-4015-90e6-45b035d1d99a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:52.392181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20aea007-767d-4015-90e6-45b035d1d99a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:52.392604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20aea007-767d-4015-90e6-45b035d1d99a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:52.460061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-20aea007-767d-4015-90e6-45b035d1d99a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:52.468901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-20aea007-767d-4015-90e6-45b035d1d99a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.091168 Oct 28 20:25:52.473376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1351/2707] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:52 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:52.726962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f7c60e4b-9cc7-4963-9d8a-67d499318dd6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:52.727575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f7c60e4b-9cc7-4963-9d8a-67d499318dd6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:52.734296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c60e4b-9cc7-4963-9d8a-67d499318dd6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:52.734784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c60e4b-9cc7-4963-9d8a-67d499318dd6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:52.735223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c60e4b-9cc7-4963-9d8a-67d499318dd6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:52.735911 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c60e4b-9cc7-4963-9d8a-67d499318dd6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:52.736368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c60e4b-9cc7-4963-9d8a-67d499318dd6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:52.736796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c60e4b-9cc7-4963-9d8a-67d499318dd6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:52.865589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f7c60e4b-9cc7-4963-9d8a-67d499318dd6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:52.873779 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f7c60e4b-9cc7-4963-9d8a-67d499318dd6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151107 Oct 28 20:25:52.874357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1357/2708] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:52 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:53.492191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d10bd404-530a-45cc-b480-2921ff9f03b6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:53.492798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d10bd404-530a-45cc-b480-2921ff9f03b6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:53.499375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d10bd404-530a-45cc-b480-2921ff9f03b6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:53.499853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d10bd404-530a-45cc-b480-2921ff9f03b6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:53.500284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d10bd404-530a-45cc-b480-2921ff9f03b6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:53.500957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d10bd404-530a-45cc-b480-2921ff9f03b6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:53.501438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d10bd404-530a-45cc-b480-2921ff9f03b6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:53.501864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d10bd404-530a-45cc-b480-2921ff9f03b6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:53.562645 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d10bd404-530a-45cc-b480-2921ff9f03b6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:53.571456 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d10bd404-530a-45cc-b480-2921ff9f03b6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083252 Oct 28 20:25:53.572017 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1352/2709] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:53 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:53.897048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85bdcf4a-52ce-4244-8eb7-90e2ad740ded tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:53.897627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-85bdcf4a-52ce-4244-8eb7-90e2ad740ded tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:53.903915 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85bdcf4a-52ce-4244-8eb7-90e2ad740ded tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:53.904388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85bdcf4a-52ce-4244-8eb7-90e2ad740ded tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:53.904820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85bdcf4a-52ce-4244-8eb7-90e2ad740ded tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:53.905530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85bdcf4a-52ce-4244-8eb7-90e2ad740ded tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:53.905977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85bdcf4a-52ce-4244-8eb7-90e2ad740ded tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:53.906391 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85bdcf4a-52ce-4244-8eb7-90e2ad740ded tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:54.041701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-85bdcf4a-52ce-4244-8eb7-90e2ad740ded tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:54.049950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-85bdcf4a-52ce-4244-8eb7-90e2ad740ded tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.156796 Oct 28 20:25:54.050514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1358/2710] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:53 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:54.594863 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cf76d7a2-9a5c-4f47-ab79-cc591e359229 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:54.595479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cf76d7a2-9a5c-4f47-ab79-cc591e359229 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:54.601945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf76d7a2-9a5c-4f47-ab79-cc591e359229 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:54.602435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf76d7a2-9a5c-4f47-ab79-cc591e359229 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:54.602877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf76d7a2-9a5c-4f47-ab79-cc591e359229 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:54.603573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf76d7a2-9a5c-4f47-ab79-cc591e359229 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:54.604031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf76d7a2-9a5c-4f47-ab79-cc591e359229 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:54.604460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf76d7a2-9a5c-4f47-ab79-cc591e359229 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:54.666333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-cf76d7a2-9a5c-4f47-ab79-cc591e359229 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:54.674406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cf76d7a2-9a5c-4f47-ab79-cc591e359229 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083658 Oct 28 20:25:54.674977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1353/2711] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:54 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:55.074562 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-43244b4a-d3a4-492c-a6ff-b5743eebfb76 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:55.075207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-43244b4a-d3a4-492c-a6ff-b5743eebfb76 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:55.081553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43244b4a-d3a4-492c-a6ff-b5743eebfb76 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:55.082032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43244b4a-d3a4-492c-a6ff-b5743eebfb76 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:55.082468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43244b4a-d3a4-492c-a6ff-b5743eebfb76 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:55.083147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43244b4a-d3a4-492c-a6ff-b5743eebfb76 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:55.083601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43244b4a-d3a4-492c-a6ff-b5743eebfb76 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:55.084587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43244b4a-d3a4-492c-a6ff-b5743eebfb76 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:55.209987 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-43244b4a-d3a4-492c-a6ff-b5743eebfb76 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:55.218357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-43244b4a-d3a4-492c-a6ff-b5743eebfb76 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.147448 Oct 28 20:25:55.218922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1359/2712] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:55 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:55.698366 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7819f1e0-1950-4fed-a9a4-0b079f7111fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:55.699009 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7819f1e0-1950-4fed-a9a4-0b079f7111fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:55.705365 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7819f1e0-1950-4fed-a9a4-0b079f7111fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:55.705857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7819f1e0-1950-4fed-a9a4-0b079f7111fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:55.706297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7819f1e0-1950-4fed-a9a4-0b079f7111fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:55.706979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7819f1e0-1950-4fed-a9a4-0b079f7111fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:55.707432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7819f1e0-1950-4fed-a9a4-0b079f7111fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:55.707856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7819f1e0-1950-4fed-a9a4-0b079f7111fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:55.769541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7819f1e0-1950-4fed-a9a4-0b079f7111fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:55.778175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7819f1e0-1950-4fed-a9a4-0b079f7111fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083729 Oct 28 20:25:55.778738 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1354/2713] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:55 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:56.242434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-71c50b9d-3aa3-4bed-96b1-e2a7c4547ab5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:56.243040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-71c50b9d-3aa3-4bed-96b1-e2a7c4547ab5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:56.249435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71c50b9d-3aa3-4bed-96b1-e2a7c4547ab5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:56.249911 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71c50b9d-3aa3-4bed-96b1-e2a7c4547ab5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:56.250339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71c50b9d-3aa3-4bed-96b1-e2a7c4547ab5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:56.251008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71c50b9d-3aa3-4bed-96b1-e2a7c4547ab5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:56.251452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71c50b9d-3aa3-4bed-96b1-e2a7c4547ab5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:56.251868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71c50b9d-3aa3-4bed-96b1-e2a7c4547ab5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:56.381688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-71c50b9d-3aa3-4bed-96b1-e2a7c4547ab5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:56.389772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-71c50b9d-3aa3-4bed-96b1-e2a7c4547ab5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.151413 Oct 28 20:25:56.390343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1360/2714] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:56 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:56.801706 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d0ddb213-7a0b-4a3e-81b5-11d73f9e0f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:56.802325 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d0ddb213-7a0b-4a3e-81b5-11d73f9e0f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:56.808908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0ddb213-7a0b-4a3e-81b5-11d73f9e0f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:56.809438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0ddb213-7a0b-4a3e-81b5-11d73f9e0f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:56.809861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0ddb213-7a0b-4a3e-81b5-11d73f9e0f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:56.810547 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0ddb213-7a0b-4a3e-81b5-11d73f9e0f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:56.811004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0ddb213-7a0b-4a3e-81b5-11d73f9e0f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:56.811434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0ddb213-7a0b-4a3e-81b5-11d73f9e0f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:56.873614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d0ddb213-7a0b-4a3e-81b5-11d73f9e0f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:56.882210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d0ddb213-7a0b-4a3e-81b5-11d73f9e0f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084396 Oct 28 20:25:56.882765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1355/2715] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:56 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:57.412178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e4714961-78f7-43fe-b95e-4422cc2aa556 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:57.412836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e4714961-78f7-43fe-b95e-4422cc2aa556 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:57.419534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4714961-78f7-43fe-b95e-4422cc2aa556 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:57.420016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4714961-78f7-43fe-b95e-4422cc2aa556 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:57.420451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4714961-78f7-43fe-b95e-4422cc2aa556 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:57.421146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4714961-78f7-43fe-b95e-4422cc2aa556 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:57.421620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4714961-78f7-43fe-b95e-4422cc2aa556 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:57.422070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4714961-78f7-43fe-b95e-4422cc2aa556 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:57.585313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e4714961-78f7-43fe-b95e-4422cc2aa556 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:57.594188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e4714961-78f7-43fe-b95e-4422cc2aa556 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.185905 Oct 28 20:25:57.594727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1361/2716] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:57 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:57.906145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-23df7714-4e4e-4dcc-b1e6-0ae0231d5be6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:57.906718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-23df7714-4e4e-4dcc-b1e6-0ae0231d5be6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:57.917022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23df7714-4e4e-4dcc-b1e6-0ae0231d5be6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:57.919340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23df7714-4e4e-4dcc-b1e6-0ae0231d5be6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:57.920150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23df7714-4e4e-4dcc-b1e6-0ae0231d5be6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:57.920884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23df7714-4e4e-4dcc-b1e6-0ae0231d5be6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:57.921374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23df7714-4e4e-4dcc-b1e6-0ae0231d5be6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:57.922008 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23df7714-4e4e-4dcc-b1e6-0ae0231d5be6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:57.990670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-23df7714-4e4e-4dcc-b1e6-0ae0231d5be6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:57.999874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-23df7714-4e4e-4dcc-b1e6-0ae0231d5be6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.097655 Oct 28 20:25:58.000635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1356/2717] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:57 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:58.617397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-93500c12-3a3b-432f-8e8f-8b2e2b899c73 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:58.618023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-93500c12-3a3b-432f-8e8f-8b2e2b899c73 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:58.624422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93500c12-3a3b-432f-8e8f-8b2e2b899c73 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:58.624909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93500c12-3a3b-432f-8e8f-8b2e2b899c73 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:58.625375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93500c12-3a3b-432f-8e8f-8b2e2b899c73 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:58.626063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93500c12-3a3b-432f-8e8f-8b2e2b899c73 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:58.626521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93500c12-3a3b-432f-8e8f-8b2e2b899c73 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:58.626945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93500c12-3a3b-432f-8e8f-8b2e2b899c73 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:58.755500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-93500c12-3a3b-432f-8e8f-8b2e2b899c73 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:58.764148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-93500c12-3a3b-432f-8e8f-8b2e2b899c73 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.150640 Oct 28 20:25:58.764707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1362/2718] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:58 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:59.023095 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-85fc8377-9e36-4fa5-b3e6-7c07c461fb10 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:59.023716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-85fc8377-9e36-4fa5-b3e6-7c07c461fb10 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:59.030231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85fc8377-9e36-4fa5-b3e6-7c07c461fb10 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:59.030722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85fc8377-9e36-4fa5-b3e6-7c07c461fb10 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:59.031190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85fc8377-9e36-4fa5-b3e6-7c07c461fb10 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:59.031887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85fc8377-9e36-4fa5-b3e6-7c07c461fb10 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:59.032346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85fc8377-9e36-4fa5-b3e6-7c07c461fb10 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:59.032782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85fc8377-9e36-4fa5-b3e6-7c07c461fb10 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:59.036809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:59.094643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-85fc8377-9e36-4fa5-b3e6-7c07c461fb10 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:59.102804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-85fc8377-9e36-4fa5-b3e6-7c07c461fb10 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083795 Oct 28 20:25:59.103368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1357/2719] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:59 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:25:59.788067 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-08bf7dff-d3c6-429e-b26d-9d318697f958 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:59.788617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-08bf7dff-d3c6-429e-b26d-9d318697f958 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:59.795106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08bf7dff-d3c6-429e-b26d-9d318697f958 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:59.795588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08bf7dff-d3c6-429e-b26d-9d318697f958 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:59.796020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08bf7dff-d3c6-429e-b26d-9d318697f958 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:59.796700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08bf7dff-d3c6-429e-b26d-9d318697f958 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:59.797151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08bf7dff-d3c6-429e-b26d-9d318697f958 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:59.797609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08bf7dff-d3c6-429e-b26d-9d318697f958 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:59.927608 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-08bf7dff-d3c6-429e-b26d-9d318697f958 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:59.936107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-08bf7dff-d3c6-429e-b26d-9d318697f958 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.152044 Oct 28 20:25:59.936666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1363/2720] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:59 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:00.125790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aa1bda79-f8a8-43c3-be19-cc52e303a28e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:00.126333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aa1bda79-f8a8-43c3-be19-cc52e303a28e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:00.132977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa1bda79-f8a8-43c3-be19-cc52e303a28e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:00.133491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa1bda79-f8a8-43c3-be19-cc52e303a28e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:00.133926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa1bda79-f8a8-43c3-be19-cc52e303a28e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:00.134599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa1bda79-f8a8-43c3-be19-cc52e303a28e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:00.135048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa1bda79-f8a8-43c3-be19-cc52e303a28e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:00.135471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa1bda79-f8a8-43c3-be19-cc52e303a28e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:00.197802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-aa1bda79-f8a8-43c3-be19-cc52e303a28e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:00.206485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aa1bda79-f8a8-43c3-be19-cc52e303a28e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084535 Oct 28 20:26:00.207058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1358/2721] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:00 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:00.959894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-61ade1e8-b8d5-4fe9-bf65-759c5115bda4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:00.960620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-61ade1e8-b8d5-4fe9-bf65-759c5115bda4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:00.966980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61ade1e8-b8d5-4fe9-bf65-759c5115bda4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:00.967459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61ade1e8-b8d5-4fe9-bf65-759c5115bda4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:00.968177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61ade1e8-b8d5-4fe9-bf65-759c5115bda4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:00.968863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61ade1e8-b8d5-4fe9-bf65-759c5115bda4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:00.969291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61ade1e8-b8d5-4fe9-bf65-759c5115bda4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:00.969743 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61ade1e8-b8d5-4fe9-bf65-759c5115bda4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:01.104960 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-61ade1e8-b8d5-4fe9-bf65-759c5115bda4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:01.113209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-61ade1e8-b8d5-4fe9-bf65-759c5115bda4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.157184 Oct 28 20:26:01.115527 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1364/2722] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:00 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:01.229465 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-904f1962-33ba-4ce2-9338-63ba4180afde tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:01.230009 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-904f1962-33ba-4ce2-9338-63ba4180afde tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:01.236348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-904f1962-33ba-4ce2-9338-63ba4180afde tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:01.236835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-904f1962-33ba-4ce2-9338-63ba4180afde tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:01.237284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-904f1962-33ba-4ce2-9338-63ba4180afde tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:01.237997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-904f1962-33ba-4ce2-9338-63ba4180afde tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:01.238457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-904f1962-33ba-4ce2-9338-63ba4180afde tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:01.238884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-904f1962-33ba-4ce2-9338-63ba4180afde tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:01.299281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-904f1962-33ba-4ce2-9338-63ba4180afde tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:01.307556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-904f1962-33ba-4ce2-9338-63ba4180afde tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082666 Oct 28 20:26:01.308111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1359/2723] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:01 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:02.138716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9f4adfe2-20d7-4f40-9661-ab037733ced9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:02.139318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9f4adfe2-20d7-4f40-9661-ab037733ced9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:02.145659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f4adfe2-20d7-4f40-9661-ab037733ced9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:02.146130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f4adfe2-20d7-4f40-9661-ab037733ced9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:02.146561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f4adfe2-20d7-4f40-9661-ab037733ced9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:02.147228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f4adfe2-20d7-4f40-9661-ab037733ced9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:02.148219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f4adfe2-20d7-4f40-9661-ab037733ced9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:02.148663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f4adfe2-20d7-4f40-9661-ab037733ced9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:02.275058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9f4adfe2-20d7-4f40-9661-ab037733ced9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:02.283156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9f4adfe2-20d7-4f40-9661-ab037733ced9 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.148177 Oct 28 20:26:02.283657 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1365/2724] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:02 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:02.329743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b1e9646f-a4e5-4ecf-945f-a371aee582c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:02.330366 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b1e9646f-a4e5-4ecf-945f-a371aee582c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:02.337125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1e9646f-a4e5-4ecf-945f-a371aee582c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:02.337628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1e9646f-a4e5-4ecf-945f-a371aee582c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:02.338082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1e9646f-a4e5-4ecf-945f-a371aee582c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:02.338743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1e9646f-a4e5-4ecf-945f-a371aee582c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:02.339195 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1e9646f-a4e5-4ecf-945f-a371aee582c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:02.339612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1e9646f-a4e5-4ecf-945f-a371aee582c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:02.399899 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b1e9646f-a4e5-4ecf-945f-a371aee582c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:02.410421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b1e9646f-a4e5-4ecf-945f-a371aee582c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084306 Oct 28 20:26:02.411008 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1360/2725] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:02 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:03.308138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b3826602-9081-4768-ad39-2e6b917e814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:03.309266 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b3826602-9081-4768-ad39-2e6b917e814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:03.315709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3826602-9081-4768-ad39-2e6b917e814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:03.321627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3826602-9081-4768-ad39-2e6b917e814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:03.321627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3826602-9081-4768-ad39-2e6b917e814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:03.321627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3826602-9081-4768-ad39-2e6b917e814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:03.321627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3826602-9081-4768-ad39-2e6b917e814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:03.322039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3826602-9081-4768-ad39-2e6b917e814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:03.440103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3696cc2e-312a-40d5-880d-951a8434a030 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:03.440846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3696cc2e-312a-40d5-880d-951a8434a030 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:03.447889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3696cc2e-312a-40d5-880d-951a8434a030 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:03.448426 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3696cc2e-312a-40d5-880d-951a8434a030 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:03.448857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3696cc2e-312a-40d5-880d-951a8434a030 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:03.449775 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3696cc2e-312a-40d5-880d-951a8434a030 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:03.450229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3696cc2e-312a-40d5-880d-951a8434a030 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:03.450650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3696cc2e-312a-40d5-880d-951a8434a030 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:03.451723 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b3826602-9081-4768-ad39-2e6b917e814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:03.460863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b3826602-9081-4768-ad39-2e6b917e814b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.157133 Oct 28 20:26:03.461887 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1366/2726] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:03 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:03.514443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3696cc2e-312a-40d5-880d-951a8434a030 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:03.523048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3696cc2e-312a-40d5-880d-951a8434a030 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087193 Oct 28 20:26:03.523701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1361/2727] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:03 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:26:04.483987 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8fa8770c-6fcb-4a1f-812e-e2ce06387232 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:04.484599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8fa8770c-6fcb-4a1f-812e-e2ce06387232 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:04.491001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fa8770c-6fcb-4a1f-812e-e2ce06387232 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:04.491595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fa8770c-6fcb-4a1f-812e-e2ce06387232 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:04.492032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fa8770c-6fcb-4a1f-812e-e2ce06387232 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:04.492745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fa8770c-6fcb-4a1f-812e-e2ce06387232 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:04.493196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fa8770c-6fcb-4a1f-812e-e2ce06387232 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:04.493649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fa8770c-6fcb-4a1f-812e-e2ce06387232 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:04.546186 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7be30724-1c4a-49a7-93fd-c550d6fdbcac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:04.546790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7be30724-1c4a-49a7-93fd-c550d6fdbcac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:04.553270 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7be30724-1c4a-49a7-93fd-c550d6fdbcac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:04.553831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7be30724-1c4a-49a7-93fd-c550d6fdbcac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:04.554370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7be30724-1c4a-49a7-93fd-c550d6fdbcac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:04.555065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7be30724-1c4a-49a7-93fd-c550d6fdbcac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:04.555520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7be30724-1c4a-49a7-93fd-c550d6fdbcac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:04.555950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7be30724-1c4a-49a7-93fd-c550d6fdbcac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:04.630126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7be30724-1c4a-49a7-93fd-c550d6fdbcac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:04.639379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7be30724-1c4a-49a7-93fd-c550d6fdbcac tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.096986 Oct 28 20:26:04.639953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1362/2728] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:04 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:26:04.646569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8fa8770c-6fcb-4a1f-812e-e2ce06387232 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:04.655444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8fa8770c-6fcb-4a1f-812e-e2ce06387232 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.175281 Oct 28 20:26:04.656019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1367/2729] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:04 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:05.662769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f008598c-8b3f-4cf9-85c3-3ccbba9f3b25 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:05.664030 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f008598c-8b3f-4cf9-85c3-3ccbba9f3b25 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:05.670813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f008598c-8b3f-4cf9-85c3-3ccbba9f3b25 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:05.671293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f008598c-8b3f-4cf9-85c3-3ccbba9f3b25 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:05.671721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f008598c-8b3f-4cf9-85c3-3ccbba9f3b25 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:05.672402 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f008598c-8b3f-4cf9-85c3-3ccbba9f3b25 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:05.672852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f008598c-8b3f-4cf9-85c3-3ccbba9f3b25 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:05.673269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f008598c-8b3f-4cf9-85c3-3ccbba9f3b25 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:05.677722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-653f0764-18b7-4f4b-b11f-d799b6c1b196 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:05.678344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-653f0764-18b7-4f4b-b11f-d799b6c1b196 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:05.685569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-653f0764-18b7-4f4b-b11f-d799b6c1b196 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:05.686055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-653f0764-18b7-4f4b-b11f-d799b6c1b196 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:05.686489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-653f0764-18b7-4f4b-b11f-d799b6c1b196 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:05.687181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-653f0764-18b7-4f4b-b11f-d799b6c1b196 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:05.687629 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-653f0764-18b7-4f4b-b11f-d799b6c1b196 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:05.688050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-653f0764-18b7-4f4b-b11f-d799b6c1b196 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:05.737521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f008598c-8b3f-4cf9-85c3-3ccbba9f3b25 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:05.746435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f008598c-8b3f-4cf9-85c3-3ccbba9f3b25 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087767 Oct 28 20:26:05.747023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1363/2730] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:05 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:05.827652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-653f0764-18b7-4f4b-b11f-d799b6c1b196 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:05.835902 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-653f0764-18b7-4f4b-b11f-d799b6c1b196 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a" status: 200 len: 1559 microversion: 2.1 time: 0.161952 Oct 28 20:26:05.836463 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1368/2731] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:05 2022] GET /compute/v2.1/servers/6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:26:06.769898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6058af8f-4030-466d-b907-75b56a6505fe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:06.770540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6058af8f-4030-466d-b907-75b56a6505fe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:06.777562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6058af8f-4030-466d-b907-75b56a6505fe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:06.778049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6058af8f-4030-466d-b907-75b56a6505fe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:06.778489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6058af8f-4030-466d-b907-75b56a6505fe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:06.779157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6058af8f-4030-466d-b907-75b56a6505fe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:06.779638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6058af8f-4030-466d-b907-75b56a6505fe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:06.780076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6058af8f-4030-466d-b907-75b56a6505fe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:06.851850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6058af8f-4030-466d-b907-75b56a6505fe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:06.859921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6058af8f-4030-466d-b907-75b56a6505fe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.093952 Oct 28 20:26:06.860507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1364/2732] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:06 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:07.884627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c330a760-c025-49e8-83be-61991844ae4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:07.885195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c330a760-c025-49e8-83be-61991844ae4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:07.891577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c330a760-c025-49e8-83be-61991844ae4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:07.892052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c330a760-c025-49e8-83be-61991844ae4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:07.892483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c330a760-c025-49e8-83be-61991844ae4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:07.893159 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c330a760-c025-49e8-83be-61991844ae4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:07.893642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c330a760-c025-49e8-83be-61991844ae4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:07.894061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c330a760-c025-49e8-83be-61991844ae4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:07.954052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c330a760-c025-49e8-83be-61991844ae4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:07.962152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c330a760-c025-49e8-83be-61991844ae4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082342 Oct 28 20:26:07.962741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1369/2733] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:07 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:08.984389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5d6db02d-f504-4ed5-b577-a26a846c1d55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:08.985006 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5d6db02d-f504-4ed5-b577-a26a846c1d55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:08.992188 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d6db02d-f504-4ed5-b577-a26a846c1d55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:08.992676 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d6db02d-f504-4ed5-b577-a26a846c1d55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:08.993115 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d6db02d-f504-4ed5-b577-a26a846c1d55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:08.993838 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d6db02d-f504-4ed5-b577-a26a846c1d55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:08.994296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d6db02d-f504-4ed5-b577-a26a846c1d55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:08.994727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d6db02d-f504-4ed5-b577-a26a846c1d55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:09.056313 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5d6db02d-f504-4ed5-b577-a26a846c1d55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:09.064435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5d6db02d-f504-4ed5-b577-a26a846c1d55 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083939 Oct 28 20:26:09.065002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1365/2734] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:08 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:10.087059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ebbb5f5f-fa11-4181-8104-89b77e6042ae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:10.087673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ebbb5f5f-fa11-4181-8104-89b77e6042ae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:10.094381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebbb5f5f-fa11-4181-8104-89b77e6042ae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:10.094865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebbb5f5f-fa11-4181-8104-89b77e6042ae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:10.095301 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebbb5f5f-fa11-4181-8104-89b77e6042ae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:10.095988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebbb5f5f-fa11-4181-8104-89b77e6042ae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:10.096440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebbb5f5f-fa11-4181-8104-89b77e6042ae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:10.096865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebbb5f5f-fa11-4181-8104-89b77e6042ae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:10.157801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ebbb5f5f-fa11-4181-8104-89b77e6042ae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:10.160035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:26:10.166640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ebbb5f5f-fa11-4181-8104-89b77e6042ae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083893 Oct 28 20:26:10.167202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1370/2735] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:10 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:11.190136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3aa5083e-db25-42b2-8a28-472a8d3c32f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:11.190750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3aa5083e-db25-42b2-8a28-472a8d3c32f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:11.197854 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa5083e-db25-42b2-8a28-472a8d3c32f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:11.198359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa5083e-db25-42b2-8a28-472a8d3c32f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:11.198794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa5083e-db25-42b2-8a28-472a8d3c32f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:11.199477 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa5083e-db25-42b2-8a28-472a8d3c32f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:11.199935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa5083e-db25-42b2-8a28-472a8d3c32f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:11.200357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa5083e-db25-42b2-8a28-472a8d3c32f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:11.262460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3aa5083e-db25-42b2-8a28-472a8d3c32f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:11.270903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3aa5083e-db25-42b2-8a28-472a8d3c32f2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084624 Oct 28 20:26:11.271472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1366/2736] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:11 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:12.294721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fdfbd40d-ec04-469e-a0d2-87c7e473fbbf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:12.295298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fdfbd40d-ec04-469e-a0d2-87c7e473fbbf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:12.301881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdfbd40d-ec04-469e-a0d2-87c7e473fbbf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:12.302375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdfbd40d-ec04-469e-a0d2-87c7e473fbbf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:12.302808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdfbd40d-ec04-469e-a0d2-87c7e473fbbf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:12.303490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdfbd40d-ec04-469e-a0d2-87c7e473fbbf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:12.304492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdfbd40d-ec04-469e-a0d2-87c7e473fbbf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:12.305024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdfbd40d-ec04-469e-a0d2-87c7e473fbbf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:12.370192 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fdfbd40d-ec04-469e-a0d2-87c7e473fbbf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:12.378314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fdfbd40d-ec04-469e-a0d2-87c7e473fbbf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087928 Oct 28 20:26:12.378879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1371/2737] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:12 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:13.402172 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c80073d0-3232-4132-ad71-ba696d9210bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:13.402761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c80073d0-3232-4132-ad71-ba696d9210bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:13.405053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=50 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:26:13.409995 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c80073d0-3232-4132-ad71-ba696d9210bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:13.410503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c80073d0-3232-4132-ad71-ba696d9210bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:13.410930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c80073d0-3232-4132-ad71-ba696d9210bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:13.411608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c80073d0-3232-4132-ad71-ba696d9210bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:13.412067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c80073d0-3232-4132-ad71-ba696d9210bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:13.412500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c80073d0-3232-4132-ad71-ba696d9210bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:13.476154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c80073d0-3232-4132-ad71-ba696d9210bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:13.483092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c80073d0-3232-4132-ad71-ba696d9210bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085532 Oct 28 20:26:13.483659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1367/2738] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:13 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:14.505942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-df541737-e21f-44a5-b2f9-f2f8a4383419 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:14.506548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-df541737-e21f-44a5-b2f9-f2f8a4383419 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:14.509990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=44 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:26:14.514797 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df541737-e21f-44a5-b2f9-f2f8a4383419 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:14.515286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df541737-e21f-44a5-b2f9-f2f8a4383419 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:14.515724 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df541737-e21f-44a5-b2f9-f2f8a4383419 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:14.516410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df541737-e21f-44a5-b2f9-f2f8a4383419 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:14.516865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df541737-e21f-44a5-b2f9-f2f8a4383419 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:14.517290 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df541737-e21f-44a5-b2f9-f2f8a4383419 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:14.589432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-df541737-e21f-44a5-b2f9-f2f8a4383419 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:14.597706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-df541737-e21f-44a5-b2f9-f2f8a4383419 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.095578 Oct 28 20:26:14.598265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1372/2739] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:14 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:15.621076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-64bb8b85-8525-46b9-ae70-94b82b0bb74c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:15.621716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-64bb8b85-8525-46b9-ae70-94b82b0bb74c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:15.628147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64bb8b85-8525-46b9-ae70-94b82b0bb74c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:15.628621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64bb8b85-8525-46b9-ae70-94b82b0bb74c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:15.629051 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64bb8b85-8525-46b9-ae70-94b82b0bb74c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:15.629750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64bb8b85-8525-46b9-ae70-94b82b0bb74c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:15.630199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64bb8b85-8525-46b9-ae70-94b82b0bb74c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:15.630620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64bb8b85-8525-46b9-ae70-94b82b0bb74c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:15.690467 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-64bb8b85-8525-46b9-ae70-94b82b0bb74c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:15.699397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-64bb8b85-8525-46b9-ae70-94b82b0bb74c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082608 Oct 28 20:26:15.699987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1368/2740] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:15 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:16.723394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4e142d9-24ed-4416-91b6-41e2b2d994d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:16.724756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d4e142d9-24ed-4416-91b6-41e2b2d994d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:16.730306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4e142d9-24ed-4416-91b6-41e2b2d994d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:16.730789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4e142d9-24ed-4416-91b6-41e2b2d994d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:16.731224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4e142d9-24ed-4416-91b6-41e2b2d994d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:16.731904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4e142d9-24ed-4416-91b6-41e2b2d994d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:16.732357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4e142d9-24ed-4416-91b6-41e2b2d994d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:16.732777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4e142d9-24ed-4416-91b6-41e2b2d994d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:17.037077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d4e142d9-24ed-4416-91b6-41e2b2d994d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:17.045897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d4e142d9-24ed-4416-91b6-41e2b2d994d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.326560 Oct 28 20:26:17.046456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1373/2741] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:16 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:18.068874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-baade1dd-3a2f-4b0e-b3d5-0db6ed09d289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:18.069523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-baade1dd-3a2f-4b0e-b3d5-0db6ed09d289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:18.075925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-baade1dd-3a2f-4b0e-b3d5-0db6ed09d289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:18.076409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-baade1dd-3a2f-4b0e-b3d5-0db6ed09d289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:18.076846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-baade1dd-3a2f-4b0e-b3d5-0db6ed09d289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:18.077564 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-baade1dd-3a2f-4b0e-b3d5-0db6ed09d289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:18.078019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-baade1dd-3a2f-4b0e-b3d5-0db6ed09d289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:18.078442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-baade1dd-3a2f-4b0e-b3d5-0db6ed09d289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:18.138304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-baade1dd-3a2f-4b0e-b3d5-0db6ed09d289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:18.146367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-baade1dd-3a2f-4b0e-b3d5-0db6ed09d289 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.081398 Oct 28 20:26:18.146942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1369/2742] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:18 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:19.169956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d17dad2d-3926-4743-9cd7-449f83291cf9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:19.170568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d17dad2d-3926-4743-9cd7-449f83291cf9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:19.177283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d17dad2d-3926-4743-9cd7-449f83291cf9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:19.177790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d17dad2d-3926-4743-9cd7-449f83291cf9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:19.178226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d17dad2d-3926-4743-9cd7-449f83291cf9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:19.179044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d17dad2d-3926-4743-9cd7-449f83291cf9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:19.179494 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d17dad2d-3926-4743-9cd7-449f83291cf9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:19.179920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d17dad2d-3926-4743-9cd7-449f83291cf9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:19.240253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d17dad2d-3926-4743-9cd7-449f83291cf9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:19.248802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d17dad2d-3926-4743-9cd7-449f83291cf9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082684 Oct 28 20:26:19.249387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1374/2743] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:19 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:20.271076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c1c2fb10-08c9-4511-9220-3c42ee78ef1f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:20.271699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c1c2fb10-08c9-4511-9220-3c42ee78ef1f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:20.278658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c2fb10-08c9-4511-9220-3c42ee78ef1f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:20.279150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c2fb10-08c9-4511-9220-3c42ee78ef1f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:20.279592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c2fb10-08c9-4511-9220-3c42ee78ef1f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:20.280282 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c2fb10-08c9-4511-9220-3c42ee78ef1f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:20.280743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c2fb10-08c9-4511-9220-3c42ee78ef1f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:20.281219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c2fb10-08c9-4511-9220-3c42ee78ef1f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:20.344622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c1c2fb10-08c9-4511-9220-3c42ee78ef1f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:20.353532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c1c2fb10-08c9-4511-9220-3c42ee78ef1f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086544 Oct 28 20:26:20.355840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1370/2744] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:20 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:21.376120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e2c29070-f779-4bd0-bdf3-99d72871f7d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:21.376714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e2c29070-f779-4bd0-bdf3-99d72871f7d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:21.383757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2c29070-f779-4bd0-bdf3-99d72871f7d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:21.384236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2c29070-f779-4bd0-bdf3-99d72871f7d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:21.384667 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2c29070-f779-4bd0-bdf3-99d72871f7d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:21.385368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2c29070-f779-4bd0-bdf3-99d72871f7d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:21.385864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2c29070-f779-4bd0-bdf3-99d72871f7d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:21.386286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2c29070-f779-4bd0-bdf3-99d72871f7d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:21.448374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e2c29070-f779-4bd0-bdf3-99d72871f7d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:21.456374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e2c29070-f779-4bd0-bdf3-99d72871f7d6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084232 Oct 28 20:26:21.456931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1375/2745] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:21 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:22.479418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f3322a61-f3da-41e9-a592-f049ac301ef7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:22.480009 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f3322a61-f3da-41e9-a592-f049ac301ef7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:22.486433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3322a61-f3da-41e9-a592-f049ac301ef7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:22.486913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3322a61-f3da-41e9-a592-f049ac301ef7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:22.487343 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3322a61-f3da-41e9-a592-f049ac301ef7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:22.488068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3322a61-f3da-41e9-a592-f049ac301ef7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:22.488517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3322a61-f3da-41e9-a592-f049ac301ef7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:22.488934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3322a61-f3da-41e9-a592-f049ac301ef7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:22.555602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f3322a61-f3da-41e9-a592-f049ac301ef7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:22.563666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f3322a61-f3da-41e9-a592-f049ac301ef7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.088322 Oct 28 20:26:22.572893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1371/2746] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:22 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:23.587095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c8145959-ddfa-4dc5-9b38-2aee03a069a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:23.587712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c8145959-ddfa-4dc5-9b38-2aee03a069a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:23.594594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8145959-ddfa-4dc5-9b38-2aee03a069a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:23.595077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8145959-ddfa-4dc5-9b38-2aee03a069a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:23.595679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8145959-ddfa-4dc5-9b38-2aee03a069a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:23.596370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8145959-ddfa-4dc5-9b38-2aee03a069a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:23.596822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8145959-ddfa-4dc5-9b38-2aee03a069a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:23.597245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8145959-ddfa-4dc5-9b38-2aee03a069a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:23.658190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c8145959-ddfa-4dc5-9b38-2aee03a069a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:23.666484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c8145959-ddfa-4dc5-9b38-2aee03a069a6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083311 Oct 28 20:26:23.667040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1376/2747] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:23 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:24.690536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-59de5177-3c2d-4eb5-9b17-e59986842ee6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:24.700518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-59de5177-3c2d-4eb5-9b17-e59986842ee6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:24.700518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59de5177-3c2d-4eb5-9b17-e59986842ee6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:24.700518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59de5177-3c2d-4eb5-9b17-e59986842ee6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:24.700518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59de5177-3c2d-4eb5-9b17-e59986842ee6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:24.701021 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59de5177-3c2d-4eb5-9b17-e59986842ee6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:24.701126 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59de5177-3c2d-4eb5-9b17-e59986842ee6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:24.701535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59de5177-3c2d-4eb5-9b17-e59986842ee6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:24.763107 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-59de5177-3c2d-4eb5-9b17-e59986842ee6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:24.771388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-59de5177-3c2d-4eb5-9b17-e59986842ee6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085204 Oct 28 20:26:24.771968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1372/2748] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:24 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:25.794935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c3e1591a-ea9c-4a61-9c1b-bca60b49a6b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:25.795550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c3e1591a-ea9c-4a61-9c1b-bca60b49a6b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:25.802046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e1591a-ea9c-4a61-9c1b-bca60b49a6b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:25.802650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e1591a-ea9c-4a61-9c1b-bca60b49a6b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:25.803083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e1591a-ea9c-4a61-9c1b-bca60b49a6b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:25.804803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e1591a-ea9c-4a61-9c1b-bca60b49a6b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:25.805271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e1591a-ea9c-4a61-9c1b-bca60b49a6b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:25.805725 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e1591a-ea9c-4a61-9c1b-bca60b49a6b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:25.869284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c3e1591a-ea9c-4a61-9c1b-bca60b49a6b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:25.877577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c3e1591a-ea9c-4a61-9c1b-bca60b49a6b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086560 Oct 28 20:26:25.878139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1377/2749] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:25 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:26.900160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7cce0704-5f67-41f2-8249-32d9c07e5fba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:26.900759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7cce0704-5f67-41f2-8249-32d9c07e5fba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:26.907205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cce0704-5f67-41f2-8249-32d9c07e5fba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:26.907680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cce0704-5f67-41f2-8249-32d9c07e5fba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:26.908111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cce0704-5f67-41f2-8249-32d9c07e5fba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:26.908781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cce0704-5f67-41f2-8249-32d9c07e5fba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:26.909228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cce0704-5f67-41f2-8249-32d9c07e5fba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:26.909677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cce0704-5f67-41f2-8249-32d9c07e5fba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:26.970699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7cce0704-5f67-41f2-8249-32d9c07e5fba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:26.974094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:26:26.979518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7cce0704-5f67-41f2-8249-32d9c07e5fba tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083354 Oct 28 20:26:26.980091 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1373/2750] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:26 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:28.002966 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3e79b814-b127-4f01-92be-df6df5f3c0de tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:28.003662 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3e79b814-b127-4f01-92be-df6df5f3c0de tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:28.011399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e79b814-b127-4f01-92be-df6df5f3c0de tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:28.011888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e79b814-b127-4f01-92be-df6df5f3c0de tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:28.012326 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e79b814-b127-4f01-92be-df6df5f3c0de tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:28.013027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e79b814-b127-4f01-92be-df6df5f3c0de tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:28.013515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e79b814-b127-4f01-92be-df6df5f3c0de tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:28.013944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e79b814-b127-4f01-92be-df6df5f3c0de tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:28.079423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3e79b814-b127-4f01-92be-df6df5f3c0de tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:28.087824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3e79b814-b127-4f01-92be-df6df5f3c0de tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.088700 Oct 28 20:26:28.088425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1378/2751] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:27 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:29.110957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ed92957d-5ea8-4cce-b978-ddfb8fc9e41a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:29.111574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ed92957d-5ea8-4cce-b978-ddfb8fc9e41a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:29.119459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed92957d-5ea8-4cce-b978-ddfb8fc9e41a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:29.119948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed92957d-5ea8-4cce-b978-ddfb8fc9e41a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:29.120389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed92957d-5ea8-4cce-b978-ddfb8fc9e41a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:29.121074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed92957d-5ea8-4cce-b978-ddfb8fc9e41a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:29.121569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed92957d-5ea8-4cce-b978-ddfb8fc9e41a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:29.121999 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed92957d-5ea8-4cce-b978-ddfb8fc9e41a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:29.183114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ed92957d-5ea8-4cce-b978-ddfb8fc9e41a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:29.190987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ed92957d-5ea8-4cce-b978-ddfb8fc9e41a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083926 Oct 28 20:26:29.191548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1374/2752] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:29 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:30.215157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-158ff5da-0ccd-4beb-a21e-ca9c12b3e93f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:30.215765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-158ff5da-0ccd-4beb-a21e-ca9c12b3e93f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:30.222436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-158ff5da-0ccd-4beb-a21e-ca9c12b3e93f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:30.222913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-158ff5da-0ccd-4beb-a21e-ca9c12b3e93f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:30.223346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-158ff5da-0ccd-4beb-a21e-ca9c12b3e93f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:30.224025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-158ff5da-0ccd-4beb-a21e-ca9c12b3e93f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:30.224474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-158ff5da-0ccd-4beb-a21e-ca9c12b3e93f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:30.224894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-158ff5da-0ccd-4beb-a21e-ca9c12b3e93f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:30.290587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-158ff5da-0ccd-4beb-a21e-ca9c12b3e93f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:30.298844 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-158ff5da-0ccd-4beb-a21e-ca9c12b3e93f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087566 Oct 28 20:26:30.299407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1379/2753] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:30 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:31.323341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dac98b24-1698-4dd9-8d76-f935739b7127 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:31.323896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dac98b24-1698-4dd9-8d76-f935739b7127 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:31.330228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dac98b24-1698-4dd9-8d76-f935739b7127 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:31.330714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dac98b24-1698-4dd9-8d76-f935739b7127 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:31.331152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dac98b24-1698-4dd9-8d76-f935739b7127 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:31.331840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dac98b24-1698-4dd9-8d76-f935739b7127 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:31.332299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dac98b24-1698-4dd9-8d76-f935739b7127 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:31.332726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dac98b24-1698-4dd9-8d76-f935739b7127 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:31.395864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-dac98b24-1698-4dd9-8d76-f935739b7127 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:31.404445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dac98b24-1698-4dd9-8d76-f935739b7127 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085375 Oct 28 20:26:31.405004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1375/2754] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:31 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:32.427689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-911a60ed-48e6-469e-abdf-92b5bef27d53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:32.428282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-911a60ed-48e6-469e-abdf-92b5bef27d53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:32.435272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-911a60ed-48e6-469e-abdf-92b5bef27d53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:32.435749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-911a60ed-48e6-469e-abdf-92b5bef27d53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:32.436180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-911a60ed-48e6-469e-abdf-92b5bef27d53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:32.436859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-911a60ed-48e6-469e-abdf-92b5bef27d53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:32.437309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-911a60ed-48e6-469e-abdf-92b5bef27d53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:32.437750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-911a60ed-48e6-469e-abdf-92b5bef27d53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:32.499920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-911a60ed-48e6-469e-abdf-92b5bef27d53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:32.508100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-911a60ed-48e6-469e-abdf-92b5bef27d53 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084227 Oct 28 20:26:32.510147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1380/2755] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:32 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:33.531304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-86312e99-aa49-443a-84cd-b19fc4a91c75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:33.531914 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-86312e99-aa49-443a-84cd-b19fc4a91c75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:33.538227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86312e99-aa49-443a-84cd-b19fc4a91c75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:33.538704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86312e99-aa49-443a-84cd-b19fc4a91c75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:33.539197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86312e99-aa49-443a-84cd-b19fc4a91c75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:33.539878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86312e99-aa49-443a-84cd-b19fc4a91c75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:33.540327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86312e99-aa49-443a-84cd-b19fc4a91c75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:33.540749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86312e99-aa49-443a-84cd-b19fc4a91c75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:33.601918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-86312e99-aa49-443a-84cd-b19fc4a91c75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:33.609997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-86312e99-aa49-443a-84cd-b19fc4a91c75 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082562 Oct 28 20:26:33.610556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1376/2756] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:33 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:34.633605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9301ace8-7808-43c6-94ec-c08ff8fef823 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:34.634237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9301ace8-7808-43c6-94ec-c08ff8fef823 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:34.640735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9301ace8-7808-43c6-94ec-c08ff8fef823 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:34.641219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9301ace8-7808-43c6-94ec-c08ff8fef823 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:34.641685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9301ace8-7808-43c6-94ec-c08ff8fef823 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:34.642380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9301ace8-7808-43c6-94ec-c08ff8fef823 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:34.642841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9301ace8-7808-43c6-94ec-c08ff8fef823 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:34.643268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9301ace8-7808-43c6-94ec-c08ff8fef823 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:34.708415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9301ace8-7808-43c6-94ec-c08ff8fef823 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:34.716641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9301ace8-7808-43c6-94ec-c08ff8fef823 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087463 Oct 28 20:26:34.717203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1381/2757] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:34 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:35.740203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8d914c48-5080-4b3a-a21e-58468a1c8452 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:35.740849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8d914c48-5080-4b3a-a21e-58468a1c8452 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:35.747894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d914c48-5080-4b3a-a21e-58468a1c8452 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:35.748374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d914c48-5080-4b3a-a21e-58468a1c8452 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:35.748811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d914c48-5080-4b3a-a21e-58468a1c8452 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:35.749522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d914c48-5080-4b3a-a21e-58468a1c8452 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:35.749980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d914c48-5080-4b3a-a21e-58468a1c8452 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:35.750412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d914c48-5080-4b3a-a21e-58468a1c8452 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:35.810304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8d914c48-5080-4b3a-a21e-58468a1c8452 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:35.818444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8d914c48-5080-4b3a-a21e-58468a1c8452 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082078 Oct 28 20:26:35.819000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1377/2758] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:35 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:36.841909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9397dd7f-3a6e-49a4-8a62-813c7ce96de0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:36.842508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9397dd7f-3a6e-49a4-8a62-813c7ce96de0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:36.849062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9397dd7f-3a6e-49a4-8a62-813c7ce96de0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:36.849652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9397dd7f-3a6e-49a4-8a62-813c7ce96de0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:36.850085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9397dd7f-3a6e-49a4-8a62-813c7ce96de0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:36.850764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9397dd7f-3a6e-49a4-8a62-813c7ce96de0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:36.851745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9397dd7f-3a6e-49a4-8a62-813c7ce96de0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:36.852359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9397dd7f-3a6e-49a4-8a62-813c7ce96de0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:36.913100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9397dd7f-3a6e-49a4-8a62-813c7ce96de0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:36.921363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9397dd7f-3a6e-49a4-8a62-813c7ce96de0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083535 Oct 28 20:26:36.921931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1382/2759] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:36 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:26:37.944018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-29264a57-1047-4fe9-ad9e-8ac9e947e852 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:37.944642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-29264a57-1047-4fe9-ad9e-8ac9e947e852 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:37.951557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29264a57-1047-4fe9-ad9e-8ac9e947e852 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:37.952046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29264a57-1047-4fe9-ad9e-8ac9e947e852 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:37.952487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29264a57-1047-4fe9-ad9e-8ac9e947e852 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:37.953185 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29264a57-1047-4fe9-ad9e-8ac9e947e852 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:37.953677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29264a57-1047-4fe9-ad9e-8ac9e947e852 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:37.954103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29264a57-1047-4fe9-ad9e-8ac9e947e852 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:38.018578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-29264a57-1047-4fe9-ad9e-8ac9e947e852 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:38.027952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-29264a57-1047-4fe9-ad9e-8ac9e947e852 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087808 Oct 28 20:26:38.028526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1378/2760] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:37 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:39.051406 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4afa115e-0464-418b-9444-4ba1794a3801 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:39.052024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4afa115e-0464-418b-9444-4ba1794a3801 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:39.059283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4afa115e-0464-418b-9444-4ba1794a3801 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:39.059767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4afa115e-0464-418b-9444-4ba1794a3801 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:39.060208 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4afa115e-0464-418b-9444-4ba1794a3801 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:39.060897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4afa115e-0464-418b-9444-4ba1794a3801 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:39.061382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4afa115e-0464-418b-9444-4ba1794a3801 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:39.061811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4afa115e-0464-418b-9444-4ba1794a3801 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:39.125358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4afa115e-0464-418b-9444-4ba1794a3801 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:39.133795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4afa115e-0464-418b-9444-4ba1794a3801 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086237 Oct 28 20:26:39.134653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1383/2761] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:39 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:40.157272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8cfbf185-f560-4c57-a212-0cd7244effdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:40.157909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8cfbf185-f560-4c57-a212-0cd7244effdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:40.164966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cfbf185-f560-4c57-a212-0cd7244effdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:40.165480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cfbf185-f560-4c57-a212-0cd7244effdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:40.165919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cfbf185-f560-4c57-a212-0cd7244effdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:40.166600 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cfbf185-f560-4c57-a212-0cd7244effdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:40.167052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cfbf185-f560-4c57-a212-0cd7244effdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:40.167475 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cfbf185-f560-4c57-a212-0cd7244effdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:40.227185 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8cfbf185-f560-4c57-a212-0cd7244effdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:40.235245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8cfbf185-f560-4c57-a212-0cd7244effdb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.081836 Oct 28 20:26:40.235805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1379/2762] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:40 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:26:41.258347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58b20fec-b4c1-4717-9d9e-04962508484b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:41.258967 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-58b20fec-b4c1-4717-9d9e-04962508484b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:41.265539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58b20fec-b4c1-4717-9d9e-04962508484b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:41.266027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58b20fec-b4c1-4717-9d9e-04962508484b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:41.266471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58b20fec-b4c1-4717-9d9e-04962508484b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:41.267158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58b20fec-b4c1-4717-9d9e-04962508484b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:41.267615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58b20fec-b4c1-4717-9d9e-04962508484b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:41.268038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58b20fec-b4c1-4717-9d9e-04962508484b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:41.332806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-58b20fec-b4c1-4717-9d9e-04962508484b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:41.341109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-58b20fec-b4c1-4717-9d9e-04962508484b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086802 Oct 28 20:26:41.341704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1384/2763] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:41 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:42.364030 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dbc8e978-61d1-414e-94aa-e3cb5efd389a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:42.364609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dbc8e978-61d1-414e-94aa-e3cb5efd389a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:42.371855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbc8e978-61d1-414e-94aa-e3cb5efd389a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:42.372343 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbc8e978-61d1-414e-94aa-e3cb5efd389a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:42.372782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbc8e978-61d1-414e-94aa-e3cb5efd389a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:42.373512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbc8e978-61d1-414e-94aa-e3cb5efd389a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:42.373979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbc8e978-61d1-414e-94aa-e3cb5efd389a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:42.374407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbc8e978-61d1-414e-94aa-e3cb5efd389a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:42.435394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-dbc8e978-61d1-414e-94aa-e3cb5efd389a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:42.443334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dbc8e978-61d1-414e-94aa-e3cb5efd389a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083248 Oct 28 20:26:42.443901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1380/2764] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:42 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:43.467311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d3367c2e-962d-42f7-aeb6-a948c4debfa5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:43.467926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d3367c2e-962d-42f7-aeb6-a948c4debfa5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:43.474653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3367c2e-962d-42f7-aeb6-a948c4debfa5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:43.475129 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3367c2e-962d-42f7-aeb6-a948c4debfa5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:43.475563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3367c2e-962d-42f7-aeb6-a948c4debfa5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:43.476274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3367c2e-962d-42f7-aeb6-a948c4debfa5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:43.476808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3367c2e-962d-42f7-aeb6-a948c4debfa5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:43.477398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3367c2e-962d-42f7-aeb6-a948c4debfa5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:43.479904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=86 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:26:43.541357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d3367c2e-962d-42f7-aeb6-a948c4debfa5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:43.549462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d3367c2e-962d-42f7-aeb6-a948c4debfa5 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085971 Oct 28 20:26:43.550022 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1385/2765] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:43 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:44.572767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-98769760-34c7-4680-bcad-f43e4c4c326b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:44.573408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-98769760-34c7-4680-bcad-f43e4c4c326b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:44.575716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=28 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:26:44.580372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98769760-34c7-4680-bcad-f43e4c4c326b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:44.580856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98769760-34c7-4680-bcad-f43e4c4c326b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:44.581295 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98769760-34c7-4680-bcad-f43e4c4c326b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:44.582004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98769760-34c7-4680-bcad-f43e4c4c326b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:44.582460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98769760-34c7-4680-bcad-f43e4c4c326b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:44.582885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98769760-34c7-4680-bcad-f43e4c4c326b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:44.644951 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-98769760-34c7-4680-bcad-f43e4c4c326b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:44.653219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-98769760-34c7-4680-bcad-f43e4c4c326b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085133 Oct 28 20:26:44.653832 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1381/2766] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:44 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:45.675936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a8a0e694-c2e0-4eab-94e5-c342d2a4a561 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:45.676559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a8a0e694-c2e0-4eab-94e5-c342d2a4a561 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:45.678975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=28 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:26:45.683920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8a0e694-c2e0-4eab-94e5-c342d2a4a561 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:45.684401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8a0e694-c2e0-4eab-94e5-c342d2a4a561 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:45.684841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8a0e694-c2e0-4eab-94e5-c342d2a4a561 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:45.685559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8a0e694-c2e0-4eab-94e5-c342d2a4a561 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:45.686008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8a0e694-c2e0-4eab-94e5-c342d2a4a561 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:45.686432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8a0e694-c2e0-4eab-94e5-c342d2a4a561 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:45.748149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a8a0e694-c2e0-4eab-94e5-c342d2a4a561 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:45.756210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a8a0e694-c2e0-4eab-94e5-c342d2a4a561 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084175 Oct 28 20:26:45.756795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1386/2767] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:45 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:46.779772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-50dd8b15-e20f-4e81-a654-3eb5a351f256 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:46.780437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-50dd8b15-e20f-4e81-a654-3eb5a351f256 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:46.786710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50dd8b15-e20f-4e81-a654-3eb5a351f256 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:46.787281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50dd8b15-e20f-4e81-a654-3eb5a351f256 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:46.787613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50dd8b15-e20f-4e81-a654-3eb5a351f256 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:46.788298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50dd8b15-e20f-4e81-a654-3eb5a351f256 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:46.789467 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50dd8b15-e20f-4e81-a654-3eb5a351f256 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:46.789898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50dd8b15-e20f-4e81-a654-3eb5a351f256 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:46.851584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-50dd8b15-e20f-4e81-a654-3eb5a351f256 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:46.859724 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-50dd8b15-e20f-4e81-a654-3eb5a351f256 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083891 Oct 28 20:26:46.860292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1382/2768] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:46 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:47.882975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-23aa3eeb-67d4-4127-904a-018c9adf1c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:47.883527 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-23aa3eeb-67d4-4127-904a-018c9adf1c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:47.889581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23aa3eeb-67d4-4127-904a-018c9adf1c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:47.890063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23aa3eeb-67d4-4127-904a-018c9adf1c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:47.890520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23aa3eeb-67d4-4127-904a-018c9adf1c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:47.891205 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23aa3eeb-67d4-4127-904a-018c9adf1c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:47.891720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23aa3eeb-67d4-4127-904a-018c9adf1c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:47.892145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23aa3eeb-67d4-4127-904a-018c9adf1c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:47.955781 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-23aa3eeb-67d4-4127-904a-018c9adf1c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:47.964892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-23aa3eeb-67d4-4127-904a-018c9adf1c9f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086084 Oct 28 20:26:47.965484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1387/2769] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:47 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:48.988059 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b7a6295-522f-4c48-b692-3f8aa5ab8995 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:48.988714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9b7a6295-522f-4c48-b692-3f8aa5ab8995 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:48.995997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b7a6295-522f-4c48-b692-3f8aa5ab8995 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:48.996485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b7a6295-522f-4c48-b692-3f8aa5ab8995 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:48.996924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b7a6295-522f-4c48-b692-3f8aa5ab8995 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:48.997650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b7a6295-522f-4c48-b692-3f8aa5ab8995 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:48.998115 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b7a6295-522f-4c48-b692-3f8aa5ab8995 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:48.998543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b7a6295-522f-4c48-b692-3f8aa5ab8995 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:49.061416 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9b7a6295-522f-4c48-b692-3f8aa5ab8995 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:49.069577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b7a6295-522f-4c48-b692-3f8aa5ab8995 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085387 Oct 28 20:26:49.070289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1383/2770] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:48 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:50.092096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-645e470c-c5d4-4075-9303-032643436231 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:50.092709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-645e470c-c5d4-4075-9303-032643436231 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:50.099345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-645e470c-c5d4-4075-9303-032643436231 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:50.099858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-645e470c-c5d4-4075-9303-032643436231 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:50.100303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-645e470c-c5d4-4075-9303-032643436231 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:50.101482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-645e470c-c5d4-4075-9303-032643436231 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:50.101959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-645e470c-c5d4-4075-9303-032643436231 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:50.102388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-645e470c-c5d4-4075-9303-032643436231 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:50.163913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-645e470c-c5d4-4075-9303-032643436231 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:50.171851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-645e470c-c5d4-4075-9303-032643436231 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083668 Oct 28 20:26:50.172411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1388/2771] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:50 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:51.196198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4bf5079d-cb98-4833-97be-9f86ca689cae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:51.196839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4bf5079d-cb98-4833-97be-9f86ca689cae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:51.203259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bf5079d-cb98-4833-97be-9f86ca689cae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:51.203741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bf5079d-cb98-4833-97be-9f86ca689cae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:51.204180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bf5079d-cb98-4833-97be-9f86ca689cae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:51.204868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bf5079d-cb98-4833-97be-9f86ca689cae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:51.205351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bf5079d-cb98-4833-97be-9f86ca689cae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:51.205774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bf5079d-cb98-4833-97be-9f86ca689cae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:51.267239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4bf5079d-cb98-4833-97be-9f86ca689cae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:51.276226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4bf5079d-cb98-4833-97be-9f86ca689cae tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084757 Oct 28 20:26:51.276814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1384/2772] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:51 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:52.299999 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1dc4945c-3d5f-4f19-8949-2254f6f5274e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:52.300548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1dc4945c-3d5f-4f19-8949-2254f6f5274e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:52.307525 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1dc4945c-3d5f-4f19-8949-2254f6f5274e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:52.308000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1dc4945c-3d5f-4f19-8949-2254f6f5274e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:52.308429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1dc4945c-3d5f-4f19-8949-2254f6f5274e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:52.309108 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1dc4945c-3d5f-4f19-8949-2254f6f5274e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:52.309586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1dc4945c-3d5f-4f19-8949-2254f6f5274e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:52.310004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1dc4945c-3d5f-4f19-8949-2254f6f5274e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:52.373765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1dc4945c-3d5f-4f19-8949-2254f6f5274e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:52.381819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1dc4945c-3d5f-4f19-8949-2254f6f5274e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085737 Oct 28 20:26:52.383022 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1389/2773] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:52 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:53.405656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e10e94d6-fa03-42de-bcae-7a6565bd97bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:53.406283 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e10e94d6-fa03-42de-bcae-7a6565bd97bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:53.412623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e10e94d6-fa03-42de-bcae-7a6565bd97bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:53.413109 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e10e94d6-fa03-42de-bcae-7a6565bd97bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:53.414138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e10e94d6-fa03-42de-bcae-7a6565bd97bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:53.414934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e10e94d6-fa03-42de-bcae-7a6565bd97bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:53.415392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e10e94d6-fa03-42de-bcae-7a6565bd97bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:53.415817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e10e94d6-fa03-42de-bcae-7a6565bd97bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:53.478299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e10e94d6-fa03-42de-bcae-7a6565bd97bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:53.486400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e10e94d6-fa03-42de-bcae-7a6565bd97bb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084733 Oct 28 20:26:53.486963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1385/2774] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:53 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:54.509936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c7416ebc-9dfb-421e-bc1a-26659701585a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:54.510581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c7416ebc-9dfb-421e-bc1a-26659701585a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:54.517051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7416ebc-9dfb-421e-bc1a-26659701585a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:54.517568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7416ebc-9dfb-421e-bc1a-26659701585a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:54.518006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7416ebc-9dfb-421e-bc1a-26659701585a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:54.518696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7416ebc-9dfb-421e-bc1a-26659701585a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:54.519151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7416ebc-9dfb-421e-bc1a-26659701585a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:54.519579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7416ebc-9dfb-421e-bc1a-26659701585a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:54.580318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c7416ebc-9dfb-421e-bc1a-26659701585a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:54.589347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c7416ebc-9dfb-421e-bc1a-26659701585a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083453 Oct 28 20:26:54.589907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1390/2775] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:54 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:55.612837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-77f78de3-9502-4194-ac3d-cf34438627b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:55.613493 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-77f78de3-9502-4194-ac3d-cf34438627b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:55.619591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77f78de3-9502-4194-ac3d-cf34438627b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:55.620067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77f78de3-9502-4194-ac3d-cf34438627b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:55.620507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77f78de3-9502-4194-ac3d-cf34438627b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:55.621183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77f78de3-9502-4194-ac3d-cf34438627b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:55.621666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77f78de3-9502-4194-ac3d-cf34438627b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:55.622092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77f78de3-9502-4194-ac3d-cf34438627b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:55.682426 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-77f78de3-9502-4194-ac3d-cf34438627b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:55.690503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-77f78de3-9502-4194-ac3d-cf34438627b3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.081460 Oct 28 20:26:55.691065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1386/2776] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:55 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:56.714047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-408ecdd5-bd46-4222-bda5-50f338eb873d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:56.714602 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-408ecdd5-bd46-4222-bda5-50f338eb873d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:56.721182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-408ecdd5-bd46-4222-bda5-50f338eb873d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:56.721693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-408ecdd5-bd46-4222-bda5-50f338eb873d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:56.722130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-408ecdd5-bd46-4222-bda5-50f338eb873d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:56.722812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-408ecdd5-bd46-4222-bda5-50f338eb873d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:56.723263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-408ecdd5-bd46-4222-bda5-50f338eb873d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:56.723687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-408ecdd5-bd46-4222-bda5-50f338eb873d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:56.790365 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-408ecdd5-bd46-4222-bda5-50f338eb873d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:56.798553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-408ecdd5-bd46-4222-bda5-50f338eb873d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.088984 Oct 28 20:26:56.799118 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1391/2777] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:56 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:26:57.821604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d2b8b978-3d22-4ca0-a99d-1682b02b4612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:57.822150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d2b8b978-3d22-4ca0-a99d-1682b02b4612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:57.828447 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2b8b978-3d22-4ca0-a99d-1682b02b4612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:57.828920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2b8b978-3d22-4ca0-a99d-1682b02b4612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:57.829372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2b8b978-3d22-4ca0-a99d-1682b02b4612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:57.830050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2b8b978-3d22-4ca0-a99d-1682b02b4612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:57.830498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2b8b978-3d22-4ca0-a99d-1682b02b4612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:57.830917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2b8b978-3d22-4ca0-a99d-1682b02b4612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:57.892461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d2b8b978-3d22-4ca0-a99d-1682b02b4612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:57.900915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d2b8b978-3d22-4ca0-a99d-1682b02b4612 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083327 Oct 28 20:26:57.901498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1387/2778] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:57 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:58.924893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-92ea77c6-f0bc-43c2-a371-ce188190dbc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:58.925548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-92ea77c6-f0bc-43c2-a371-ce188190dbc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:58.933738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92ea77c6-f0bc-43c2-a371-ce188190dbc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:58.934218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92ea77c6-f0bc-43c2-a371-ce188190dbc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:58.934650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92ea77c6-f0bc-43c2-a371-ce188190dbc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:58.935336 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92ea77c6-f0bc-43c2-a371-ce188190dbc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:58.935779 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92ea77c6-f0bc-43c2-a371-ce188190dbc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:58.936194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92ea77c6-f0bc-43c2-a371-ce188190dbc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:59.000146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-92ea77c6-f0bc-43c2-a371-ce188190dbc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:59.014936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-92ea77c6-f0bc-43c2-a371-ce188190dbc0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.094489 Oct 28 20:26:59.015542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1392/2779] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:58 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:00.038273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4edde07b-3ec1-431b-9073-59e560372356 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:00.038896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4edde07b-3ec1-431b-9073-59e560372356 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:00.045593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4edde07b-3ec1-431b-9073-59e560372356 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:00.046110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4edde07b-3ec1-431b-9073-59e560372356 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:00.046626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4edde07b-3ec1-431b-9073-59e560372356 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:00.047203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4edde07b-3ec1-431b-9073-59e560372356 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:00.047653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4edde07b-3ec1-431b-9073-59e560372356 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:00.048072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4edde07b-3ec1-431b-9073-59e560372356 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:00.050798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=85 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:00.111528 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4edde07b-3ec1-431b-9073-59e560372356 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:00.119769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4edde07b-3ec1-431b-9073-59e560372356 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085304 Oct 28 20:27:00.120346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1388/2780] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:00 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:01.143143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1e7b0a09-122f-406d-b006-0efaef4ceccd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:01.143756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1e7b0a09-122f-406d-b006-0efaef4ceccd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:01.150813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e7b0a09-122f-406d-b006-0efaef4ceccd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:01.151296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e7b0a09-122f-406d-b006-0efaef4ceccd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:01.151742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e7b0a09-122f-406d-b006-0efaef4ceccd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:01.152435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e7b0a09-122f-406d-b006-0efaef4ceccd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:01.152892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e7b0a09-122f-406d-b006-0efaef4ceccd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:01.153334 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e7b0a09-122f-406d-b006-0efaef4ceccd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:01.219029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1e7b0a09-122f-406d-b006-0efaef4ceccd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:01.227626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1e7b0a09-122f-406d-b006-0efaef4ceccd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.088352 Oct 28 20:27:01.228310 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1393/2781] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:01 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:02.250537 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-04396b7e-a8e9-4966-86b9-e6af35769c1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:02.251160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-04396b7e-a8e9-4966-86b9-e6af35769c1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:02.257577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04396b7e-a8e9-4966-86b9-e6af35769c1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:02.258063 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04396b7e-a8e9-4966-86b9-e6af35769c1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:02.259004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04396b7e-a8e9-4966-86b9-e6af35769c1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:02.259853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04396b7e-a8e9-4966-86b9-e6af35769c1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:02.260317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04396b7e-a8e9-4966-86b9-e6af35769c1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:02.260748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04396b7e-a8e9-4966-86b9-e6af35769c1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:02.322750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-04396b7e-a8e9-4966-86b9-e6af35769c1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:02.330974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-04396b7e-a8e9-4966-86b9-e6af35769c1c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084361 Oct 28 20:27:02.331541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1389/2782] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:02 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:03.356009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-83cf5413-bcc6-40df-8473-ac448390b1e7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:03.454341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-83cf5413-bcc6-40df-8473-ac448390b1e7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:03.454341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83cf5413-bcc6-40df-8473-ac448390b1e7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:03.454341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83cf5413-bcc6-40df-8473-ac448390b1e7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:03.454341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83cf5413-bcc6-40df-8473-ac448390b1e7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:03.456274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83cf5413-bcc6-40df-8473-ac448390b1e7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:03.456274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83cf5413-bcc6-40df-8473-ac448390b1e7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:03.456274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83cf5413-bcc6-40df-8473-ac448390b1e7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:03.457031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-83cf5413-bcc6-40df-8473-ac448390b1e7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:03.457031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-83cf5413-bcc6-40df-8473-ac448390b1e7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.091891 Oct 28 20:27:03.457031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1394/2783] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:03 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:04.467069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7b3196d-b207-42b5-8678-2c4c353718a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:04.467687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7b3196d-b207-42b5-8678-2c4c353718a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:04.474437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7b3196d-b207-42b5-8678-2c4c353718a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:04.474932 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7b3196d-b207-42b5-8678-2c4c353718a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:04.475366 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7b3196d-b207-42b5-8678-2c4c353718a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:04.476046 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7b3196d-b207-42b5-8678-2c4c353718a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:04.476500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7b3196d-b207-42b5-8678-2c4c353718a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:04.476925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7b3196d-b207-42b5-8678-2c4c353718a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:04.537048 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7b3196d-b207-42b5-8678-2c4c353718a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:04.545438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7b3196d-b207-42b5-8678-2c4c353718a8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082201 Oct 28 20:27:04.546007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1390/2784] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:04 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:05.568427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c569114b-9616-4031-a47a-740796b0eaa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:05.569101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c569114b-9616-4031-a47a-740796b0eaa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:05.575975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c569114b-9616-4031-a47a-740796b0eaa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:05.576452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c569114b-9616-4031-a47a-740796b0eaa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:05.576884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c569114b-9616-4031-a47a-740796b0eaa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:05.577595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c569114b-9616-4031-a47a-740796b0eaa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:05.578048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c569114b-9616-4031-a47a-740796b0eaa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:05.578471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c569114b-9616-4031-a47a-740796b0eaa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:05.642104 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c569114b-9616-4031-a47a-740796b0eaa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:05.650792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c569114b-9616-4031-a47a-740796b0eaa1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086553 Oct 28 20:27:05.651352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1395/2785] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:05 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:27:06.674505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-49fd05f8-d036-45dd-aaf8-03dd8492591d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:06.675129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-49fd05f8-d036-45dd-aaf8-03dd8492591d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:06.683109 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49fd05f8-d036-45dd-aaf8-03dd8492591d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:06.683964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49fd05f8-d036-45dd-aaf8-03dd8492591d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:06.684739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49fd05f8-d036-45dd-aaf8-03dd8492591d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:06.685823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49fd05f8-d036-45dd-aaf8-03dd8492591d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:06.686646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49fd05f8-d036-45dd-aaf8-03dd8492591d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:06.687433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49fd05f8-d036-45dd-aaf8-03dd8492591d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:06.749880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-49fd05f8-d036-45dd-aaf8-03dd8492591d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:06.758181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-49fd05f8-d036-45dd-aaf8-03dd8492591d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087564 Oct 28 20:27:06.758862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1391/2786] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:06 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:07.781583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-90e4cc37-5a3c-4b94-9136-d43a30d43157 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:07.782206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-90e4cc37-5a3c-4b94-9136-d43a30d43157 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:07.788661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90e4cc37-5a3c-4b94-9136-d43a30d43157 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:07.789149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90e4cc37-5a3c-4b94-9136-d43a30d43157 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:07.790269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90e4cc37-5a3c-4b94-9136-d43a30d43157 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:07.790988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90e4cc37-5a3c-4b94-9136-d43a30d43157 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:07.791446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90e4cc37-5a3c-4b94-9136-d43a30d43157 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:07.791869 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90e4cc37-5a3c-4b94-9136-d43a30d43157 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:07.851885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-90e4cc37-5a3c-4b94-9136-d43a30d43157 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:07.860760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-90e4cc37-5a3c-4b94-9136-d43a30d43157 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083225 Oct 28 20:27:07.861361 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1396/2787] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:07 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:08.883653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-19fd587c-da4c-4a6e-8aaa-763073ad4a3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:08.884273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-19fd587c-da4c-4a6e-8aaa-763073ad4a3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:08.890913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19fd587c-da4c-4a6e-8aaa-763073ad4a3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:08.891405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19fd587c-da4c-4a6e-8aaa-763073ad4a3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:08.891843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19fd587c-da4c-4a6e-8aaa-763073ad4a3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:08.892534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19fd587c-da4c-4a6e-8aaa-763073ad4a3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:08.892992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19fd587c-da4c-4a6e-8aaa-763073ad4a3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:08.893454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19fd587c-da4c-4a6e-8aaa-763073ad4a3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:08.955998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-19fd587c-da4c-4a6e-8aaa-763073ad4a3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:08.964319 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-19fd587c-da4c-4a6e-8aaa-763073ad4a3f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084603 Oct 28 20:27:08.964887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1392/2788] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:08 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:09.988107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6557e518-e4cf-460f-a3fc-5c7a6a20f261 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:09.988728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6557e518-e4cf-460f-a3fc-5c7a6a20f261 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:09.995739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6557e518-e4cf-460f-a3fc-5c7a6a20f261 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:09.996224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6557e518-e4cf-460f-a3fc-5c7a6a20f261 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:09.996665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6557e518-e4cf-460f-a3fc-5c7a6a20f261 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:09.997384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6557e518-e4cf-460f-a3fc-5c7a6a20f261 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:09.997843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6557e518-e4cf-460f-a3fc-5c7a6a20f261 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:09.998267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6557e518-e4cf-460f-a3fc-5c7a6a20f261 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:10.061686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6557e518-e4cf-460f-a3fc-5c7a6a20f261 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:10.069800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6557e518-e4cf-460f-a3fc-5c7a6a20f261 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085628 Oct 28 20:27:10.070359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1397/2789] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:09 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:11.092643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-39ec22a8-a1bd-4aab-b738-76f7b15c6c4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:11.093257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-39ec22a8-a1bd-4aab-b738-76f7b15c6c4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:11.100015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39ec22a8-a1bd-4aab-b738-76f7b15c6c4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:11.100498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39ec22a8-a1bd-4aab-b738-76f7b15c6c4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:11.100936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39ec22a8-a1bd-4aab-b738-76f7b15c6c4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:11.101648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39ec22a8-a1bd-4aab-b738-76f7b15c6c4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:11.102615 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39ec22a8-a1bd-4aab-b738-76f7b15c6c4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:11.103237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39ec22a8-a1bd-4aab-b738-76f7b15c6c4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:11.165872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-39ec22a8-a1bd-4aab-b738-76f7b15c6c4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:11.174053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-39ec22a8-a1bd-4aab-b738-76f7b15c6c4a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085292 Oct 28 20:27:11.174611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1393/2790] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:11 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:12.196687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e5ca6625-a4e8-4811-ab08-9100cdd8ed8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:12.197306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e5ca6625-a4e8-4811-ab08-9100cdd8ed8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:12.203892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5ca6625-a4e8-4811-ab08-9100cdd8ed8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:12.204358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5ca6625-a4e8-4811-ab08-9100cdd8ed8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:12.204786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5ca6625-a4e8-4811-ab08-9100cdd8ed8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:12.205480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5ca6625-a4e8-4811-ab08-9100cdd8ed8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:12.205925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5ca6625-a4e8-4811-ab08-9100cdd8ed8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:12.206347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5ca6625-a4e8-4811-ab08-9100cdd8ed8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:12.270881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e5ca6625-a4e8-4811-ab08-9100cdd8ed8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:12.279146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e5ca6625-a4e8-4811-ab08-9100cdd8ed8e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086891 Oct 28 20:27:12.279708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1398/2791] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:12 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:13.302351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a392f336-05cb-4e6f-beb3-81eb39c7f1a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:13.302895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a392f336-05cb-4e6f-beb3-81eb39c7f1a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:13.309234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a392f336-05cb-4e6f-beb3-81eb39c7f1a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:13.309750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a392f336-05cb-4e6f-beb3-81eb39c7f1a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:13.310197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a392f336-05cb-4e6f-beb3-81eb39c7f1a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:13.310905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a392f336-05cb-4e6f-beb3-81eb39c7f1a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:13.311337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a392f336-05cb-4e6f-beb3-81eb39c7f1a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:13.311759 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a392f336-05cb-4e6f-beb3-81eb39c7f1a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:13.373439 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a392f336-05cb-4e6f-beb3-81eb39c7f1a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:13.381594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a392f336-05cb-4e6f-beb3-81eb39c7f1a2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083190 Oct 28 20:27:13.382160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1394/2792] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:13 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:14.406240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0d43928d-1097-4785-8d2f-d37e6482dab1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:14.406813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0d43928d-1097-4785-8d2f-d37e6482dab1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:14.413158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d43928d-1097-4785-8d2f-d37e6482dab1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:14.413678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d43928d-1097-4785-8d2f-d37e6482dab1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:14.414126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d43928d-1097-4785-8d2f-d37e6482dab1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:14.414808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d43928d-1097-4785-8d2f-d37e6482dab1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:14.415264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d43928d-1097-4785-8d2f-d37e6482dab1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:14.415687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d43928d-1097-4785-8d2f-d37e6482dab1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:14.418236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=84 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:14.480017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0d43928d-1097-4785-8d2f-d37e6482dab1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:14.488099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0d43928d-1097-4785-8d2f-d37e6482dab1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085799 Oct 28 20:27:14.488669 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1399/2793] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:14 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:15.512147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7ea45b78-ff2a-4fd2-a1c4-3a9bdc7719b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:15.512782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7ea45b78-ff2a-4fd2-a1c4-3a9bdc7719b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:15.515079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=28 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:15.519751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ea45b78-ff2a-4fd2-a1c4-3a9bdc7719b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:15.522855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ea45b78-ff2a-4fd2-a1c4-3a9bdc7719b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:15.522855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ea45b78-ff2a-4fd2-a1c4-3a9bdc7719b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:15.522855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ea45b78-ff2a-4fd2-a1c4-3a9bdc7719b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:15.522855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ea45b78-ff2a-4fd2-a1c4-3a9bdc7719b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:15.523333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ea45b78-ff2a-4fd2-a1c4-3a9bdc7719b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:15.584388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7ea45b78-ff2a-4fd2-a1c4-3a9bdc7719b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:15.593527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7ea45b78-ff2a-4fd2-a1c4-3a9bdc7719b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085204 Oct 28 20:27:15.594139 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1395/2794] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:15 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:16.618920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9202579d-0e9f-4194-a6f5-985f1aaefa00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:16.619538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9202579d-0e9f-4194-a6f5-985f1aaefa00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:16.621518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=28 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:16.626194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9202579d-0e9f-4194-a6f5-985f1aaefa00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:16.626748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9202579d-0e9f-4194-a6f5-985f1aaefa00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:16.627209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9202579d-0e9f-4194-a6f5-985f1aaefa00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:16.627897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9202579d-0e9f-4194-a6f5-985f1aaefa00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:16.628350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9202579d-0e9f-4194-a6f5-985f1aaefa00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:16.628775 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9202579d-0e9f-4194-a6f5-985f1aaefa00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:16.690360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9202579d-0e9f-4194-a6f5-985f1aaefa00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:16.699140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9202579d-0e9f-4194-a6f5-985f1aaefa00 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084616 Oct 28 20:27:16.699704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1400/2795] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:16 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:27:17.724957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d56d1287-6367-4afc-89dc-64d104e09ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:17.725588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d56d1287-6367-4afc-89dc-64d104e09ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:17.732523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56d1287-6367-4afc-89dc-64d104e09ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:17.732995 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56d1287-6367-4afc-89dc-64d104e09ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:17.733505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56d1287-6367-4afc-89dc-64d104e09ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:17.736820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56d1287-6367-4afc-89dc-64d104e09ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:17.736820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56d1287-6367-4afc-89dc-64d104e09ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:17.736820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d56d1287-6367-4afc-89dc-64d104e09ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:17.796509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d56d1287-6367-4afc-89dc-64d104e09ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:17.804463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d56d1287-6367-4afc-89dc-64d104e09ca8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083458 Oct 28 20:27:17.805225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1396/2796] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:17 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:18.827866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-17fd2d18-7fb7-4feb-ae75-9b7ce2c96ddd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:18.828510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-17fd2d18-7fb7-4feb-ae75-9b7ce2c96ddd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:18.835233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17fd2d18-7fb7-4feb-ae75-9b7ce2c96ddd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:18.835720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17fd2d18-7fb7-4feb-ae75-9b7ce2c96ddd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:18.836162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17fd2d18-7fb7-4feb-ae75-9b7ce2c96ddd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:18.836909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17fd2d18-7fb7-4feb-ae75-9b7ce2c96ddd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:18.837643 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17fd2d18-7fb7-4feb-ae75-9b7ce2c96ddd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:18.838199 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17fd2d18-7fb7-4feb-ae75-9b7ce2c96ddd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:18.903666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-17fd2d18-7fb7-4feb-ae75-9b7ce2c96ddd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:18.911841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-17fd2d18-7fb7-4feb-ae75-9b7ce2c96ddd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087977 Oct 28 20:27:18.912408 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1401/2797] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:18 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:27:19.935592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0acd61b8-3086-4548-9e38-d7f56bd7b399 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:19.936158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0acd61b8-3086-4548-9e38-d7f56bd7b399 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:19.938550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:27:19.938698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:27:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 (ip 10.222.0.66) !!! Oct 28 20:27:19.945142 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0acd61b8-3086-4548-9e38-d7f56bd7b399 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:19.945645 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0acd61b8-3086-4548-9e38-d7f56bd7b399 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:19.946077 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0acd61b8-3086-4548-9e38-d7f56bd7b399 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:19.947565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0acd61b8-3086-4548-9e38-d7f56bd7b399 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:19.948017 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0acd61b8-3086-4548-9e38-d7f56bd7b399 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:19.948439 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0acd61b8-3086-4548-9e38-d7f56bd7b399 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:20.009767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0acd61b8-3086-4548-9e38-d7f56bd7b399 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:20.018108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0acd61b8-3086-4548-9e38-d7f56bd7b399 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086412 Oct 28 20:27:20.018682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1397/2798] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:19 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:21.040733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eb5824a2-bb80-4bb2-b0da-3a75053b1772 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:21.041371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eb5824a2-bb80-4bb2-b0da-3a75053b1772 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:21.047875 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb5824a2-bb80-4bb2-b0da-3a75053b1772 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:21.048351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb5824a2-bb80-4bb2-b0da-3a75053b1772 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:21.048783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb5824a2-bb80-4bb2-b0da-3a75053b1772 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:21.049492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb5824a2-bb80-4bb2-b0da-3a75053b1772 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:21.049944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb5824a2-bb80-4bb2-b0da-3a75053b1772 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:21.050367 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb5824a2-bb80-4bb2-b0da-3a75053b1772 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:21.111917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-eb5824a2-bb80-4bb2-b0da-3a75053b1772 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:21.120124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eb5824a2-bb80-4bb2-b0da-3a75053b1772 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083264 Oct 28 20:27:21.120688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1402/2799] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:21 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:22.142726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-235cc671-fa95-4b0a-84b7-0418bb757678 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:22.143383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-235cc671-fa95-4b0a-84b7-0418bb757678 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:22.150352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235cc671-fa95-4b0a-84b7-0418bb757678 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:22.150827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235cc671-fa95-4b0a-84b7-0418bb757678 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:22.151259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235cc671-fa95-4b0a-84b7-0418bb757678 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:22.151947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235cc671-fa95-4b0a-84b7-0418bb757678 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:22.152404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235cc671-fa95-4b0a-84b7-0418bb757678 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:22.152823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235cc671-fa95-4b0a-84b7-0418bb757678 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:22.215589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-235cc671-fa95-4b0a-84b7-0418bb757678 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:22.223740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-235cc671-fa95-4b0a-84b7-0418bb757678 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084911 Oct 28 20:27:22.224296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1398/2800] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:22 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:23.247204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3e1a4389-495c-47ad-87bd-7818b35424c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:23.247811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3e1a4389-495c-47ad-87bd-7818b35424c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:23.255402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e1a4389-495c-47ad-87bd-7818b35424c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:23.255886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e1a4389-495c-47ad-87bd-7818b35424c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:23.256320 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e1a4389-495c-47ad-87bd-7818b35424c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:23.257011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e1a4389-495c-47ad-87bd-7818b35424c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:23.257499 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e1a4389-495c-47ad-87bd-7818b35424c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:23.257923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e1a4389-495c-47ad-87bd-7818b35424c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:23.304864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:27:23.305069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:27:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 (ip 10.222.0.66) !!! Oct 28 20:27:23.324147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3e1a4389-495c-47ad-87bd-7818b35424c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:23.332921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3e1a4389-495c-47ad-87bd-7818b35424c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.089515 Oct 28 20:27:23.333512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1403/2801] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:23 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:24.356550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ee4f225-f3b4-41d1-a193-5e5cf5714916 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:24.357089 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5ee4f225-f3b4-41d1-a193-5e5cf5714916 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:24.363456 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee4f225-f3b4-41d1-a193-5e5cf5714916 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:24.363941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee4f225-f3b4-41d1-a193-5e5cf5714916 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:24.364378 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee4f225-f3b4-41d1-a193-5e5cf5714916 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:24.365060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee4f225-f3b4-41d1-a193-5e5cf5714916 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:24.365540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee4f225-f3b4-41d1-a193-5e5cf5714916 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:24.365965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee4f225-f3b4-41d1-a193-5e5cf5714916 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:24.425689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5ee4f225-f3b4-41d1-a193-5e5cf5714916 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:24.433778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5ee4f225-f3b4-41d1-a193-5e5cf5714916 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.081683 Oct 28 20:27:24.434342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1399/2802] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:24 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:25.455914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b0f30e29-8508-4e05-9db8-c241c39114ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:25.456540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b0f30e29-8508-4e05-9db8-c241c39114ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:25.463094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0f30e29-8508-4e05-9db8-c241c39114ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:25.463585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0f30e29-8508-4e05-9db8-c241c39114ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:25.464027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0f30e29-8508-4e05-9db8-c241c39114ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:25.464717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0f30e29-8508-4e05-9db8-c241c39114ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:25.465172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0f30e29-8508-4e05-9db8-c241c39114ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:25.465623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0f30e29-8508-4e05-9db8-c241c39114ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:25.526333 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b0f30e29-8508-4e05-9db8-c241c39114ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:25.534275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b0f30e29-8508-4e05-9db8-c241c39114ec tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082173 Oct 28 20:27:25.534865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1404/2803] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:25 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:26.557287 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c6fd138a-63fe-48c2-b7ff-4ac66c3c0521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:26.557919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c6fd138a-63fe-48c2-b7ff-4ac66c3c0521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:26.564245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6fd138a-63fe-48c2-b7ff-4ac66c3c0521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:26.564727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6fd138a-63fe-48c2-b7ff-4ac66c3c0521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:26.565172 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6fd138a-63fe-48c2-b7ff-4ac66c3c0521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:26.565876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6fd138a-63fe-48c2-b7ff-4ac66c3c0521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:26.566331 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6fd138a-63fe-48c2-b7ff-4ac66c3c0521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:26.566757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6fd138a-63fe-48c2-b7ff-4ac66c3c0521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:26.627632 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c6fd138a-63fe-48c2-b7ff-4ac66c3c0521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:26.635707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c6fd138a-63fe-48c2-b7ff-4ac66c3c0521 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082425 Oct 28 20:27:26.636277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1400/2804] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:26 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:27.659514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f91e49e9-c6b1-4555-9940-e4c26314b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:27.660164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f91e49e9-c6b1-4555-9940-e4c26314b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:27.667009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f91e49e9-c6b1-4555-9940-e4c26314b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:27.667492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f91e49e9-c6b1-4555-9940-e4c26314b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:27.667931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f91e49e9-c6b1-4555-9940-e4c26314b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:27.668618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f91e49e9-c6b1-4555-9940-e4c26314b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:27.669074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f91e49e9-c6b1-4555-9940-e4c26314b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:27.669531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f91e49e9-c6b1-4555-9940-e4c26314b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:27.735940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f91e49e9-c6b1-4555-9940-e4c26314b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:27.744415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f91e49e9-c6b1-4555-9940-e4c26314b2c6 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.088890 Oct 28 20:27:27.744980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1405/2805] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:27 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:27:28.766675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-62a104c5-7d78-4a3b-9ac8-5358dcb46a26 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:28.767280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-62a104c5-7d78-4a3b-9ac8-5358dcb46a26 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:28.773641 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62a104c5-7d78-4a3b-9ac8-5358dcb46a26 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:28.774628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62a104c5-7d78-4a3b-9ac8-5358dcb46a26 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:28.775271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62a104c5-7d78-4a3b-9ac8-5358dcb46a26 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:28.775738 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62a104c5-7d78-4a3b-9ac8-5358dcb46a26 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:28.776182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62a104c5-7d78-4a3b-9ac8-5358dcb46a26 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:28.776602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62a104c5-7d78-4a3b-9ac8-5358dcb46a26 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:28.841760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-62a104c5-7d78-4a3b-9ac8-5358dcb46a26 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:28.850119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-62a104c5-7d78-4a3b-9ac8-5358dcb46a26 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087281 Oct 28 20:27:28.850668 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1401/2806] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:28 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:29.874055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48bd6c7b-3a42-48bf-8f5c-793242b4a422 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:29.874586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48bd6c7b-3a42-48bf-8f5c-793242b4a422 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:29.880914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48bd6c7b-3a42-48bf-8f5c-793242b4a422 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:29.881412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48bd6c7b-3a42-48bf-8f5c-793242b4a422 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:29.881842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48bd6c7b-3a42-48bf-8f5c-793242b4a422 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:29.882512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48bd6c7b-3a42-48bf-8f5c-793242b4a422 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:29.882951 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48bd6c7b-3a42-48bf-8f5c-793242b4a422 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:29.883364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48bd6c7b-3a42-48bf-8f5c-793242b4a422 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:29.943206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-48bd6c7b-3a42-48bf-8f5c-793242b4a422 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:29.951198 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48bd6c7b-3a42-48bf-8f5c-793242b4a422 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.081114 Oct 28 20:27:29.951752 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1406/2807] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:29 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:27:30.974522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-147b8d89-7929-4b50-8b45-c16c29d10c5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:30.975136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-147b8d89-7929-4b50-8b45-c16c29d10c5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:30.982358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147b8d89-7929-4b50-8b45-c16c29d10c5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:30.982847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147b8d89-7929-4b50-8b45-c16c29d10c5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:30.983280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147b8d89-7929-4b50-8b45-c16c29d10c5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:30.983962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147b8d89-7929-4b50-8b45-c16c29d10c5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:30.984415 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147b8d89-7929-4b50-8b45-c16c29d10c5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:30.984841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147b8d89-7929-4b50-8b45-c16c29d10c5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:30.987368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=84 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:31.046299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-147b8d89-7929-4b50-8b45-c16c29d10c5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:31.054294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-147b8d89-7929-4b50-8b45-c16c29d10c5b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083647 Oct 28 20:27:31.054861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1402/2808] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:30 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:32.077735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d27cb2f4-7d3e-4f6a-9964-731fa26409af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:32.078360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d27cb2f4-7d3e-4f6a-9964-731fa26409af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:32.084858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d27cb2f4-7d3e-4f6a-9964-731fa26409af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:32.085363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d27cb2f4-7d3e-4f6a-9964-731fa26409af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:32.085801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d27cb2f4-7d3e-4f6a-9964-731fa26409af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:32.086549 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d27cb2f4-7d3e-4f6a-9964-731fa26409af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:32.087086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d27cb2f4-7d3e-4f6a-9964-731fa26409af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:32.087507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d27cb2f4-7d3e-4f6a-9964-731fa26409af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:32.151956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d27cb2f4-7d3e-4f6a-9964-731fa26409af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:32.160040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d27cb2f4-7d3e-4f6a-9964-731fa26409af tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086311 Oct 28 20:27:32.160610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1407/2809] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:32 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:33.183996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ad78fca-48d8-4d0c-9217-1257a5b88e49 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:33.184613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ad78fca-48d8-4d0c-9217-1257a5b88e49 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:33.191097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ad78fca-48d8-4d0c-9217-1257a5b88e49 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:33.191583 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ad78fca-48d8-4d0c-9217-1257a5b88e49 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:33.192021 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ad78fca-48d8-4d0c-9217-1257a5b88e49 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:33.192707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ad78fca-48d8-4d0c-9217-1257a5b88e49 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:33.193163 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ad78fca-48d8-4d0c-9217-1257a5b88e49 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:33.193622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ad78fca-48d8-4d0c-9217-1257a5b88e49 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:33.255773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0ad78fca-48d8-4d0c-9217-1257a5b88e49 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:33.264039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ad78fca-48d8-4d0c-9217-1257a5b88e49 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084749 Oct 28 20:27:33.264628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1403/2810] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:33 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:34.287121 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-99f39b16-b711-4a06-9cee-3dcf1a04bab9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:34.287674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-99f39b16-b711-4a06-9cee-3dcf1a04bab9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:34.290321 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:27:34.290858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:27:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 (ip 10.222.0.66) !!! Oct 28 20:27:34.297497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99f39b16-b711-4a06-9cee-3dcf1a04bab9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:34.297981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99f39b16-b711-4a06-9cee-3dcf1a04bab9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:34.298422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99f39b16-b711-4a06-9cee-3dcf1a04bab9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:34.299111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99f39b16-b711-4a06-9cee-3dcf1a04bab9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:34.299567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99f39b16-b711-4a06-9cee-3dcf1a04bab9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:34.299991 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99f39b16-b711-4a06-9cee-3dcf1a04bab9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:34.363192 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-99f39b16-b711-4a06-9cee-3dcf1a04bab9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:34.371193 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-99f39b16-b711-4a06-9cee-3dcf1a04bab9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.088012 Oct 28 20:27:34.371749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1408/2811] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:34 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:35.394164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2864675d-64fd-45bd-a088-ed4948d1ce0b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:35.394705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2864675d-64fd-45bd-a088-ed4948d1ce0b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:35.396667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:27:35.396802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:27:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 (ip 10.222.0.66) !!! Oct 28 20:27:35.403989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2864675d-64fd-45bd-a088-ed4948d1ce0b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:35.404475 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2864675d-64fd-45bd-a088-ed4948d1ce0b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:35.404916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2864675d-64fd-45bd-a088-ed4948d1ce0b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:35.405650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2864675d-64fd-45bd-a088-ed4948d1ce0b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:35.406108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2864675d-64fd-45bd-a088-ed4948d1ce0b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:35.406535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2864675d-64fd-45bd-a088-ed4948d1ce0b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:35.467407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2864675d-64fd-45bd-a088-ed4948d1ce0b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:35.475865 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2864675d-64fd-45bd-a088-ed4948d1ce0b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085705 Oct 28 20:27:35.476431 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1404/2812] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:35 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:36.499145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f907e780-a63c-44cf-894a-82f48a1e5624 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:36.499750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f907e780-a63c-44cf-894a-82f48a1e5624 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:36.506141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f907e780-a63c-44cf-894a-82f48a1e5624 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:36.506621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f907e780-a63c-44cf-894a-82f48a1e5624 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:36.507058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f907e780-a63c-44cf-894a-82f48a1e5624 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:36.507743 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f907e780-a63c-44cf-894a-82f48a1e5624 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:36.508202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f907e780-a63c-44cf-894a-82f48a1e5624 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:36.508842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f907e780-a63c-44cf-894a-82f48a1e5624 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:36.571877 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f907e780-a63c-44cf-894a-82f48a1e5624 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:36.580052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f907e780-a63c-44cf-894a-82f48a1e5624 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084817 Oct 28 20:27:36.580615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1409/2813] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:36 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:37.603863 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dd531b9c-612a-4311-b191-5e6220b1e9ce tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:37.604468 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dd531b9c-612a-4311-b191-5e6220b1e9ce tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:37.610837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd531b9c-612a-4311-b191-5e6220b1e9ce tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:37.611312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd531b9c-612a-4311-b191-5e6220b1e9ce tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:37.611748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd531b9c-612a-4311-b191-5e6220b1e9ce tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:37.612420 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd531b9c-612a-4311-b191-5e6220b1e9ce tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:37.612867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd531b9c-612a-4311-b191-5e6220b1e9ce tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:37.613292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd531b9c-612a-4311-b191-5e6220b1e9ce tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:37.678469 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-dd531b9c-612a-4311-b191-5e6220b1e9ce tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:37.686959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dd531b9c-612a-4311-b191-5e6220b1e9ce tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.087036 Oct 28 20:27:37.687517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1405/2814] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:37 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:38.711012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-64e9c8d4-30a4-426d-9043-6e005806449a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:38.711679 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-64e9c8d4-30a4-426d-9043-6e005806449a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:38.718156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64e9c8d4-30a4-426d-9043-6e005806449a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:38.718631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64e9c8d4-30a4-426d-9043-6e005806449a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:38.719059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64e9c8d4-30a4-426d-9043-6e005806449a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:38.719888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64e9c8d4-30a4-426d-9043-6e005806449a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:38.720605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64e9c8d4-30a4-426d-9043-6e005806449a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:38.721024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64e9c8d4-30a4-426d-9043-6e005806449a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:38.791712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-64e9c8d4-30a4-426d-9043-6e005806449a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:38.791712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-64e9c8d4-30a4-426d-9043-6e005806449a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083905 Oct 28 20:27:38.791712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1410/2815] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:38 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:39.814880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-953486e2-1cc9-40b8-aaba-d14539b52336 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:39.815500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-953486e2-1cc9-40b8-aaba-d14539b52336 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:39.822758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-953486e2-1cc9-40b8-aaba-d14539b52336 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:39.823245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-953486e2-1cc9-40b8-aaba-d14539b52336 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:39.823689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-953486e2-1cc9-40b8-aaba-d14539b52336 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:39.824379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-953486e2-1cc9-40b8-aaba-d14539b52336 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:39.824838 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-953486e2-1cc9-40b8-aaba-d14539b52336 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:39.825268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-953486e2-1cc9-40b8-aaba-d14539b52336 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:39.886922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-953486e2-1cc9-40b8-aaba-d14539b52336 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:39.894880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-953486e2-1cc9-40b8-aaba-d14539b52336 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083855 Oct 28 20:27:39.895444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1406/2816] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:39 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:40.918649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7f8f1cb6-d824-495b-b8b3-0522d6c48009 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:40.919253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7f8f1cb6-d824-495b-b8b3-0522d6c48009 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:40.925761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f8f1cb6-d824-495b-b8b3-0522d6c48009 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:40.926243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f8f1cb6-d824-495b-b8b3-0522d6c48009 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:40.926684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f8f1cb6-d824-495b-b8b3-0522d6c48009 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:40.927371 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f8f1cb6-d824-495b-b8b3-0522d6c48009 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:40.927826 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f8f1cb6-d824-495b-b8b3-0522d6c48009 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:40.928251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f8f1cb6-d824-495b-b8b3-0522d6c48009 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:40.991435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7f8f1cb6-d824-495b-b8b3-0522d6c48009 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:40.999497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7f8f1cb6-d824-495b-b8b3-0522d6c48009 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.085279 Oct 28 20:27:41.000062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1411/2817] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:40 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:42.022888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-54a0a595-821c-458c-bd78-32056eabe936 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:42.023539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-54a0a595-821c-458c-bd78-32056eabe936 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:42.030094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54a0a595-821c-458c-bd78-32056eabe936 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:42.030579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54a0a595-821c-458c-bd78-32056eabe936 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:42.031016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54a0a595-821c-458c-bd78-32056eabe936 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:42.031718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54a0a595-821c-458c-bd78-32056eabe936 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:42.032152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54a0a595-821c-458c-bd78-32056eabe936 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:42.032575 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54a0a595-821c-458c-bd78-32056eabe936 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:42.093156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-54a0a595-821c-458c-bd78-32056eabe936 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:42.101565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-54a0a595-821c-458c-bd78-32056eabe936 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082542 Oct 28 20:27:42.102664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1407/2818] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:42 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:43.124634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91fe0798-1924-45e9-a95a-4b6cc4d64c0d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:43.125284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-91fe0798-1924-45e9-a95a-4b6cc4d64c0d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:43.131672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91fe0798-1924-45e9-a95a-4b6cc4d64c0d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:43.132152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91fe0798-1924-45e9-a95a-4b6cc4d64c0d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:43.132591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91fe0798-1924-45e9-a95a-4b6cc4d64c0d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:43.133278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91fe0798-1924-45e9-a95a-4b6cc4d64c0d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:43.133761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91fe0798-1924-45e9-a95a-4b6cc4d64c0d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:43.134194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91fe0798-1924-45e9-a95a-4b6cc4d64c0d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:43.196674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-91fe0798-1924-45e9-a95a-4b6cc4d64c0d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:43.204847 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-91fe0798-1924-45e9-a95a-4b6cc4d64c0d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084121 Oct 28 20:27:43.205432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1412/2819] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:43 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:44.229011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5b17594e-eead-43ec-8d04-d88ef3668a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:44.229650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5b17594e-eead-43ec-8d04-d88ef3668a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:44.236345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b17594e-eead-43ec-8d04-d88ef3668a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:44.236828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b17594e-eead-43ec-8d04-d88ef3668a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:44.237267 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b17594e-eead-43ec-8d04-d88ef3668a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:44.238011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b17594e-eead-43ec-8d04-d88ef3668a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:44.238459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b17594e-eead-43ec-8d04-d88ef3668a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:44.238878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b17594e-eead-43ec-8d04-d88ef3668a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:44.299405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5b17594e-eead-43ec-8d04-d88ef3668a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:44.308072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5b17594e-eead-43ec-8d04-d88ef3668a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.083455 Oct 28 20:27:44.308631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1408/2820] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:44 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:45.329538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f19a276b-36fe-42f6-b242-b803e9e6ebb0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:45.330261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f19a276b-36fe-42f6-b242-b803e9e6ebb0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:45.337111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f19a276b-36fe-42f6-b242-b803e9e6ebb0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:45.337896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f19a276b-36fe-42f6-b242-b803e9e6ebb0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:45.338333 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f19a276b-36fe-42f6-b242-b803e9e6ebb0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:45.339026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f19a276b-36fe-42f6-b242-b803e9e6ebb0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:45.339480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f19a276b-36fe-42f6-b242-b803e9e6ebb0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:45.339903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f19a276b-36fe-42f6-b242-b803e9e6ebb0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:45.342518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=84 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:45.405817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f19a276b-36fe-42f6-b242-b803e9e6ebb0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:45.415455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f19a276b-36fe-42f6-b242-b803e9e6ebb0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.088963 Oct 28 20:27:45.416034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1413/2821] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:45 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:46.438513 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c285ebaf-4370-41ea-b6c3-89e0a95fa767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:46.439125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c285ebaf-4370-41ea-b6c3-89e0a95fa767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:46.441515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:27:46.441666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:27:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 (ip 10.222.0.66) !!! Oct 28 20:27:46.442526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=28 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:46.448559 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c285ebaf-4370-41ea-b6c3-89e0a95fa767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:46.449040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c285ebaf-4370-41ea-b6c3-89e0a95fa767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:46.449499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c285ebaf-4370-41ea-b6c3-89e0a95fa767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:46.450182 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c285ebaf-4370-41ea-b6c3-89e0a95fa767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:46.450711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c285ebaf-4370-41ea-b6c3-89e0a95fa767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:46.451071 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c285ebaf-4370-41ea-b6c3-89e0a95fa767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:46.513269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c285ebaf-4370-41ea-b6c3-89e0a95fa767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:46.521394 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c285ebaf-4370-41ea-b6c3-89e0a95fa767 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.086641 Oct 28 20:27:46.521954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1409/2822] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:46 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:47.545020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-12257f64-c3ab-49de-8969-53a5134ed397 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:47.545670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-12257f64-c3ab-49de-8969-53a5134ed397 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:47.547639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=28 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:47.552263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12257f64-c3ab-49de-8969-53a5134ed397 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:47.552748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12257f64-c3ab-49de-8969-53a5134ed397 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:47.553185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12257f64-c3ab-49de-8969-53a5134ed397 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:47.553906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12257f64-c3ab-49de-8969-53a5134ed397 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:47.554365 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12257f64-c3ab-49de-8969-53a5134ed397 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:47.560912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12257f64-c3ab-49de-8969-53a5134ed397 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:47.617420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-12257f64-c3ab-49de-8969-53a5134ed397 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:47.626050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-12257f64-c3ab-49de-8969-53a5134ed397 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.084897 Oct 28 20:27:47.626616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1414/2823] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:47 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:48.649962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5a2603f5-e4c0-4e1a-9310-25d2ad8d05be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:48.650587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5a2603f5-e4c0-4e1a-9310-25d2ad8d05be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:48.657042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a2603f5-e4c0-4e1a-9310-25d2ad8d05be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:48.657572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a2603f5-e4c0-4e1a-9310-25d2ad8d05be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:48.658014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a2603f5-e4c0-4e1a-9310-25d2ad8d05be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:48.658711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a2603f5-e4c0-4e1a-9310-25d2ad8d05be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:48.659169 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a2603f5-e4c0-4e1a-9310-25d2ad8d05be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:48.659630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a2603f5-e4c0-4e1a-9310-25d2ad8d05be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:48.719708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5a2603f5-e4c0-4e1a-9310-25d2ad8d05be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:48.728284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5a2603f5-e4c0-4e1a-9310-25d2ad8d05be tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 200 len: 1372 microversion: 2.1 time: 0.082892 Oct 28 20:27:48.728848 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1410/2824] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:48 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:48.750749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6e3fc6f3-9cfe-4148-8f39-d79ba2fe94d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '.version_select at 0x7f1f50791160>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:48.863814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6e3fc6f3-9cfe-4148-8f39-d79ba2fe94d3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337679790" status: 202 len: 0 microversion: 2.1 time: 0.116693 Oct 28 20:27:48.864402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1415/2825] 10.222.0.66 () {58 vars in 1221 bytes} [Fri Oct 28 20:27:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337679790 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:27:49.776901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2d6f1b9a-863f-43fc-9879-74475a98aa8a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Action: 'create', calling method: .version_select at 0x7f1f4ce21700>, body: {"keypair": {"name": "tempest-keypair-884029290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEHbHXF0mWBnZ0l/uPlplhOzwEzeQsD8kN8YbwFPPRlrHgK3O4FJ6wPRkj9Dm7s8WXmDPci77SA3VJm2OaVRtmsnHRg+KTyuSok/apBX+c0Z3yjMkn1UHh6aSPKd/0coA=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:27:49.793395 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-2d6f1b9a-863f-43fc-9879-74475a98aa8a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Getting quotas for project 940ce72c42534c5196dfb909cc2a8d54. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:27:49.797700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-2d6f1b9a-863f-43fc-9879-74475a98aa8a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Getting quotas for user 724baaa4aa834e609fe4f513f9fc0b4b and project 940ce72c42534c5196dfb909cc2a8d54. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:27:49.925804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2d6f1b9a-863f-43fc-9879-74475a98aa8a tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.153639 Oct 28 20:27:49.926414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1411/2826] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Oct 28 20:27:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:27:52.055675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1145991584", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9279e057-17ab-422f-8ee0-b121068c9ee3"}], "security_groups": [{"name": "tempest-securitygroup--773404746"}], "key_name": "tempest-keypair-884029290", "user_data": "}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:27:52.158722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] validate_networks() for [('9279e057-17ab-422f-8ee0-b121068c9ee3', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:27:52.585837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:27:52.586261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:27:52.586758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:27:52.587163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:27:52.587571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:27:52.597115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:52.597623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:52.598057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:52.598777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:52.599228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:52.599675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:52.616385 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Getting quotas for project 940ce72c42534c5196dfb909cc2a8d54. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:27:52.620339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Getting quotas for user 724baaa4aa834e609fe4f513f9fc0b4b and project 940ce72c42534c5196dfb909cc2a8d54. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:27:52.631117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:27:52.633381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:27:52.763223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-21f0e53d-be76-45b8-a914-49368719bb4e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.712310 Oct 28 20:27:52.763936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1416/2827] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:27:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:27:52.774880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7ff47644-4899-432a-93e8-447c342a0435 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:52.775494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7ff47644-4899-432a-93e8-447c342a0435 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:52.834217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7ff47644-4899-432a-93e8-447c342a0435 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:52.841464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7ff47644-4899-432a-93e8-447c342a0435 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 200 len: 1241 microversion: 2.1 time: 0.070375 Oct 28 20:27:52.842035 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1412/2828] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:52 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:53.864049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-03060524-bd22-486c-869a-99f9bb5cfce8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:53.864669 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-03060524-bd22-486c-869a-99f9bb5cfce8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:53.871220 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03060524-bd22-486c-869a-99f9bb5cfce8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:53.873242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03060524-bd22-486c-869a-99f9bb5cfce8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:53.873242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03060524-bd22-486c-869a-99f9bb5cfce8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:53.873242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03060524-bd22-486c-869a-99f9bb5cfce8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:53.873242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03060524-bd22-486c-869a-99f9bb5cfce8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:53.873763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03060524-bd22-486c-869a-99f9bb5cfce8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:53.934573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-03060524-bd22-486c-869a-99f9bb5cfce8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:53.942283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-03060524-bd22-486c-869a-99f9bb5cfce8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 200 len: 1245 microversion: 2.1 time: 0.082549 Oct 28 20:27:53.942859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1417/2829] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:53 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:54.966111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3b7b73ae-fcba-418f-8fd2-3974e3fd4206 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:54.966726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3b7b73ae-fcba-418f-8fd2-3974e3fd4206 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:54.973169 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b7b73ae-fcba-418f-8fd2-3974e3fd4206 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:54.973700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b7b73ae-fcba-418f-8fd2-3974e3fd4206 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:54.974198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b7b73ae-fcba-418f-8fd2-3974e3fd4206 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:54.975096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b7b73ae-fcba-418f-8fd2-3974e3fd4206 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:54.975558 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b7b73ae-fcba-418f-8fd2-3974e3fd4206 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:54.975989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b7b73ae-fcba-418f-8fd2-3974e3fd4206 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:55.041474 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3b7b73ae-fcba-418f-8fd2-3974e3fd4206 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:55.049463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3b7b73ae-fcba-418f-8fd2-3974e3fd4206 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 200 len: 1301 microversion: 2.1 time: 0.087590 Oct 28 20:27:55.050094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1413/2830] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:54 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 1301 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:56.073970 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aed2d2f2-a439-4c23-822c-77db92564c3b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:56.074587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aed2d2f2-a439-4c23-822c-77db92564c3b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:56.081678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aed2d2f2-a439-4c23-822c-77db92564c3b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:56.082324 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aed2d2f2-a439-4c23-822c-77db92564c3b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:56.082768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aed2d2f2-a439-4c23-822c-77db92564c3b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:56.083466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aed2d2f2-a439-4c23-822c-77db92564c3b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:56.083926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aed2d2f2-a439-4c23-822c-77db92564c3b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:56.084351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aed2d2f2-a439-4c23-822c-77db92564c3b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:56.214476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-aed2d2f2-a439-4c23-822c-77db92564c3b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:56.223243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aed2d2f2-a439-4c23-822c-77db92564c3b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 200 len: 1366 microversion: 2.1 time: 0.153685 Oct 28 20:27:56.223825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1418/2831] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:56 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:57.041101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-0d556607-9cd8-4655-a1a7-fe9bcb05f34f req-193f961e-f982-423b-a36b-fe304b480929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fca705e-f209-4a12-8462-5cb6a76b8976", "tag": "409a1018-b50b-4b3c-8392-24957ee7c660"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:27:57.050770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0d556607-9cd8-4655-a1a7-fe9bcb05f34f req-193f961e-f982-423b-a36b-fe304b480929 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:57.051248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0d556607-9cd8-4655-a1a7-fe9bcb05f34f req-193f961e-f982-423b-a36b-fe304b480929 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:57.051680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0d556607-9cd8-4655-a1a7-fe9bcb05f34f req-193f961e-f982-423b-a36b-fe304b480929 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:57.063552 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0d556607-9cd8-4655-a1a7-fe9bcb05f34f req-193f961e-f982-423b-a36b-fe304b480929 service nova] Creating event network-changed:409a1018-b50b-4b3c-8392-24957ee7c660 for instance 7fca705e-f209-4a12-8462-5cb6a76b8976 on hv-cinder-86236 Oct 28 20:27:57.069410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-0d556607-9cd8-4655-a1a7-fe9bcb05f34f req-193f961e-f982-423b-a36b-fe304b480929 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086487 Oct 28 20:27:57.070021 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1414/2832] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:27:57.246866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ea0303d-8190-4cc6-ab87-460191cd0d77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:57.247415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1ea0303d-8190-4cc6-ab87-460191cd0d77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:57.253743 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ea0303d-8190-4cc6-ab87-460191cd0d77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:57.254217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ea0303d-8190-4cc6-ab87-460191cd0d77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:57.254643 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ea0303d-8190-4cc6-ab87-460191cd0d77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:57.255331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ea0303d-8190-4cc6-ab87-460191cd0d77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:57.255771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ea0303d-8190-4cc6-ab87-460191cd0d77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:57.256182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ea0303d-8190-4cc6-ab87-460191cd0d77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:57.384587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ea0303d-8190-4cc6-ab87-460191cd0d77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:57.392692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1ea0303d-8190-4cc6-ab87-460191cd0d77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 200 len: 1366 microversion: 2.1 time: 0.149820 Oct 28 20:27:57.393563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1419/2833] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:57 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:58.417002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e1b30df1-632a-45d5-95c3-26a4583f9f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:58.417732 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e1b30df1-632a-45d5-95c3-26a4583f9f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:58.425829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1b30df1-632a-45d5-95c3-26a4583f9f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:58.426314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1b30df1-632a-45d5-95c3-26a4583f9f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:58.426750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1b30df1-632a-45d5-95c3-26a4583f9f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:58.427443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1b30df1-632a-45d5-95c3-26a4583f9f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:58.428080 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1b30df1-632a-45d5-95c3-26a4583f9f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:58.428683 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1b30df1-632a-45d5-95c3-26a4583f9f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:58.578296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e1b30df1-632a-45d5-95c3-26a4583f9f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:58.586586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e1b30df1-632a-45d5-95c3-26a4583f9f77 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 200 len: 1366 microversion: 2.1 time: 0.174334 Oct 28 20:27:58.587279 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1415/2834] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:58 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:59.613101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c41cc2cc-5b30-43e4-948d-0c8622c4a9bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:59.614270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c41cc2cc-5b30-43e4-948d-0c8622c4a9bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:59.616133 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:27:59.616282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:27:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 (ip 10.222.0.66) !!! Oct 28 20:27:59.621824 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c41cc2cc-5b30-43e4-948d-0c8622c4a9bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:59.622308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c41cc2cc-5b30-43e4-948d-0c8622c4a9bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:59.622746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c41cc2cc-5b30-43e4-948d-0c8622c4a9bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:59.624106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c41cc2cc-5b30-43e4-948d-0c8622c4a9bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:59.624556 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c41cc2cc-5b30-43e4-948d-0c8622c4a9bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:59.624983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c41cc2cc-5b30-43e4-948d-0c8622c4a9bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:59.757226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c41cc2cc-5b30-43e4-948d-0c8622c4a9bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:59.764906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c41cc2cc-5b30-43e4-948d-0c8622c4a9bd tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 200 len: 1366 microversion: 2.1 time: 0.155711 Oct 28 20:27:59.765497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1420/2835] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:59 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:00.788100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-41582ae4-08e0-47f9-b080-0627c9962b61 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:00.788658 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-41582ae4-08e0-47f9-b080-0627c9962b61 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:00.795481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41582ae4-08e0-47f9-b080-0627c9962b61 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:00.795960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41582ae4-08e0-47f9-b080-0627c9962b61 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:00.796402 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41582ae4-08e0-47f9-b080-0627c9962b61 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:00.797084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41582ae4-08e0-47f9-b080-0627c9962b61 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:00.797571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41582ae4-08e0-47f9-b080-0627c9962b61 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:00.797998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41582ae4-08e0-47f9-b080-0627c9962b61 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:00.926650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-41582ae4-08e0-47f9-b080-0627c9962b61 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:00.934197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-41582ae4-08e0-47f9-b080-0627c9962b61 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 200 len: 1366 microversion: 2.1 time: 0.150100 Oct 28 20:28:00.934755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1416/2836] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:00 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:01.961211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-38cc995d-0547-4447-83d8-13a229d36a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:01.961860 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-38cc995d-0547-4447-83d8-13a229d36a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:01.968941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38cc995d-0547-4447-83d8-13a229d36a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:01.969451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38cc995d-0547-4447-83d8-13a229d36a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:01.969888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38cc995d-0547-4447-83d8-13a229d36a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:01.970828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38cc995d-0547-4447-83d8-13a229d36a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:01.971283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38cc995d-0547-4447-83d8-13a229d36a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:01.971708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38cc995d-0547-4447-83d8-13a229d36a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:02.105085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-38cc995d-0547-4447-83d8-13a229d36a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:02.112802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-38cc995d-0547-4447-83d8-13a229d36a20 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 200 len: 1366 microversion: 2.1 time: 0.155560 Oct 28 20:28:02.113714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1421/2837] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:01 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:02.208328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1ba1d627-8e3e-45a8-b629-c27ec908ef4a req-850a8e10-80f9-493b-9ff0-18922571e6ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fca705e-f209-4a12-8462-5cb6a76b8976", "name": "network-vif-plugged", "status": "completed", "tag": "409a1018-b50b-4b3c-8392-24957ee7c660"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:28:02.218327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1ba1d627-8e3e-45a8-b629-c27ec908ef4a req-850a8e10-80f9-493b-9ff0-18922571e6ce service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:02.218806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1ba1d627-8e3e-45a8-b629-c27ec908ef4a req-850a8e10-80f9-493b-9ff0-18922571e6ce service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:02.219237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1ba1d627-8e3e-45a8-b629-c27ec908ef4a req-850a8e10-80f9-493b-9ff0-18922571e6ce service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:02.223286 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=74 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:28:02.230861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1ba1d627-8e3e-45a8-b629-c27ec908ef4a req-850a8e10-80f9-493b-9ff0-18922571e6ce service nova] Creating event network-vif-plugged:409a1018-b50b-4b3c-8392-24957ee7c660 for instance 7fca705e-f209-4a12-8462-5cb6a76b8976 on hv-cinder-86236 Oct 28 20:28:02.236654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-1ba1d627-8e3e-45a8-b629-c27ec908ef4a req-850a8e10-80f9-493b-9ff0-18922571e6ce service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098813 Oct 28 20:28:02.237434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1417/2838] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:28:03.136473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fa9f5630-603f-4ab9-ac10-599e62edf30e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:03.137094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fa9f5630-603f-4ab9-ac10-599e62edf30e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:03.138983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:28:03.139793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:28:03.144920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa9f5630-603f-4ab9-ac10-599e62edf30e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:03.145435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa9f5630-603f-4ab9-ac10-599e62edf30e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:03.145874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa9f5630-603f-4ab9-ac10-599e62edf30e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:03.146557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa9f5630-603f-4ab9-ac10-599e62edf30e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:03.147010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa9f5630-603f-4ab9-ac10-599e62edf30e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:03.147440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa9f5630-603f-4ab9-ac10-599e62edf30e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:03.275356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fa9f5630-603f-4ab9-ac10-599e62edf30e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:03.283115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fa9f5630-603f-4ab9-ac10-599e62edf30e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 200 len: 1366 microversion: 2.1 time: 0.150507 Oct 28 20:28:03.283687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1422/2839] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:03 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:04.303608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:28:04.308222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0c60200e-4bc4-4a37-8e6f-d5c7b321f9c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:04.308958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0c60200e-4bc4-4a37-8e6f-d5c7b321f9c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:04.316264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c60200e-4bc4-4a37-8e6f-d5c7b321f9c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:04.316760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c60200e-4bc4-4a37-8e6f-d5c7b321f9c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:04.317209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c60200e-4bc4-4a37-8e6f-d5c7b321f9c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:04.317974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c60200e-4bc4-4a37-8e6f-d5c7b321f9c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:04.318496 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c60200e-4bc4-4a37-8e6f-d5c7b321f9c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:04.318925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c60200e-4bc4-4a37-8e6f-d5c7b321f9c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:04.449300 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0c60200e-4bc4-4a37-8e6f-d5c7b321f9c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:04.457846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0c60200e-4bc4-4a37-8e6f-d5c7b321f9c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 200 len: 1556 microversion: 2.1 time: 0.155304 Oct 28 20:28:04.458420 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1418/2840] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:04 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:04.480586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-734a0b38-3aa5-46b7-9cb3-899359ff4deb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:04.481083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-734a0b38-3aa5-46b7-9cb3-899359ff4deb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:04.488108 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-734a0b38-3aa5-46b7-9cb3-899359ff4deb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:04.488634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-734a0b38-3aa5-46b7-9cb3-899359ff4deb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:04.489076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-734a0b38-3aa5-46b7-9cb3-899359ff4deb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:04.489819 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-734a0b38-3aa5-46b7-9cb3-899359ff4deb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:04.490277 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-734a0b38-3aa5-46b7-9cb3-899359ff4deb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:04.491053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-734a0b38-3aa5-46b7-9cb3-899359ff4deb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:04.567048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-734a0b38-3aa5-46b7-9cb3-899359ff4deb tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090303 Oct 28 20:28:04.567649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1423/2841] 10.222.0.66 () {58 vars in 1275 bytes} [Fri Oct 28 20:28:04 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:28:05.842279 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-bb422a18-69a4-442d-b2f6-eccc73191ff6 req-fd4198af-3dec-4b27-84e9-6a83f00e63e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fca705e-f209-4a12-8462-5cb6a76b8976", "tag": "409a1018-b50b-4b3c-8392-24957ee7c660"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:28:05.852120 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bb422a18-69a4-442d-b2f6-eccc73191ff6 req-fd4198af-3dec-4b27-84e9-6a83f00e63e3 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:05.852538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bb422a18-69a4-442d-b2f6-eccc73191ff6 req-fd4198af-3dec-4b27-84e9-6a83f00e63e3 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:05.852972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bb422a18-69a4-442d-b2f6-eccc73191ff6 req-fd4198af-3dec-4b27-84e9-6a83f00e63e3 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:05.864121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-bb422a18-69a4-442d-b2f6-eccc73191ff6 req-fd4198af-3dec-4b27-84e9-6a83f00e63e3 service nova] Creating event network-changed:409a1018-b50b-4b3c-8392-24957ee7c660 for instance 7fca705e-f209-4a12-8462-5cb6a76b8976 on hv-cinder-86236 Oct 28 20:28:05.869339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-bb422a18-69a4-442d-b2f6-eccc73191ff6 req-fd4198af-3dec-4b27-84e9-6a83f00e63e3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084985 Oct 28 20:28:05.869949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1419/2842] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:28:35.305258 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:28:35.305950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=53 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:28:35.309775 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2ba029b1-667c-4bc4-b250-88a278eaab2d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:35.310260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2ba029b1-667c-4bc4-b250-88a278eaab2d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:35.316618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ba029b1-667c-4bc4-b250-88a278eaab2d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:35.323456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ba029b1-667c-4bc4-b250-88a278eaab2d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:35.323456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ba029b1-667c-4bc4-b250-88a278eaab2d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:35.323456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ba029b1-667c-4bc4-b250-88a278eaab2d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:35.323456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ba029b1-667c-4bc4-b250-88a278eaab2d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:35.323961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ba029b1-667c-4bc4-b250-88a278eaab2d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:35.342493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2ba029b1-667c-4bc4-b250-88a278eaab2d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976/ips" status: 200 len: 150 microversion: 2.1 time: 0.038916 Oct 28 20:28:35.343060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1424/2843] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Oct 28 20:28:35 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:29:01.502696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:01.503442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=9 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:01.508480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f8e78227-ac9c-4a1c-b43b-e010ef577966 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:01.509065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f8e78227-ac9c-4a1c-b43b-e010ef577966 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:01.515293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8e78227-ac9c-4a1c-b43b-e010ef577966 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:01.515821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8e78227-ac9c-4a1c-b43b-e010ef577966 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:01.516259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8e78227-ac9c-4a1c-b43b-e010ef577966 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:01.516958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8e78227-ac9c-4a1c-b43b-e010ef577966 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:01.517446 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8e78227-ac9c-4a1c-b43b-e010ef577966 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:01.517880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8e78227-ac9c-4a1c-b43b-e010ef577966 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-f8e78227-ac9c-4a1c-b43b-e010ef577966 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] HTTP exception thrown: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f8e78227-ac9c-4a1c-b43b-e010ef577966 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Request method failure captured: Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e HTTP/1.1 Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDYUV_YNM0XXwBBLx-WTdB2tjq5FfUSX5VRsT-xAlZ_e2f17iFR5KGzRqSyIT82YsBG3tEufG_S544gzvHRmKEDqErboY4PRO_Jp3hTpg8bXzg1fr4ePkhDzlMYdYf0HRuRZe5iaTEAu5mcOB7RsQRVC4HQxwtLzgZrAvWmiG9LEcj0 Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 34d30fbe6fa645bd9ea3d88ea5f68449 Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:29:01.542206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:29:01.548662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34d30fbe6fa645bd9ea3d88ea5f68449", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:29:01.548662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:29:01.548662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 34d30fbe6fa645bd9ea3d88ea5f68449 Oct 28 20:29:01.548662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:29:01.548662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-AttachVolumeShelveTestJSON-1907610215-project Oct 28 20:29:01.548662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:29:01.548662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:29:01.548662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: e0ba6bf2459d4a98a3a1f5684bdad2b2 Oct 28 20:29:01.548662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1907610215-project Oct 28 20:29:01.548662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:29:01.548662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. Oct 28 20:29:01.548662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': 'c6a0384e-d0fc-4074-ae6f-32c22703e39e'} Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:29:01.556337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. Oct 28 20:29:01.559245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:29:01.567503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f8e78227-ac9c-4a1c-b43b-e010ef577966 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Returning 404 to user: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:29:01.567503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f8e78227-ac9c-4a1c-b43b-e010ef577966 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 404 len: 111 microversion: 2.20 time: 0.033995 Oct 28 20:29:01.567503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1420/2844] 10.222.0.66 () {60 vars in 1280 bytes} [Fri Oct 28 20:29:01 2022] DELETE /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 20:29:01.569029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1d15a92b-b654-4ce1-8eae-bd565b026997 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:01.569029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1d15a92b-b654-4ce1-8eae-bd565b026997 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: c6a0384e-d0fc-4074-ae6f-32c22703e39e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:01.569029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d15a92b-b654-4ce1-8eae-bd565b026997 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:01.569029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d15a92b-b654-4ce1-8eae-bd565b026997 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:01.570149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d15a92b-b654-4ce1-8eae-bd565b026997 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:01.570149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d15a92b-b654-4ce1-8eae-bd565b026997 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:01.570149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d15a92b-b654-4ce1-8eae-bd565b026997 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:01.570149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d15a92b-b654-4ce1-8eae-bd565b026997 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:01.570888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cc75d24d-c8ab-4706-ba65-a782bd7b0713 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:01.572055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cc75d24d-c8ab-4706-ba65-a782bd7b0713 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:01.575898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-1d15a92b-b654-4ce1-8eae-bd565b026997 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] HTTP exception thrown: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1d15a92b-b654-4ce1-8eae-bd565b026997 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Request method failure captured: Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e HTTP/1.1 Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYUV_YNM0XXwBBLx-WTdB2tjq5FfUSX5VRsT-xAlZ_e2f17iFR5KGzRqSyIT82YsBG3tEufG_S544gzvHRmKEDqErboY4PRO_Jp3hTpg8bXzg1fr4ePkhDzlMYdYf0HRuRZe5iaTEAu5mcOB7RsQRVC4HQxwtLzgZrAvWmiG9LEcj0 Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 34d30fbe6fa645bd9ea3d88ea5f68449 Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:29:01.576774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:29:01.578534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34d30fbe6fa645bd9ea3d88ea5f68449", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:29:01.578534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:29:01.578534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 34d30fbe6fa645bd9ea3d88ea5f68449 Oct 28 20:29:01.578534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:29:01.578534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-AttachVolumeShelveTestJSON-1907610215-project Oct 28 20:29:01.578534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:29:01.578534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:29:01.578534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: e0ba6bf2459d4a98a3a1f5684bdad2b2 Oct 28 20:29:01.578534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1907610215-project Oct 28 20:29:01.578534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:29:01.578534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. Oct 28 20:29:01.578534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': 'c6a0384e-d0fc-4074-ae6f-32c22703e39e'} Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:29:01.579393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. Oct 28 20:29:01.580793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:29:01.582541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1d15a92b-b654-4ce1-8eae-bd565b026997 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Returning 404 to user: Instance c6a0384e-d0fc-4074-ae6f-32c22703e39e could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:29:01.582652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc75d24d-c8ab-4706-ba65-a782bd7b0713 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:01.582652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc75d24d-c8ab-4706-ba65-a782bd7b0713 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:01.582867 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1d15a92b-b654-4ce1-8eae-bd565b026997 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e" status: 404 len: 111 microversion: 2.20 time: 0.038298 Oct 28 20:29:01.582976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc75d24d-c8ab-4706-ba65-a782bd7b0713 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:01.582976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc75d24d-c8ab-4706-ba65-a782bd7b0713 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:01.582976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc75d24d-c8ab-4706-ba65-a782bd7b0713 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:01.582976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc75d24d-c8ab-4706-ba65-a782bd7b0713 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:01.583353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1425/2845] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:29:01 2022] GET /compute/v2.1/servers/c6a0384e-d0fc-4074-ae6f-32c22703e39e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 20:29:01.608952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cc75d24d-c8ab-4706-ba65-a782bd7b0713 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:29:01.891085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cc75d24d-c8ab-4706-ba65-a782bd7b0713 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 204 len: 0 microversion: 2.1 time: 0.339309 Oct 28 20:29:01.891685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1421/2846] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:29:01 2022] DELETE /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:29:01.900355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-22cd2d42-ff9a-439e-9168-8f8909eb01f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:01.900974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22cd2d42-ff9a-439e-9168-8f8909eb01f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:01.907555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22cd2d42-ff9a-439e-9168-8f8909eb01f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:01.908044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22cd2d42-ff9a-439e-9168-8f8909eb01f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:01.908486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22cd2d42-ff9a-439e-9168-8f8909eb01f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:01.909178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22cd2d42-ff9a-439e-9168-8f8909eb01f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:01.909677 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22cd2d42-ff9a-439e-9168-8f8909eb01f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:01.910099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22cd2d42-ff9a-439e-9168-8f8909eb01f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:02.040984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-22cd2d42-ff9a-439e-9168-8f8909eb01f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:02.049390 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-22cd2d42-ff9a-439e-9168-8f8909eb01f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153286 Oct 28 20:29:02.049955 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1426/2847] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:01 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:03.074423 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5f2704ed-99fc-4d2e-a9ac-c3684c4d2e0a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:03.075119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5f2704ed-99fc-4d2e-a9ac-c3684c4d2e0a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:03.081410 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f2704ed-99fc-4d2e-a9ac-c3684c4d2e0a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:03.081889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f2704ed-99fc-4d2e-a9ac-c3684c4d2e0a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:03.082326 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f2704ed-99fc-4d2e-a9ac-c3684c4d2e0a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:03.083001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f2704ed-99fc-4d2e-a9ac-c3684c4d2e0a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:03.083453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f2704ed-99fc-4d2e-a9ac-c3684c4d2e0a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:03.083872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f2704ed-99fc-4d2e-a9ac-c3684c4d2e0a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:03.218292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f2704ed-99fc-4d2e-a9ac-c3684c4d2e0a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:03.226997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5f2704ed-99fc-4d2e-a9ac-c3684c4d2e0a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.156806 Oct 28 20:29:03.227564 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1422/2848] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:03 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:04.251250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2674a250-bbeb-4272-90c4-231859b2afdd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:04.251861 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2674a250-bbeb-4272-90c4-231859b2afdd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:04.259133 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2674a250-bbeb-4272-90c4-231859b2afdd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:04.259616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2674a250-bbeb-4272-90c4-231859b2afdd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:04.260054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2674a250-bbeb-4272-90c4-231859b2afdd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:04.260737 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2674a250-bbeb-4272-90c4-231859b2afdd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:04.261189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2674a250-bbeb-4272-90c4-231859b2afdd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:04.261638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2674a250-bbeb-4272-90c4-231859b2afdd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:04.390307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2674a250-bbeb-4272-90c4-231859b2afdd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:04.398874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2674a250-bbeb-4272-90c4-231859b2afdd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151822 Oct 28 20:29:04.399434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1427/2849] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:04 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:05.422633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cf46e8e1-972c-4ca3-a4a7-0500e8d4a554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:05.423242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cf46e8e1-972c-4ca3-a4a7-0500e8d4a554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:05.430271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf46e8e1-972c-4ca3-a4a7-0500e8d4a554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:05.430755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf46e8e1-972c-4ca3-a4a7-0500e8d4a554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:05.431186 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf46e8e1-972c-4ca3-a4a7-0500e8d4a554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:05.432291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf46e8e1-972c-4ca3-a4a7-0500e8d4a554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:05.432747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf46e8e1-972c-4ca3-a4a7-0500e8d4a554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:05.433169 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf46e8e1-972c-4ca3-a4a7-0500e8d4a554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:05.561550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-cf46e8e1-972c-4ca3-a4a7-0500e8d4a554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:05.569720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cf46e8e1-972c-4ca3-a4a7-0500e8d4a554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150939 Oct 28 20:29:05.570294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1423/2850] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:05 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:06.593209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f273adc6-3360-49b4-b04f-7f2f5f5d9078 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:06.593853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f273adc6-3360-49b4-b04f-7f2f5f5d9078 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:06.601264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f273adc6-3360-49b4-b04f-7f2f5f5d9078 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:06.601790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f273adc6-3360-49b4-b04f-7f2f5f5d9078 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:06.602217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f273adc6-3360-49b4-b04f-7f2f5f5d9078 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:06.602903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f273adc6-3360-49b4-b04f-7f2f5f5d9078 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:06.603362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f273adc6-3360-49b4-b04f-7f2f5f5d9078 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:06.603789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f273adc6-3360-49b4-b04f-7f2f5f5d9078 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:06.735050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f273adc6-3360-49b4-b04f-7f2f5f5d9078 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:06.743149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f273adc6-3360-49b4-b04f-7f2f5f5d9078 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154097 Oct 28 20:29:06.743707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1428/2851] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:06 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:07.766298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-236d88a3-fcb3-486c-afb0-5cd269f70d67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:07.766917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-236d88a3-fcb3-486c-afb0-5cd269f70d67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:07.773273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-236d88a3-fcb3-486c-afb0-5cd269f70d67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:07.773794 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-236d88a3-fcb3-486c-afb0-5cd269f70d67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:07.774233 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-236d88a3-fcb3-486c-afb0-5cd269f70d67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:07.774916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-236d88a3-fcb3-486c-afb0-5cd269f70d67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:07.775369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-236d88a3-fcb3-486c-afb0-5cd269f70d67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:07.775793 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-236d88a3-fcb3-486c-afb0-5cd269f70d67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:07.903926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-236d88a3-fcb3-486c-afb0-5cd269f70d67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:07.912645 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-236d88a3-fcb3-486c-afb0-5cd269f70d67 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149752 Oct 28 20:29:07.913269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1424/2852] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:07 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:08.936711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee86bdf9-5bd6-4013-8368-6884781099eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:08.937368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee86bdf9-5bd6-4013-8368-6884781099eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:08.943751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee86bdf9-5bd6-4013-8368-6884781099eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:08.946931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee86bdf9-5bd6-4013-8368-6884781099eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:08.946931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee86bdf9-5bd6-4013-8368-6884781099eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:08.946931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee86bdf9-5bd6-4013-8368-6884781099eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:08.947264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee86bdf9-5bd6-4013-8368-6884781099eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:08.947397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee86bdf9-5bd6-4013-8368-6884781099eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:09.081203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee86bdf9-5bd6-4013-8368-6884781099eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:09.089628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee86bdf9-5bd6-4013-8368-6884781099eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.156822 Oct 28 20:29:09.090210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1429/2853] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:08 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:10.113934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0d9d0f94-58ca-4850-abe0-834f3f3dd107 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:10.114546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0d9d0f94-58ca-4850-abe0-834f3f3dd107 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:10.121000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d9d0f94-58ca-4850-abe0-834f3f3dd107 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:10.121525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d9d0f94-58ca-4850-abe0-834f3f3dd107 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:10.121967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d9d0f94-58ca-4850-abe0-834f3f3dd107 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:10.122680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d9d0f94-58ca-4850-abe0-834f3f3dd107 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:10.123139 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d9d0f94-58ca-4850-abe0-834f3f3dd107 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:10.123566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d9d0f94-58ca-4850-abe0-834f3f3dd107 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:10.251388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0d9d0f94-58ca-4850-abe0-834f3f3dd107 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:10.260456 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0d9d0f94-58ca-4850-abe0-834f3f3dd107 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150455 Oct 28 20:29:10.261029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1425/2854] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:10 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:11.284109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0610aae0-d64e-4c87-b53d-f568213b0ba3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:11.284662 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0610aae0-d64e-4c87-b53d-f568213b0ba3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:11.291085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0610aae0-d64e-4c87-b53d-f568213b0ba3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:11.291537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0610aae0-d64e-4c87-b53d-f568213b0ba3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:11.291964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0610aae0-d64e-4c87-b53d-f568213b0ba3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:11.292637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0610aae0-d64e-4c87-b53d-f568213b0ba3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:11.293082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0610aae0-d64e-4c87-b53d-f568213b0ba3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:11.293534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0610aae0-d64e-4c87-b53d-f568213b0ba3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:11.425194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0610aae0-d64e-4c87-b53d-f568213b0ba3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:11.434473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0610aae0-d64e-4c87-b53d-f568213b0ba3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154240 Oct 28 20:29:11.435040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1430/2855] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:11 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:12.458100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-30ce970e-05a7-46f9-b4d8-5a21ae4d16f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:12.458715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-30ce970e-05a7-46f9-b4d8-5a21ae4d16f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:12.466278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30ce970e-05a7-46f9-b4d8-5a21ae4d16f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:12.466767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30ce970e-05a7-46f9-b4d8-5a21ae4d16f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:12.467206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30ce970e-05a7-46f9-b4d8-5a21ae4d16f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:12.467894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30ce970e-05a7-46f9-b4d8-5a21ae4d16f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:12.468353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30ce970e-05a7-46f9-b4d8-5a21ae4d16f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:12.468780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30ce970e-05a7-46f9-b4d8-5a21ae4d16f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:12.597736 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-30ce970e-05a7-46f9-b4d8-5a21ae4d16f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:12.605844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-30ce970e-05a7-46f9-b4d8-5a21ae4d16f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151560 Oct 28 20:29:12.606405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1426/2856] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:12 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:13.629626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a007fc3-9bff-4288-80ba-9882a0c1ee7e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:13.630328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2a007fc3-9bff-4288-80ba-9882a0c1ee7e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:13.636805 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a007fc3-9bff-4288-80ba-9882a0c1ee7e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:13.637373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a007fc3-9bff-4288-80ba-9882a0c1ee7e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:13.637810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a007fc3-9bff-4288-80ba-9882a0c1ee7e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:13.638488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a007fc3-9bff-4288-80ba-9882a0c1ee7e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:13.638935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a007fc3-9bff-4288-80ba-9882a0c1ee7e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:13.639352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a007fc3-9bff-4288-80ba-9882a0c1ee7e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:13.771872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2a007fc3-9bff-4288-80ba-9882a0c1ee7e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:13.775789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a007fc3-9bff-4288-80ba-9882a0c1ee7e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149989 Oct 28 20:29:13.776351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1431/2857] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:13 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:14.798756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f0511e7-ac59-42de-b5ff-7403259307e4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:14.799442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0f0511e7-ac59-42de-b5ff-7403259307e4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:14.806672 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f0511e7-ac59-42de-b5ff-7403259307e4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:14.807156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f0511e7-ac59-42de-b5ff-7403259307e4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:14.807593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f0511e7-ac59-42de-b5ff-7403259307e4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:14.808303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f0511e7-ac59-42de-b5ff-7403259307e4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:14.808756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f0511e7-ac59-42de-b5ff-7403259307e4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:14.809178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f0511e7-ac59-42de-b5ff-7403259307e4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:14.942362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0f0511e7-ac59-42de-b5ff-7403259307e4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:14.950665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0f0511e7-ac59-42de-b5ff-7403259307e4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155841 Oct 28 20:29:14.951230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1427/2858] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:14 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:15.974776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e31604af-ff76-4cc4-a898-3f43f4a0b331 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:15.975381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e31604af-ff76-4cc4-a898-3f43f4a0b331 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:15.982834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e31604af-ff76-4cc4-a898-3f43f4a0b331 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:15.983296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e31604af-ff76-4cc4-a898-3f43f4a0b331 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:15.983734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e31604af-ff76-4cc4-a898-3f43f4a0b331 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:15.984418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e31604af-ff76-4cc4-a898-3f43f4a0b331 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:15.984873 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e31604af-ff76-4cc4-a898-3f43f4a0b331 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:15.985301 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e31604af-ff76-4cc4-a898-3f43f4a0b331 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:16.111974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e31604af-ff76-4cc4-a898-3f43f4a0b331 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:16.120873 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e31604af-ff76-4cc4-a898-3f43f4a0b331 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150324 Oct 28 20:29:16.121467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1432/2859] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:15 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:17.145105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5752e01e-8f1b-4c8e-9a55-22fd1140e8c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:17.145814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5752e01e-8f1b-4c8e-9a55-22fd1140e8c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:17.153577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5752e01e-8f1b-4c8e-9a55-22fd1140e8c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:17.154064 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5752e01e-8f1b-4c8e-9a55-22fd1140e8c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:17.154503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5752e01e-8f1b-4c8e-9a55-22fd1140e8c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:17.155190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5752e01e-8f1b-4c8e-9a55-22fd1140e8c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:17.155648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5752e01e-8f1b-4c8e-9a55-22fd1140e8c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:17.156076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5752e01e-8f1b-4c8e-9a55-22fd1140e8c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:17.285463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5752e01e-8f1b-4c8e-9a55-22fd1140e8c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:17.294682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5752e01e-8f1b-4c8e-9a55-22fd1140e8c0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153453 Oct 28 20:29:17.295245 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1428/2860] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:17 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:18.317283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9d946ba5-c1d9-43b7-bff6-6e10fc80fc5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:18.317869 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9d946ba5-c1d9-43b7-bff6-6e10fc80fc5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:18.324026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d946ba5-c1d9-43b7-bff6-6e10fc80fc5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:18.324510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d946ba5-c1d9-43b7-bff6-6e10fc80fc5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:18.324947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d946ba5-c1d9-43b7-bff6-6e10fc80fc5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:18.325658 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d946ba5-c1d9-43b7-bff6-6e10fc80fc5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:18.326111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d946ba5-c1d9-43b7-bff6-6e10fc80fc5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:18.326536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d946ba5-c1d9-43b7-bff6-6e10fc80fc5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:18.456088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9d946ba5-c1d9-43b7-bff6-6e10fc80fc5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:18.464554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9d946ba5-c1d9-43b7-bff6-6e10fc80fc5e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151190 Oct 28 20:29:18.465119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1433/2861] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:18 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:19.488398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2450a558-be67-4b63-9904-e432dbfc98c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:19.489044 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2450a558-be67-4b63-9904-e432dbfc98c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:19.496516 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2450a558-be67-4b63-9904-e432dbfc98c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:19.497002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2450a558-be67-4b63-9904-e432dbfc98c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:19.497469 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2450a558-be67-4b63-9904-e432dbfc98c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:19.498161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2450a558-be67-4b63-9904-e432dbfc98c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:19.498621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2450a558-be67-4b63-9904-e432dbfc98c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:19.499049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2450a558-be67-4b63-9904-e432dbfc98c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:19.629280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2450a558-be67-4b63-9904-e432dbfc98c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:19.636828 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2450a558-be67-4b63-9904-e432dbfc98c6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152291 Oct 28 20:29:19.637432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1429/2862] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:19 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:29:20.659286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7c79a363-d1d4-4d1c-8c3b-1b3b452aa5f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:20.659870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7c79a363-d1d4-4d1c-8c3b-1b3b452aa5f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:20.666866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c79a363-d1d4-4d1c-8c3b-1b3b452aa5f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:20.667346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c79a363-d1d4-4d1c-8c3b-1b3b452aa5f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:20.667777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c79a363-d1d4-4d1c-8c3b-1b3b452aa5f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:20.668450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c79a363-d1d4-4d1c-8c3b-1b3b452aa5f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:20.668896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c79a363-d1d4-4d1c-8c3b-1b3b452aa5f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:20.669312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c79a363-d1d4-4d1c-8c3b-1b3b452aa5f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:20.798012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7c79a363-d1d4-4d1c-8c3b-1b3b452aa5f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:20.807048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7c79a363-d1d4-4d1c-8c3b-1b3b452aa5f6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151605 Oct 28 20:29:20.807607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1434/2863] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:20 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:21.830140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f58ced6c-ba81-45ed-91db-fd1124b55e68 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:21.830756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f58ced6c-ba81-45ed-91db-fd1124b55e68 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:21.837483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f58ced6c-ba81-45ed-91db-fd1124b55e68 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:21.837975 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f58ced6c-ba81-45ed-91db-fd1124b55e68 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:21.838416 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f58ced6c-ba81-45ed-91db-fd1124b55e68 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:21.839109 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f58ced6c-ba81-45ed-91db-fd1124b55e68 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:21.839568 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f58ced6c-ba81-45ed-91db-fd1124b55e68 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:21.839996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f58ced6c-ba81-45ed-91db-fd1124b55e68 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:21.967737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f58ced6c-ba81-45ed-91db-fd1124b55e68 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:21.975973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f58ced6c-ba81-45ed-91db-fd1124b55e68 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149809 Oct 28 20:29:21.976545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1430/2864] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:21 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:22.999310 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2509c6c7-bd9a-421e-a86f-045572780b9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:22.999896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2509c6c7-bd9a-421e-a86f-045572780b9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:23.006253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2509c6c7-bd9a-421e-a86f-045572780b9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:23.006727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2509c6c7-bd9a-421e-a86f-045572780b9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:23.007157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2509c6c7-bd9a-421e-a86f-045572780b9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:23.007831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2509c6c7-bd9a-421e-a86f-045572780b9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:23.008279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2509c6c7-bd9a-421e-a86f-045572780b9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:23.008702 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2509c6c7-bd9a-421e-a86f-045572780b9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:23.140439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2509c6c7-bd9a-421e-a86f-045572780b9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:23.148561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2509c6c7-bd9a-421e-a86f-045572780b9e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153048 Oct 28 20:29:23.149153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1435/2865] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:22 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:24.172524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-26520685-7b2e-42ab-bfc3-1788a85e0eb1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:24.173168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-26520685-7b2e-42ab-bfc3-1788a85e0eb1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:24.179875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26520685-7b2e-42ab-bfc3-1788a85e0eb1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:24.180362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26520685-7b2e-42ab-bfc3-1788a85e0eb1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:24.180825 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26520685-7b2e-42ab-bfc3-1788a85e0eb1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:24.182180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26520685-7b2e-42ab-bfc3-1788a85e0eb1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:24.182824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26520685-7b2e-42ab-bfc3-1788a85e0eb1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:24.183240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26520685-7b2e-42ab-bfc3-1788a85e0eb1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:24.312604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-26520685-7b2e-42ab-bfc3-1788a85e0eb1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:24.320603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-26520685-7b2e-42ab-bfc3-1788a85e0eb1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151943 Oct 28 20:29:24.321162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1431/2866] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:24 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:25.343973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-41e8e753-0ac1-4a3e-93b9-0ab252622b72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:25.344541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-41e8e753-0ac1-4a3e-93b9-0ab252622b72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:25.351327 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41e8e753-0ac1-4a3e-93b9-0ab252622b72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:25.351806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41e8e753-0ac1-4a3e-93b9-0ab252622b72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:25.352244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41e8e753-0ac1-4a3e-93b9-0ab252622b72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:25.352927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41e8e753-0ac1-4a3e-93b9-0ab252622b72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:25.353459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41e8e753-0ac1-4a3e-93b9-0ab252622b72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:25.353966 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41e8e753-0ac1-4a3e-93b9-0ab252622b72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:25.484186 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-41e8e753-0ac1-4a3e-93b9-0ab252622b72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:25.492362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-41e8e753-0ac1-4a3e-93b9-0ab252622b72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152346 Oct 28 20:29:25.492935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1436/2867] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:25 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:26.516753 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-72b8c72a-7300-4c8a-ae73-b593375885c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:26.517436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-72b8c72a-7300-4c8a-ae73-b593375885c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:26.523859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b8c72a-7300-4c8a-ae73-b593375885c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:26.524340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b8c72a-7300-4c8a-ae73-b593375885c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:26.524780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b8c72a-7300-4c8a-ae73-b593375885c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:26.525727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b8c72a-7300-4c8a-ae73-b593375885c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:26.526279 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b8c72a-7300-4c8a-ae73-b593375885c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:26.526713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b8c72a-7300-4c8a-ae73-b593375885c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:26.655259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-72b8c72a-7300-4c8a-ae73-b593375885c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:26.663447 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-72b8c72a-7300-4c8a-ae73-b593375885c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150740 Oct 28 20:29:26.664013 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1432/2868] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:26 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:27.686235 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6d1096b8-e861-423c-8465-7d1b85d8867a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:27.686885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6d1096b8-e861-423c-8465-7d1b85d8867a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:27.693434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d1096b8-e861-423c-8465-7d1b85d8867a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:27.693918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d1096b8-e861-423c-8465-7d1b85d8867a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:27.694355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d1096b8-e861-423c-8465-7d1b85d8867a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:27.695046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d1096b8-e861-423c-8465-7d1b85d8867a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:27.695499 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d1096b8-e861-423c-8465-7d1b85d8867a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:27.695925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d1096b8-e861-423c-8465-7d1b85d8867a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:27.824295 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6d1096b8-e861-423c-8465-7d1b85d8867a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:27.832378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6d1096b8-e861-423c-8465-7d1b85d8867a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150164 Oct 28 20:29:27.832988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1437/2869] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:27 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:28.857064 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3fa6a7e0-03ff-499d-929d-a45514b53c47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:28.857727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3fa6a7e0-03ff-499d-929d-a45514b53c47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:28.863997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fa6a7e0-03ff-499d-929d-a45514b53c47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:28.864469 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fa6a7e0-03ff-499d-929d-a45514b53c47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:28.864910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fa6a7e0-03ff-499d-929d-a45514b53c47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:28.865609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fa6a7e0-03ff-499d-929d-a45514b53c47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:28.866076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fa6a7e0-03ff-499d-929d-a45514b53c47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:28.866473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fa6a7e0-03ff-499d-929d-a45514b53c47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:28.996653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3fa6a7e0-03ff-499d-929d-a45514b53c47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:29.004686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3fa6a7e0-03ff-499d-929d-a45514b53c47 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152273 Oct 28 20:29:29.005239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1433/2870] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:28 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:30.028169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7ac32ca1-9737-41a9-b53b-7cafcdaddd1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:30.028817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7ac32ca1-9737-41a9-b53b-7cafcdaddd1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:30.035247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ac32ca1-9737-41a9-b53b-7cafcdaddd1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:30.035734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ac32ca1-9737-41a9-b53b-7cafcdaddd1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:30.036179 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ac32ca1-9737-41a9-b53b-7cafcdaddd1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:30.036865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ac32ca1-9737-41a9-b53b-7cafcdaddd1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:30.037348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ac32ca1-9737-41a9-b53b-7cafcdaddd1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:30.037771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ac32ca1-9737-41a9-b53b-7cafcdaddd1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:30.167149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7ac32ca1-9737-41a9-b53b-7cafcdaddd1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:30.175260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7ac32ca1-9737-41a9-b53b-7cafcdaddd1d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151400 Oct 28 20:29:30.175821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1438/2871] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:30 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:31.199497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b72369d-8f05-4230-9464-050984dfdc50 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:31.200107 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7b72369d-8f05-4230-9464-050984dfdc50 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:31.206489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b72369d-8f05-4230-9464-050984dfdc50 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:31.206969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b72369d-8f05-4230-9464-050984dfdc50 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:31.207402 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b72369d-8f05-4230-9464-050984dfdc50 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:31.208079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b72369d-8f05-4230-9464-050984dfdc50 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:31.208527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b72369d-8f05-4230-9464-050984dfdc50 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:31.208942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b72369d-8f05-4230-9464-050984dfdc50 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:31.346024 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b72369d-8f05-4230-9464-050984dfdc50 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:31.354956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7b72369d-8f05-4230-9464-050984dfdc50 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.159877 Oct 28 20:29:31.355526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1434/2872] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:31 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:32.378606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2e7eb72d-23d2-4531-acd7-477fe794a543 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:32.379145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2e7eb72d-23d2-4531-acd7-477fe794a543 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:32.385608 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e7eb72d-23d2-4531-acd7-477fe794a543 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:32.386090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e7eb72d-23d2-4531-acd7-477fe794a543 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:32.386527 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e7eb72d-23d2-4531-acd7-477fe794a543 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:32.387206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e7eb72d-23d2-4531-acd7-477fe794a543 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:32.387663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e7eb72d-23d2-4531-acd7-477fe794a543 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:32.388083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e7eb72d-23d2-4531-acd7-477fe794a543 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:32.390627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=85 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:32.516922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2e7eb72d-23d2-4531-acd7-477fe794a543 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:32.525700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2e7eb72d-23d2-4531-acd7-477fe794a543 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150518 Oct 28 20:29:32.527382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1439/2873] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:32 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:33.550311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d210a728-11dd-4c2e-9eab-d9e88948ad9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:33.550932 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d210a728-11dd-4c2e-9eab-d9e88948ad9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:33.553309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:33.558871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d210a728-11dd-4c2e-9eab-d9e88948ad9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:33.559366 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d210a728-11dd-4c2e-9eab-d9e88948ad9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:33.559807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d210a728-11dd-4c2e-9eab-d9e88948ad9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:33.560500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d210a728-11dd-4c2e-9eab-d9e88948ad9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:33.560995 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d210a728-11dd-4c2e-9eab-d9e88948ad9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:33.561452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d210a728-11dd-4c2e-9eab-d9e88948ad9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:33.564184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:33.692445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d210a728-11dd-4c2e-9eab-d9e88948ad9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:33.700665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d210a728-11dd-4c2e-9eab-d9e88948ad9c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154396 Oct 28 20:29:33.701239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1435/2874] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:33 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:34.724151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2d8f5f3-af98-4b5b-9b56-77f952c4ea8a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:34.724791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2d8f5f3-af98-4b5b-9b56-77f952c4ea8a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:34.727122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=33 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:34.732750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d8f5f3-af98-4b5b-9b56-77f952c4ea8a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:34.733240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d8f5f3-af98-4b5b-9b56-77f952c4ea8a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:34.733822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d8f5f3-af98-4b5b-9b56-77f952c4ea8a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:34.734617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d8f5f3-af98-4b5b-9b56-77f952c4ea8a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:34.735159 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d8f5f3-af98-4b5b-9b56-77f952c4ea8a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:34.735587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d8f5f3-af98-4b5b-9b56-77f952c4ea8a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:34.871502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2d8f5f3-af98-4b5b-9b56-77f952c4ea8a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:34.879553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2d8f5f3-af98-4b5b-9b56-77f952c4ea8a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.159657 Oct 28 20:29:34.880119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1440/2875] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:34 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:29:35.904928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8efed7ea-5b8d-458b-9f43-6da2a52a6c9b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:35.905499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8efed7ea-5b8d-458b-9f43-6da2a52a6c9b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:35.912005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8efed7ea-5b8d-458b-9f43-6da2a52a6c9b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:35.912492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8efed7ea-5b8d-458b-9f43-6da2a52a6c9b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:35.912935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8efed7ea-5b8d-458b-9f43-6da2a52a6c9b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:35.913655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8efed7ea-5b8d-458b-9f43-6da2a52a6c9b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:35.914117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8efed7ea-5b8d-458b-9f43-6da2a52a6c9b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:35.914545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8efed7ea-5b8d-458b-9f43-6da2a52a6c9b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:36.043445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8efed7ea-5b8d-458b-9f43-6da2a52a6c9b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:36.051603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8efed7ea-5b8d-458b-9f43-6da2a52a6c9b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152010 Oct 28 20:29:36.052170 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1436/2876] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:35 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:29:37.075944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f73bb6f4-73a7-448c-8880-be98b7e6b6d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:37.076535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f73bb6f4-73a7-448c-8880-be98b7e6b6d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:37.083038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f73bb6f4-73a7-448c-8880-be98b7e6b6d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:37.083520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f73bb6f4-73a7-448c-8880-be98b7e6b6d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:37.083953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f73bb6f4-73a7-448c-8880-be98b7e6b6d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:37.084640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f73bb6f4-73a7-448c-8880-be98b7e6b6d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:37.085091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f73bb6f4-73a7-448c-8880-be98b7e6b6d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:37.085548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f73bb6f4-73a7-448c-8880-be98b7e6b6d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:37.216053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f73bb6f4-73a7-448c-8880-be98b7e6b6d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:37.224437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f73bb6f4-73a7-448c-8880-be98b7e6b6d0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153038 Oct 28 20:29:37.225021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1441/2877] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:37 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:38.250495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c738e361-87be-41b5-98a6-0d5859c6befd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:38.251184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c738e361-87be-41b5-98a6-0d5859c6befd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:38.257548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c738e361-87be-41b5-98a6-0d5859c6befd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:38.258032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c738e361-87be-41b5-98a6-0d5859c6befd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:38.258461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c738e361-87be-41b5-98a6-0d5859c6befd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:38.259133 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c738e361-87be-41b5-98a6-0d5859c6befd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:38.259579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c738e361-87be-41b5-98a6-0d5859c6befd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:38.259999 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c738e361-87be-41b5-98a6-0d5859c6befd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:38.386805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c738e361-87be-41b5-98a6-0d5859c6befd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:38.394877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c738e361-87be-41b5-98a6-0d5859c6befd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149359 Oct 28 20:29:38.395434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1437/2878] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:38 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:39.418792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9ce5c7e6-3a9c-424f-b400-1d5010f6f12a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:39.419347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9ce5c7e6-3a9c-424f-b400-1d5010f6f12a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:39.426113 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ce5c7e6-3a9c-424f-b400-1d5010f6f12a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:39.426600 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ce5c7e6-3a9c-424f-b400-1d5010f6f12a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:39.427043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ce5c7e6-3a9c-424f-b400-1d5010f6f12a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:39.427727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ce5c7e6-3a9c-424f-b400-1d5010f6f12a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:39.428184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ce5c7e6-3a9c-424f-b400-1d5010f6f12a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:39.428612 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ce5c7e6-3a9c-424f-b400-1d5010f6f12a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:39.560858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9ce5c7e6-3a9c-424f-b400-1d5010f6f12a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:39.568970 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9ce5c7e6-3a9c-424f-b400-1d5010f6f12a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154474 Oct 28 20:29:39.569990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1442/2879] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:39 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:40.592145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5c6f03f7-2b26-4444-b4f8-03b9fd35ca40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:40.592778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5c6f03f7-2b26-4444-b4f8-03b9fd35ca40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:40.599630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c6f03f7-2b26-4444-b4f8-03b9fd35ca40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:40.600124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c6f03f7-2b26-4444-b4f8-03b9fd35ca40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:40.600563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c6f03f7-2b26-4444-b4f8-03b9fd35ca40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:40.601257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c6f03f7-2b26-4444-b4f8-03b9fd35ca40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:40.601739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c6f03f7-2b26-4444-b4f8-03b9fd35ca40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:40.602166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c6f03f7-2b26-4444-b4f8-03b9fd35ca40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:40.733040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5c6f03f7-2b26-4444-b4f8-03b9fd35ca40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:40.741210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5c6f03f7-2b26-4444-b4f8-03b9fd35ca40 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153080 Oct 28 20:29:40.741805 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1438/2880] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:40 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:41.766137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d89d0b9c-b7af-4e9d-bc92-1915c0052cd9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:41.766755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d89d0b9c-b7af-4e9d-bc92-1915c0052cd9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:41.773401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d89d0b9c-b7af-4e9d-bc92-1915c0052cd9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:41.773885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d89d0b9c-b7af-4e9d-bc92-1915c0052cd9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:41.774320 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d89d0b9c-b7af-4e9d-bc92-1915c0052cd9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:41.774997 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d89d0b9c-b7af-4e9d-bc92-1915c0052cd9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:41.775446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d89d0b9c-b7af-4e9d-bc92-1915c0052cd9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:41.775866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d89d0b9c-b7af-4e9d-bc92-1915c0052cd9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:41.902032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d89d0b9c-b7af-4e9d-bc92-1915c0052cd9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:41.910239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d89d0b9c-b7af-4e9d-bc92-1915c0052cd9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148022 Oct 28 20:29:41.910799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1443/2881] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:41 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:29:42.934109 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b9c67e18-3c7e-422b-89e8-e85de19c086b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:42.934709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b9c67e18-3c7e-422b-89e8-e85de19c086b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:42.941134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9c67e18-3c7e-422b-89e8-e85de19c086b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:42.941654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9c67e18-3c7e-422b-89e8-e85de19c086b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:42.942098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9c67e18-3c7e-422b-89e8-e85de19c086b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:42.942787 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9c67e18-3c7e-422b-89e8-e85de19c086b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:42.943247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9c67e18-3c7e-422b-89e8-e85de19c086b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:42.943671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9c67e18-3c7e-422b-89e8-e85de19c086b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:43.078929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b9c67e18-3c7e-422b-89e8-e85de19c086b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:43.087043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b9c67e18-3c7e-422b-89e8-e85de19c086b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.156894 Oct 28 20:29:43.087611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1439/2882] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:42 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:44.111720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b3a20ccb-eb06-4908-8481-004e9ba6da27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:44.112360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b3a20ccb-eb06-4908-8481-004e9ba6da27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:44.118736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3a20ccb-eb06-4908-8481-004e9ba6da27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:44.119220 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3a20ccb-eb06-4908-8481-004e9ba6da27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:44.119657 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3a20ccb-eb06-4908-8481-004e9ba6da27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:44.120344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3a20ccb-eb06-4908-8481-004e9ba6da27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:44.120800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3a20ccb-eb06-4908-8481-004e9ba6da27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:44.121947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3a20ccb-eb06-4908-8481-004e9ba6da27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:44.249011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b3a20ccb-eb06-4908-8481-004e9ba6da27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:44.257041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b3a20ccb-eb06-4908-8481-004e9ba6da27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149208 Oct 28 20:29:44.257627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1444/2883] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:44 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:45.279986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4ab03575-cb2f-4d6f-948c-ea5ee0214375 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:45.280582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4ab03575-cb2f-4d6f-948c-ea5ee0214375 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:45.286995 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ab03575-cb2f-4d6f-948c-ea5ee0214375 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:45.287423 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ab03575-cb2f-4d6f-948c-ea5ee0214375 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:45.287858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ab03575-cb2f-4d6f-948c-ea5ee0214375 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:45.288541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ab03575-cb2f-4d6f-948c-ea5ee0214375 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:45.288992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ab03575-cb2f-4d6f-948c-ea5ee0214375 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:45.289438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ab03575-cb2f-4d6f-948c-ea5ee0214375 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:45.431249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4ab03575-cb2f-4d6f-948c-ea5ee0214375 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:45.439773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4ab03575-cb2f-4d6f-948c-ea5ee0214375 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.164101 Oct 28 20:29:45.440550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1440/2884] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:45 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:46.463376 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-25c10866-ca0b-4e0d-a1c1-3a43d7809b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:46.463988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-25c10866-ca0b-4e0d-a1c1-3a43d7809b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:46.470774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25c10866-ca0b-4e0d-a1c1-3a43d7809b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:46.471255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25c10866-ca0b-4e0d-a1c1-3a43d7809b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:46.471691 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25c10866-ca0b-4e0d-a1c1-3a43d7809b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:46.472378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25c10866-ca0b-4e0d-a1c1-3a43d7809b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:46.473074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25c10866-ca0b-4e0d-a1c1-3a43d7809b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:46.473543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25c10866-ca0b-4e0d-a1c1-3a43d7809b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:46.600263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-25c10866-ca0b-4e0d-a1c1-3a43d7809b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:46.609058 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-25c10866-ca0b-4e0d-a1c1-3a43d7809b19 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149549 Oct 28 20:29:46.609672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1445/2885] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:46 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:47.634923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3c415a9a-be1d-45ac-8ca2-b2b85e919557 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:47.635675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3c415a9a-be1d-45ac-8ca2-b2b85e919557 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:47.646341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c415a9a-be1d-45ac-8ca2-b2b85e919557 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:47.647345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c415a9a-be1d-45ac-8ca2-b2b85e919557 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:47.647829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c415a9a-be1d-45ac-8ca2-b2b85e919557 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:47.648774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c415a9a-be1d-45ac-8ca2-b2b85e919557 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:47.649526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c415a9a-be1d-45ac-8ca2-b2b85e919557 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:47.650108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c415a9a-be1d-45ac-8ca2-b2b85e919557 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:47.781238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3c415a9a-be1d-45ac-8ca2-b2b85e919557 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:47.789705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3c415a9a-be1d-45ac-8ca2-b2b85e919557 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.160004 Oct 28 20:29:47.790280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1441/2886] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:47 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:29:48.813618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-697aafc6-a3cd-4c4c-8ef9-7d5d20e88265 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:48.814246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-697aafc6-a3cd-4c4c-8ef9-7d5d20e88265 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:48.820773 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-697aafc6-a3cd-4c4c-8ef9-7d5d20e88265 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:48.821259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-697aafc6-a3cd-4c4c-8ef9-7d5d20e88265 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:48.821730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-697aafc6-a3cd-4c4c-8ef9-7d5d20e88265 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:48.822425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-697aafc6-a3cd-4c4c-8ef9-7d5d20e88265 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:48.822883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-697aafc6-a3cd-4c4c-8ef9-7d5d20e88265 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:48.823308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-697aafc6-a3cd-4c4c-8ef9-7d5d20e88265 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:48.958570 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-697aafc6-a3cd-4c4c-8ef9-7d5d20e88265 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:48.966826 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-697aafc6-a3cd-4c4c-8ef9-7d5d20e88265 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.157217 Oct 28 20:29:48.967386 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1446/2887] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:48 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:49.990398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37c49aed-8e60-4d7a-9fd4-aef85c9cfb4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:49.991014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-37c49aed-8e60-4d7a-9fd4-aef85c9cfb4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:49.997967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37c49aed-8e60-4d7a-9fd4-aef85c9cfb4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:49.998453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37c49aed-8e60-4d7a-9fd4-aef85c9cfb4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:49.998895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37c49aed-8e60-4d7a-9fd4-aef85c9cfb4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:49.999581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37c49aed-8e60-4d7a-9fd4-aef85c9cfb4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:50.000062 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37c49aed-8e60-4d7a-9fd4-aef85c9cfb4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:50.000491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37c49aed-8e60-4d7a-9fd4-aef85c9cfb4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:50.129701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-37c49aed-8e60-4d7a-9fd4-aef85c9cfb4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:50.138473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-37c49aed-8e60-4d7a-9fd4-aef85c9cfb4d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151931 Oct 28 20:29:50.139033 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1442/2888] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:49 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:51.162901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-56e78463-cc92-42e8-b47a-cae69ca85337 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:51.163545 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-56e78463-cc92-42e8-b47a-cae69ca85337 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:51.170431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56e78463-cc92-42e8-b47a-cae69ca85337 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:51.170918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56e78463-cc92-42e8-b47a-cae69ca85337 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:51.171358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56e78463-cc92-42e8-b47a-cae69ca85337 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:51.172049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56e78463-cc92-42e8-b47a-cae69ca85337 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:51.172506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56e78463-cc92-42e8-b47a-cae69ca85337 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:51.172931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56e78463-cc92-42e8-b47a-cae69ca85337 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:51.304845 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-56e78463-cc92-42e8-b47a-cae69ca85337 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:51.314033 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-56e78463-cc92-42e8-b47a-cae69ca85337 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155008 Oct 28 20:29:51.314606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1447/2889] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:51 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:52.337817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81eb6676-ce01-49f5-a334-466a16b7ee2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:52.338372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-81eb6676-ce01-49f5-a334-466a16b7ee2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:52.345001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81eb6676-ce01-49f5-a334-466a16b7ee2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:52.345525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81eb6676-ce01-49f5-a334-466a16b7ee2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:52.345968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81eb6676-ce01-49f5-a334-466a16b7ee2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:52.346646 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81eb6676-ce01-49f5-a334-466a16b7ee2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:52.347094 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81eb6676-ce01-49f5-a334-466a16b7ee2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:52.347513 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81eb6676-ce01-49f5-a334-466a16b7ee2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:52.473721 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-81eb6676-ce01-49f5-a334-466a16b7ee2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:52.482873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-81eb6676-ce01-49f5-a334-466a16b7ee2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148970 Oct 28 20:29:52.483444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1443/2890] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:52 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:53.507333 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-da48a759-50ad-4de5-acbe-b7412f3c0533 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:53.507925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-da48a759-50ad-4de5-acbe-b7412f3c0533 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:53.514892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da48a759-50ad-4de5-acbe-b7412f3c0533 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:53.517065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da48a759-50ad-4de5-acbe-b7412f3c0533 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:53.517065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da48a759-50ad-4de5-acbe-b7412f3c0533 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:53.517065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da48a759-50ad-4de5-acbe-b7412f3c0533 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:53.517065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da48a759-50ad-4de5-acbe-b7412f3c0533 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:53.517527 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da48a759-50ad-4de5-acbe-b7412f3c0533 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:53.652788 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-da48a759-50ad-4de5-acbe-b7412f3c0533 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:53.660839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-da48a759-50ad-4de5-acbe-b7412f3c0533 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.157541 Oct 28 20:29:53.661429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1448/2891] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:53 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:54.683944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d20cd182-baa2-40a5-83e5-7e87fcc85b7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:54.684563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d20cd182-baa2-40a5-83e5-7e87fcc85b7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:54.690174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d20cd182-baa2-40a5-83e5-7e87fcc85b7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:54.690711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d20cd182-baa2-40a5-83e5-7e87fcc85b7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:54.691152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d20cd182-baa2-40a5-83e5-7e87fcc85b7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:54.691830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d20cd182-baa2-40a5-83e5-7e87fcc85b7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:54.692282 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d20cd182-baa2-40a5-83e5-7e87fcc85b7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:54.692704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d20cd182-baa2-40a5-83e5-7e87fcc85b7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:54.822338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d20cd182-baa2-40a5-83e5-7e87fcc85b7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:54.831347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d20cd182-baa2-40a5-83e5-7e87fcc85b7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151679 Oct 28 20:29:54.831911 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1444/2892] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:54 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:55.855528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-25102662-f713-44e1-8f20-fe03120997ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:55.856162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-25102662-f713-44e1-8f20-fe03120997ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:55.862489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25102662-f713-44e1-8f20-fe03120997ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:55.862962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25102662-f713-44e1-8f20-fe03120997ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:55.863393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25102662-f713-44e1-8f20-fe03120997ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:55.864064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25102662-f713-44e1-8f20-fe03120997ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:55.864511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25102662-f713-44e1-8f20-fe03120997ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:55.864926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25102662-f713-44e1-8f20-fe03120997ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:55.992756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-25102662-f713-44e1-8f20-fe03120997ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:56.001719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-25102662-f713-44e1-8f20-fe03120997ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150063 Oct 28 20:29:56.002292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1449/2893] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:55 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:57.026008 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef3ce457-7465-4121-bf05-a3be9cfee18b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:57.026618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef3ce457-7465-4121-bf05-a3be9cfee18b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:57.033345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef3ce457-7465-4121-bf05-a3be9cfee18b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:57.033846 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef3ce457-7465-4121-bf05-a3be9cfee18b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:57.034280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef3ce457-7465-4121-bf05-a3be9cfee18b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:57.034957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef3ce457-7465-4121-bf05-a3be9cfee18b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:57.035407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef3ce457-7465-4121-bf05-a3be9cfee18b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:57.035827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef3ce457-7465-4121-bf05-a3be9cfee18b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:57.167689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ef3ce457-7465-4121-bf05-a3be9cfee18b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:57.176712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ef3ce457-7465-4121-bf05-a3be9cfee18b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154503 Oct 28 20:29:57.177279 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1445/2894] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:57 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:58.200686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f27eee8d-a07d-43ab-a388-4ff2690388d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:58.201351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f27eee8d-a07d-43ab-a388-4ff2690388d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:58.207647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f27eee8d-a07d-43ab-a388-4ff2690388d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:58.208126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f27eee8d-a07d-43ab-a388-4ff2690388d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:58.208604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f27eee8d-a07d-43ab-a388-4ff2690388d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:58.209282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f27eee8d-a07d-43ab-a388-4ff2690388d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:58.209760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f27eee8d-a07d-43ab-a388-4ff2690388d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:58.210179 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f27eee8d-a07d-43ab-a388-4ff2690388d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:58.337156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f27eee8d-a07d-43ab-a388-4ff2690388d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:58.345372 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f27eee8d-a07d-43ab-a388-4ff2690388d3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149132 Oct 28 20:29:58.345931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1450/2895] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:58 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:59.370165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-21f10dac-2a13-46a0-8887-0f2747afffe7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:59.370707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-21f10dac-2a13-46a0-8887-0f2747afffe7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:59.377769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21f10dac-2a13-46a0-8887-0f2747afffe7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:59.378257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21f10dac-2a13-46a0-8887-0f2747afffe7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:59.378695 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21f10dac-2a13-46a0-8887-0f2747afffe7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:59.379385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21f10dac-2a13-46a0-8887-0f2747afffe7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:59.379837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21f10dac-2a13-46a0-8887-0f2747afffe7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:59.380263 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21f10dac-2a13-46a0-8887-0f2747afffe7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:59.510330 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-21f10dac-2a13-46a0-8887-0f2747afffe7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:59.519106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-21f10dac-2a13-46a0-8887-0f2747afffe7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152867 Oct 28 20:29:59.519771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1446/2896] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:59 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:00.543112 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dbba0b8e-2b11-47b9-8ee1-11301defc839 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:00.545540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dbba0b8e-2b11-47b9-8ee1-11301defc839 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:00.555591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbba0b8e-2b11-47b9-8ee1-11301defc839 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:00.556212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbba0b8e-2b11-47b9-8ee1-11301defc839 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:00.556517 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbba0b8e-2b11-47b9-8ee1-11301defc839 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:00.557364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbba0b8e-2b11-47b9-8ee1-11301defc839 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:00.557827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbba0b8e-2b11-47b9-8ee1-11301defc839 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:00.558256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbba0b8e-2b11-47b9-8ee1-11301defc839 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:00.717766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dbba0b8e-2b11-47b9-8ee1-11301defc839 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:00.730198 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dbba0b8e-2b11-47b9-8ee1-11301defc839 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.190608 Oct 28 20:30:00.731648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1451/2897] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:00 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:01.755472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bcaf703d-7a19-4be1-b5ba-4290b1da85f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:01.756087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bcaf703d-7a19-4be1-b5ba-4290b1da85f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:01.763055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcaf703d-7a19-4be1-b5ba-4290b1da85f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:01.763531 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcaf703d-7a19-4be1-b5ba-4290b1da85f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:01.763987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcaf703d-7a19-4be1-b5ba-4290b1da85f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:01.764691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcaf703d-7a19-4be1-b5ba-4290b1da85f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:01.765140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcaf703d-7a19-4be1-b5ba-4290b1da85f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:01.765592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcaf703d-7a19-4be1-b5ba-4290b1da85f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:01.893755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bcaf703d-7a19-4be1-b5ba-4290b1da85f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:01.901931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bcaf703d-7a19-4be1-b5ba-4290b1da85f4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150299 Oct 28 20:30:01.902489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1447/2898] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:01 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:02.925606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3dca5912-25c6-46db-a323-0b37f8721d0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:02.926927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3dca5912-25c6-46db-a323-0b37f8721d0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:02.934926 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dca5912-25c6-46db-a323-0b37f8721d0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:02.936202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dca5912-25c6-46db-a323-0b37f8721d0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:02.936653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dca5912-25c6-46db-a323-0b37f8721d0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:02.937380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dca5912-25c6-46db-a323-0b37f8721d0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:02.937842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dca5912-25c6-46db-a323-0b37f8721d0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:02.938291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dca5912-25c6-46db-a323-0b37f8721d0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:02.940852 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=78 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:03.071023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3dca5912-25c6-46db-a323-0b37f8721d0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:03.079066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3dca5912-25c6-46db-a323-0b37f8721d0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.157570 Oct 28 20:30:03.079625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1452/2899] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:02 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:04.102484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a16513e-48fd-4723-8611-5518b7b00a28 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:04.103105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6a16513e-48fd-4723-8611-5518b7b00a28 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:04.105534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=26 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:04.110802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a16513e-48fd-4723-8611-5518b7b00a28 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:04.111281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a16513e-48fd-4723-8611-5518b7b00a28 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:04.111718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a16513e-48fd-4723-8611-5518b7b00a28 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:04.112405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a16513e-48fd-4723-8611-5518b7b00a28 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:04.112866 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a16513e-48fd-4723-8611-5518b7b00a28 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:04.113290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a16513e-48fd-4723-8611-5518b7b00a28 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:04.240111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a16513e-48fd-4723-8611-5518b7b00a28 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:04.248681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a16513e-48fd-4723-8611-5518b7b00a28 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150331 Oct 28 20:30:04.249248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1448/2900] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:04 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:05.272194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4bfc229d-1564-4242-9acc-da6bab595293 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:05.272815 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4bfc229d-1564-4242-9acc-da6bab595293 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:05.275235 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=26 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:05.280728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4bfc229d-1564-4242-9acc-da6bab595293 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:05.281256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4bfc229d-1564-4242-9acc-da6bab595293 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:05.281671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4bfc229d-1564-4242-9acc-da6bab595293 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:05.282357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4bfc229d-1564-4242-9acc-da6bab595293 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:05.282810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4bfc229d-1564-4242-9acc-da6bab595293 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:05.283234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4bfc229d-1564-4242-9acc-da6bab595293 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:05.414682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4bfc229d-1564-4242-9acc-da6bab595293 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:05.422829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4bfc229d-1564-4242-9acc-da6bab595293 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154572 Oct 28 20:30:05.423393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1453/2901] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:05 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:06.445614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b56cb854-01f3-4aad-aa1d-ecec7155b940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:06.446271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b56cb854-01f3-4aad-aa1d-ecec7155b940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:06.454105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b56cb854-01f3-4aad-aa1d-ecec7155b940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:06.454592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b56cb854-01f3-4aad-aa1d-ecec7155b940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:06.455032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b56cb854-01f3-4aad-aa1d-ecec7155b940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:06.455718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b56cb854-01f3-4aad-aa1d-ecec7155b940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:06.456175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b56cb854-01f3-4aad-aa1d-ecec7155b940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:06.456599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b56cb854-01f3-4aad-aa1d-ecec7155b940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:06.459141 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=84 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:06.583853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b56cb854-01f3-4aad-aa1d-ecec7155b940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:06.592401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b56cb854-01f3-4aad-aa1d-ecec7155b940 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150679 Oct 28 20:30:06.592983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1449/2902] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:06 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:07.617132 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0acbcd32-6992-4823-8dae-f0172e5da02e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:07.617762 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0acbcd32-6992-4823-8dae-f0172e5da02e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:07.625256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0acbcd32-6992-4823-8dae-f0172e5da02e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:07.625767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0acbcd32-6992-4823-8dae-f0172e5da02e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:07.626203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0acbcd32-6992-4823-8dae-f0172e5da02e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:07.626896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0acbcd32-6992-4823-8dae-f0172e5da02e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:07.627353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0acbcd32-6992-4823-8dae-f0172e5da02e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:07.627779 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0acbcd32-6992-4823-8dae-f0172e5da02e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:07.760242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0acbcd32-6992-4823-8dae-f0172e5da02e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:07.768950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0acbcd32-6992-4823-8dae-f0172e5da02e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155744 Oct 28 20:30:07.769538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1454/2903] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:07 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:08.792821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ed4e28a1-ef19-4933-80ca-148f8a3feda1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:08.793668 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ed4e28a1-ef19-4933-80ca-148f8a3feda1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:08.800224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed4e28a1-ef19-4933-80ca-148f8a3feda1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:08.804936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed4e28a1-ef19-4933-80ca-148f8a3feda1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:08.804936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed4e28a1-ef19-4933-80ca-148f8a3feda1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:08.804936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed4e28a1-ef19-4933-80ca-148f8a3feda1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:08.804936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed4e28a1-ef19-4933-80ca-148f8a3feda1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:08.805408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed4e28a1-ef19-4933-80ca-148f8a3feda1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:08.933242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ed4e28a1-ef19-4933-80ca-148f8a3feda1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:08.941517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ed4e28a1-ef19-4933-80ca-148f8a3feda1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152544 Oct 28 20:30:08.942079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1450/2904] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:08 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:09.966876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f06e1689-ab62-49f0-9247-9ccb8fb57bbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:09.967488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f06e1689-ab62-49f0-9247-9ccb8fb57bbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:09.974217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f06e1689-ab62-49f0-9247-9ccb8fb57bbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:09.974692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f06e1689-ab62-49f0-9247-9ccb8fb57bbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:09.975122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f06e1689-ab62-49f0-9247-9ccb8fb57bbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:09.975795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f06e1689-ab62-49f0-9247-9ccb8fb57bbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:09.976242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f06e1689-ab62-49f0-9247-9ccb8fb57bbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:09.976666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f06e1689-ab62-49f0-9247-9ccb8fb57bbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:10.104804 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f06e1689-ab62-49f0-9247-9ccb8fb57bbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:10.113577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f06e1689-ab62-49f0-9247-9ccb8fb57bbb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150711 Oct 28 20:30:10.114139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1455/2905] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:09 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:11.138183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-12677bfb-11fd-45cd-9a4e-cde5b63d9737 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:11.138823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-12677bfb-11fd-45cd-9a4e-cde5b63d9737 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:11.145232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12677bfb-11fd-45cd-9a4e-cde5b63d9737 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:11.145734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12677bfb-11fd-45cd-9a4e-cde5b63d9737 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:11.146166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12677bfb-11fd-45cd-9a4e-cde5b63d9737 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:11.146838 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12677bfb-11fd-45cd-9a4e-cde5b63d9737 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:11.147281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12677bfb-11fd-45cd-9a4e-cde5b63d9737 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:11.147698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12677bfb-11fd-45cd-9a4e-cde5b63d9737 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:11.277298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-12677bfb-11fd-45cd-9a4e-cde5b63d9737 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:11.286052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-12677bfb-11fd-45cd-9a4e-cde5b63d9737 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151845 Oct 28 20:30:11.286561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1451/2906] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:11 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:12.311184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ec9c2aec-3045-44b8-9c93-8b87a94f4251 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:12.311742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ec9c2aec-3045-44b8-9c93-8b87a94f4251 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:12.318197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec9c2aec-3045-44b8-9c93-8b87a94f4251 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:12.318680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec9c2aec-3045-44b8-9c93-8b87a94f4251 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:12.319119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec9c2aec-3045-44b8-9c93-8b87a94f4251 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:12.319800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec9c2aec-3045-44b8-9c93-8b87a94f4251 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:12.320250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec9c2aec-3045-44b8-9c93-8b87a94f4251 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:12.320677 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec9c2aec-3045-44b8-9c93-8b87a94f4251 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:12.447561 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ec9c2aec-3045-44b8-9c93-8b87a94f4251 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:12.456845 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ec9c2aec-3045-44b8-9c93-8b87a94f4251 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150367 Oct 28 20:30:12.457424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1456/2907] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:12 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:13.480242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f8096a61-ed1b-4f9b-9619-10548c88d002 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:13.486636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f8096a61-ed1b-4f9b-9619-10548c88d002 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:13.487798 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8096a61-ed1b-4f9b-9619-10548c88d002 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:13.488280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8096a61-ed1b-4f9b-9619-10548c88d002 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:13.488717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8096a61-ed1b-4f9b-9619-10548c88d002 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:13.489425 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8096a61-ed1b-4f9b-9619-10548c88d002 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:13.489884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8096a61-ed1b-4f9b-9619-10548c88d002 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:13.490305 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8096a61-ed1b-4f9b-9619-10548c88d002 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:13.628391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f8096a61-ed1b-4f9b-9619-10548c88d002 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:13.636547 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f8096a61-ed1b-4f9b-9619-10548c88d002 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.160159 Oct 28 20:30:13.637627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1452/2908] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:13 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:14.660144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1df50ac-56c5-490e-8af9-c6dfe277d430 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:14.660789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f1df50ac-56c5-490e-8af9-c6dfe277d430 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:14.667131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1df50ac-56c5-490e-8af9-c6dfe277d430 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:14.667616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1df50ac-56c5-490e-8af9-c6dfe277d430 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:14.668057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1df50ac-56c5-490e-8af9-c6dfe277d430 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:14.668898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1df50ac-56c5-490e-8af9-c6dfe277d430 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:14.669377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1df50ac-56c5-490e-8af9-c6dfe277d430 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:14.669809 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1df50ac-56c5-490e-8af9-c6dfe277d430 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:14.798777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1df50ac-56c5-490e-8af9-c6dfe277d430 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:14.806846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1df50ac-56c5-490e-8af9-c6dfe277d430 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150644 Oct 28 20:30:14.807414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1457/2909] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:14 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:15.831529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-365ec993-9ddd-4364-8c59-0565680e783a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:15.832146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-365ec993-9ddd-4364-8c59-0565680e783a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:15.838461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-365ec993-9ddd-4364-8c59-0565680e783a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:15.838948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-365ec993-9ddd-4364-8c59-0565680e783a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:15.839386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-365ec993-9ddd-4364-8c59-0565680e783a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:15.840089 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-365ec993-9ddd-4364-8c59-0565680e783a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:15.841133 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-365ec993-9ddd-4364-8c59-0565680e783a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:15.841593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-365ec993-9ddd-4364-8c59-0565680e783a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:15.965968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-365ec993-9ddd-4364-8c59-0565680e783a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:15.974318 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-365ec993-9ddd-4364-8c59-0565680e783a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.146713 Oct 28 20:30:15.974877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1453/2910] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:15 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:16.999149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fbb34dd1-c268-4dd7-8e8f-af04fa7a39a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:16.999749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fbb34dd1-c268-4dd7-8e8f-af04fa7a39a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:17.005764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbb34dd1-c268-4dd7-8e8f-af04fa7a39a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:17.006237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbb34dd1-c268-4dd7-8e8f-af04fa7a39a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:17.006664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbb34dd1-c268-4dd7-8e8f-af04fa7a39a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:17.007334 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbb34dd1-c268-4dd7-8e8f-af04fa7a39a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:17.007781 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbb34dd1-c268-4dd7-8e8f-af04fa7a39a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:17.008195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbb34dd1-c268-4dd7-8e8f-af04fa7a39a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:17.137894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fbb34dd1-c268-4dd7-8e8f-af04fa7a39a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:17.145973 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fbb34dd1-c268-4dd7-8e8f-af04fa7a39a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151340 Oct 28 20:30:17.146545 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1458/2911] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:16 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:18.170928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84f4192a-b571-4559-8168-13f003975705 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:18.171577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-84f4192a-b571-4559-8168-13f003975705 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:18.178075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f4192a-b571-4559-8168-13f003975705 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:18.178563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f4192a-b571-4559-8168-13f003975705 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:18.179001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f4192a-b571-4559-8168-13f003975705 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:18.179746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f4192a-b571-4559-8168-13f003975705 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:18.180208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f4192a-b571-4559-8168-13f003975705 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:18.180633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f4192a-b571-4559-8168-13f003975705 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:18.326117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-84f4192a-b571-4559-8168-13f003975705 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:18.326722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-84f4192a-b571-4559-8168-13f003975705 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.160548 Oct 28 20:30:18.327489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1454/2912] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:18 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:19.350822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f4d1c59d-cb25-4beb-b960-ce3acbe3d1db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:19.351377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f4d1c59d-cb25-4beb-b960-ce3acbe3d1db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:19.357788 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4d1c59d-cb25-4beb-b960-ce3acbe3d1db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:19.358273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4d1c59d-cb25-4beb-b960-ce3acbe3d1db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:19.358709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4d1c59d-cb25-4beb-b960-ce3acbe3d1db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:19.359387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4d1c59d-cb25-4beb-b960-ce3acbe3d1db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:19.359839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4d1c59d-cb25-4beb-b960-ce3acbe3d1db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:19.360263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4d1c59d-cb25-4beb-b960-ce3acbe3d1db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:19.744709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f4d1c59d-cb25-4beb-b960-ce3acbe3d1db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:19.752871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f4d1c59d-cb25-4beb-b960-ce3acbe3d1db tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.406238 Oct 28 20:30:19.753464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1459/2913] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:19 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:20.776549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5e4f7288-1b3a-4f4b-b566-06576ea968da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:20.777160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5e4f7288-1b3a-4f4b-b566-06576ea968da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:20.784302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e4f7288-1b3a-4f4b-b566-06576ea968da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:20.784792 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e4f7288-1b3a-4f4b-b566-06576ea968da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:20.785233 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e4f7288-1b3a-4f4b-b566-06576ea968da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:20.785946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e4f7288-1b3a-4f4b-b566-06576ea968da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:20.786404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e4f7288-1b3a-4f4b-b566-06576ea968da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:20.786830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e4f7288-1b3a-4f4b-b566-06576ea968da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:20.912571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5e4f7288-1b3a-4f4b-b566-06576ea968da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:20.921291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5e4f7288-1b3a-4f4b-b566-06576ea968da tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148624 Oct 28 20:30:20.921880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1455/2914] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:20 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:21.945303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-01069441-e02f-4f66-9964-940aa306bc2b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:21.946023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-01069441-e02f-4f66-9964-940aa306bc2b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:21.955883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01069441-e02f-4f66-9964-940aa306bc2b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:21.956378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01069441-e02f-4f66-9964-940aa306bc2b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:21.956817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01069441-e02f-4f66-9964-940aa306bc2b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:21.957532 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01069441-e02f-4f66-9964-940aa306bc2b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:21.958081 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01069441-e02f-4f66-9964-940aa306bc2b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:21.958502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01069441-e02f-4f66-9964-940aa306bc2b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:22.108390 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-01069441-e02f-4f66-9964-940aa306bc2b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:22.118191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-01069441-e02f-4f66-9964-940aa306bc2b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.176804 Oct 28 20:30:22.118967 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1460/2915] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:21 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:23.143285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5d2a23bd-d9d8-4271-9392-63d071331b10 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:23.143902 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5d2a23bd-d9d8-4271-9392-63d071331b10 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:23.150429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d2a23bd-d9d8-4271-9392-63d071331b10 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:23.150917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d2a23bd-d9d8-4271-9392-63d071331b10 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:23.151361 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d2a23bd-d9d8-4271-9392-63d071331b10 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:23.152133 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d2a23bd-d9d8-4271-9392-63d071331b10 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:23.152592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d2a23bd-d9d8-4271-9392-63d071331b10 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:23.153014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d2a23bd-d9d8-4271-9392-63d071331b10 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:23.281885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5d2a23bd-d9d8-4271-9392-63d071331b10 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:23.289913 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5d2a23bd-d9d8-4271-9392-63d071331b10 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151173 Oct 28 20:30:23.290473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1456/2916] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:23 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:24.313421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ab4b0ab2-a4f8-4a70-8074-a6bd3e659eac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:24.314091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ab4b0ab2-a4f8-4a70-8074-a6bd3e659eac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:24.320825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab4b0ab2-a4f8-4a70-8074-a6bd3e659eac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:24.321349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab4b0ab2-a4f8-4a70-8074-a6bd3e659eac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:24.321791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab4b0ab2-a4f8-4a70-8074-a6bd3e659eac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:24.322480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab4b0ab2-a4f8-4a70-8074-a6bd3e659eac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:24.322950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab4b0ab2-a4f8-4a70-8074-a6bd3e659eac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:24.323357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab4b0ab2-a4f8-4a70-8074-a6bd3e659eac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:24.501390 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ab4b0ab2-a4f8-4a70-8074-a6bd3e659eac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:24.509419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ab4b0ab2-a4f8-4a70-8074-a6bd3e659eac tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.200047 Oct 28 20:30:24.509980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1461/2917] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:24 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:25.533929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-23f03885-b0fc-4138-97cb-1f143de399ea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:25.534560 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-23f03885-b0fc-4138-97cb-1f143de399ea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:25.540462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23f03885-b0fc-4138-97cb-1f143de399ea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:25.540941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23f03885-b0fc-4138-97cb-1f143de399ea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:25.541396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23f03885-b0fc-4138-97cb-1f143de399ea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:25.547220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23f03885-b0fc-4138-97cb-1f143de399ea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:25.547220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23f03885-b0fc-4138-97cb-1f143de399ea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:25.547220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23f03885-b0fc-4138-97cb-1f143de399ea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:25.674561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-23f03885-b0fc-4138-97cb-1f143de399ea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:25.682825 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-23f03885-b0fc-4138-97cb-1f143de399ea tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153500 Oct 28 20:30:25.683388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1457/2918] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:25 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:26.708690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-996808ec-e9b4-49e8-a8a6-355707843adf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:26.709345 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-996808ec-e9b4-49e8-a8a6-355707843adf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:26.715821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-996808ec-e9b4-49e8-a8a6-355707843adf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:26.716306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-996808ec-e9b4-49e8-a8a6-355707843adf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:26.716745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-996808ec-e9b4-49e8-a8a6-355707843adf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:26.718570 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-996808ec-e9b4-49e8-a8a6-355707843adf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:26.719031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-996808ec-e9b4-49e8-a8a6-355707843adf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:26.719460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-996808ec-e9b4-49e8-a8a6-355707843adf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:26.849216 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-996808ec-e9b4-49e8-a8a6-355707843adf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:26.857291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-996808ec-e9b4-49e8-a8a6-355707843adf tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155737 Oct 28 20:30:26.860427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1462/2919] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:26 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:27.882620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b6507990-4a63-40cd-8eb6-752884aaa67a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:27.883238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b6507990-4a63-40cd-8eb6-752884aaa67a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:27.889415 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6507990-4a63-40cd-8eb6-752884aaa67a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:27.889859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6507990-4a63-40cd-8eb6-752884aaa67a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:27.890294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6507990-4a63-40cd-8eb6-752884aaa67a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:27.890977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6507990-4a63-40cd-8eb6-752884aaa67a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:27.891426 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6507990-4a63-40cd-8eb6-752884aaa67a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:27.891844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6507990-4a63-40cd-8eb6-752884aaa67a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:28.025841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b6507990-4a63-40cd-8eb6-752884aaa67a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:28.034096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b6507990-4a63-40cd-8eb6-752884aaa67a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155462 Oct 28 20:30:28.034682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1458/2920] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:27 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:29.058229 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fbd944a0-1bdb-4da6-8de9-c377474dd63b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:29.058871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fbd944a0-1bdb-4da6-8de9-c377474dd63b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:29.065439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd944a0-1bdb-4da6-8de9-c377474dd63b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:29.065922 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd944a0-1bdb-4da6-8de9-c377474dd63b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:29.066357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd944a0-1bdb-4da6-8de9-c377474dd63b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:29.067038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd944a0-1bdb-4da6-8de9-c377474dd63b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:29.067490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd944a0-1bdb-4da6-8de9-c377474dd63b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:29.067914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd944a0-1bdb-4da6-8de9-c377474dd63b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:29.194949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fbd944a0-1bdb-4da6-8de9-c377474dd63b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:29.203833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fbd944a0-1bdb-4da6-8de9-c377474dd63b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149413 Oct 28 20:30:29.208563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1463/2921] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:29 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:30.227757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a241420d-9f34-45e9-84e8-4451fee39cc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:30.228413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a241420d-9f34-45e9-84e8-4451fee39cc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:30.235436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a241420d-9f34-45e9-84e8-4451fee39cc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:30.235934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a241420d-9f34-45e9-84e8-4451fee39cc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:30.236403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a241420d-9f34-45e9-84e8-4451fee39cc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:30.237074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a241420d-9f34-45e9-84e8-4451fee39cc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:30.237561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a241420d-9f34-45e9-84e8-4451fee39cc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:30.238000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a241420d-9f34-45e9-84e8-4451fee39cc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:30.528982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a241420d-9f34-45e9-84e8-4451fee39cc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:30.537578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a241420d-9f34-45e9-84e8-4451fee39cc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.313843 Oct 28 20:30:30.538144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1459/2922] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:30 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:31.560929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b5432a13-d12a-4ad3-b3d0-17efd5cd7112 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:31.561587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b5432a13-d12a-4ad3-b3d0-17efd5cd7112 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:31.567977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5432a13-d12a-4ad3-b3d0-17efd5cd7112 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:31.568515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5432a13-d12a-4ad3-b3d0-17efd5cd7112 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:31.568896 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5432a13-d12a-4ad3-b3d0-17efd5cd7112 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:31.569604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5432a13-d12a-4ad3-b3d0-17efd5cd7112 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:31.570059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5432a13-d12a-4ad3-b3d0-17efd5cd7112 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:31.570485 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5432a13-d12a-4ad3-b3d0-17efd5cd7112 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:31.703045 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b5432a13-d12a-4ad3-b3d0-17efd5cd7112 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:31.711280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b5432a13-d12a-4ad3-b3d0-17efd5cd7112 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154214 Oct 28 20:30:31.711846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1464/2923] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:31 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:32.736540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d82430c8-31cb-4344-b224-029669f2baad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:32.737157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d82430c8-31cb-4344-b224-029669f2baad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:32.743680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d82430c8-31cb-4344-b224-029669f2baad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:32.744173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d82430c8-31cb-4344-b224-029669f2baad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:32.744614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d82430c8-31cb-4344-b224-029669f2baad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:32.745303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d82430c8-31cb-4344-b224-029669f2baad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:32.745780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d82430c8-31cb-4344-b224-029669f2baad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:32.746209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d82430c8-31cb-4344-b224-029669f2baad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:32.874350 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d82430c8-31cb-4344-b224-029669f2baad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:32.882442 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d82430c8-31cb-4344-b224-029669f2baad tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150443 Oct 28 20:30:32.883007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1460/2924] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:32 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:33.906623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c3869332-5e54-41fc-ba70-729bf1a0479d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:33.907382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c3869332-5e54-41fc-ba70-729bf1a0479d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:33.913889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3869332-5e54-41fc-ba70-729bf1a0479d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:33.914375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3869332-5e54-41fc-ba70-729bf1a0479d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:33.914811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3869332-5e54-41fc-ba70-729bf1a0479d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:33.915499 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3869332-5e54-41fc-ba70-729bf1a0479d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:33.915959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3869332-5e54-41fc-ba70-729bf1a0479d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:33.916384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3869332-5e54-41fc-ba70-729bf1a0479d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:33.918962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=78 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:34.052497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c3869332-5e54-41fc-ba70-729bf1a0479d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:34.061520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c3869332-5e54-41fc-ba70-729bf1a0479d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.158503 Oct 28 20:30:34.062090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1465/2925] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:33 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:35.084137 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-969505d7-44db-4767-b666-02ff254ff574 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:35.084745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-969505d7-44db-4767-b666-02ff254ff574 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:35.087194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=26 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:35.091905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-969505d7-44db-4767-b666-02ff254ff574 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:35.092455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-969505d7-44db-4767-b666-02ff254ff574 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:35.092895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-969505d7-44db-4767-b666-02ff254ff574 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:35.093691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-969505d7-44db-4767-b666-02ff254ff574 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:35.094140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-969505d7-44db-4767-b666-02ff254ff574 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:35.094560 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-969505d7-44db-4767-b666-02ff254ff574 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:35.225558 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-969505d7-44db-4767-b666-02ff254ff574 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:35.234198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-969505d7-44db-4767-b666-02ff254ff574 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154033 Oct 28 20:30:35.234772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1461/2926] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:35 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:36.258392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0364b78e-149f-4bfc-be15-110b2d997e1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:36.259042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0364b78e-149f-4bfc-be15-110b2d997e1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:36.261488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=26 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:36.266747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0364b78e-149f-4bfc-be15-110b2d997e1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:36.267225 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0364b78e-149f-4bfc-be15-110b2d997e1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:36.267657 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0364b78e-149f-4bfc-be15-110b2d997e1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:36.268339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0364b78e-149f-4bfc-be15-110b2d997e1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:36.268789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0364b78e-149f-4bfc-be15-110b2d997e1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:36.269212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0364b78e-149f-4bfc-be15-110b2d997e1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:36.405652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0364b78e-149f-4bfc-be15-110b2d997e1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:36.413860 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0364b78e-149f-4bfc-be15-110b2d997e1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.159335 Oct 28 20:30:36.414429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1466/2927] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:36 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:37.437270 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a6c3757f-7c5a-4fb0-ad67-4a40025c77dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:37.437875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a6c3757f-7c5a-4fb0-ad67-4a40025c77dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:37.444294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6c3757f-7c5a-4fb0-ad67-4a40025c77dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:37.444782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6c3757f-7c5a-4fb0-ad67-4a40025c77dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:37.445226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6c3757f-7c5a-4fb0-ad67-4a40025c77dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:37.445938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6c3757f-7c5a-4fb0-ad67-4a40025c77dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:37.446397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6c3757f-7c5a-4fb0-ad67-4a40025c77dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:37.446826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6c3757f-7c5a-4fb0-ad67-4a40025c77dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:37.449383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=78 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:37.577347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a6c3757f-7c5a-4fb0-ad67-4a40025c77dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:37.585654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a6c3757f-7c5a-4fb0-ad67-4a40025c77dc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152495 Oct 28 20:30:37.586221 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1462/2928] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:37 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:38.611769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cb269604-a0e7-4302-bac4-4ecd0a14df02 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:38.612387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cb269604-a0e7-4302-bac4-4ecd0a14df02 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:38.618875 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb269604-a0e7-4302-bac4-4ecd0a14df02 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:38.619360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb269604-a0e7-4302-bac4-4ecd0a14df02 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:38.619800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb269604-a0e7-4302-bac4-4ecd0a14df02 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:38.620489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb269604-a0e7-4302-bac4-4ecd0a14df02 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:38.620949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb269604-a0e7-4302-bac4-4ecd0a14df02 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:38.621411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb269604-a0e7-4302-bac4-4ecd0a14df02 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:38.754517 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cb269604-a0e7-4302-bac4-4ecd0a14df02 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:38.762618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cb269604-a0e7-4302-bac4-4ecd0a14df02 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155624 Oct 28 20:30:38.763189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1467/2929] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:38 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:39.786309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2aaaf153-18ff-4daf-95f5-0d0647385793 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:39.786917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2aaaf153-18ff-4daf-95f5-0d0647385793 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:39.793217 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2aaaf153-18ff-4daf-95f5-0d0647385793 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:39.793726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2aaaf153-18ff-4daf-95f5-0d0647385793 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:39.794159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2aaaf153-18ff-4daf-95f5-0d0647385793 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:39.794930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2aaaf153-18ff-4daf-95f5-0d0647385793 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:39.795548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2aaaf153-18ff-4daf-95f5-0d0647385793 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:39.795976 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2aaaf153-18ff-4daf-95f5-0d0647385793 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:39.930316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2aaaf153-18ff-4daf-95f5-0d0647385793 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:39.939310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2aaaf153-18ff-4daf-95f5-0d0647385793 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.156895 Oct 28 20:30:39.939882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1463/2930] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:39 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:40.963199 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-954cbd61-d300-4dd6-aef1-a44d53b67c55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:40.963789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-954cbd61-d300-4dd6-aef1-a44d53b67c55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:40.970886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-954cbd61-d300-4dd6-aef1-a44d53b67c55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:40.971368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-954cbd61-d300-4dd6-aef1-a44d53b67c55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:40.971814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-954cbd61-d300-4dd6-aef1-a44d53b67c55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:40.972502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-954cbd61-d300-4dd6-aef1-a44d53b67c55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:40.973191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-954cbd61-d300-4dd6-aef1-a44d53b67c55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:40.973676 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-954cbd61-d300-4dd6-aef1-a44d53b67c55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:41.099785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-954cbd61-d300-4dd6-aef1-a44d53b67c55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:41.107906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-954cbd61-d300-4dd6-aef1-a44d53b67c55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148562 Oct 28 20:30:41.108463 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1468/2931] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:40 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:42.130953 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-78b18d9c-b399-411e-b542-43d6b81c8ac9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:42.131584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-78b18d9c-b399-411e-b542-43d6b81c8ac9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:42.134001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:30:42.134135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:30:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 (ip 10.222.0.66) !!! Oct 28 20:30:42.143809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78b18d9c-b399-411e-b542-43d6b81c8ac9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:42.144656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78b18d9c-b399-411e-b542-43d6b81c8ac9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:42.145490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78b18d9c-b399-411e-b542-43d6b81c8ac9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:42.146758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78b18d9c-b399-411e-b542-43d6b81c8ac9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:42.147626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78b18d9c-b399-411e-b542-43d6b81c8ac9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:42.148422 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78b18d9c-b399-411e-b542-43d6b81c8ac9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:42.282331 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-78b18d9c-b399-411e-b542-43d6b81c8ac9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:42.290432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-78b18d9c-b399-411e-b542-43d6b81c8ac9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.163381 Oct 28 20:30:42.291013 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1464/2932] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:42 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:43.314779 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e917fcc3-cfc3-4149-8443-056f3962f1eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:43.315310 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e917fcc3-cfc3-4149-8443-056f3962f1eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:43.321546 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e917fcc3-cfc3-4149-8443-056f3962f1eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:43.322030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e917fcc3-cfc3-4149-8443-056f3962f1eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:43.322476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e917fcc3-cfc3-4149-8443-056f3962f1eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:43.323210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e917fcc3-cfc3-4149-8443-056f3962f1eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:43.324277 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e917fcc3-cfc3-4149-8443-056f3962f1eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:43.324277 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e917fcc3-cfc3-4149-8443-056f3962f1eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:43.463626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e917fcc3-cfc3-4149-8443-056f3962f1eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:43.472279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e917fcc3-cfc3-4149-8443-056f3962f1eb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.161881 Oct 28 20:30:43.476639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1469/2933] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:43 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:44.496023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b72af075-37d4-42f5-9642-4a661613da73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:44.496699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b72af075-37d4-42f5-9642-4a661613da73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:44.503464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b72af075-37d4-42f5-9642-4a661613da73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:44.503947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b72af075-37d4-42f5-9642-4a661613da73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:44.504375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b72af075-37d4-42f5-9642-4a661613da73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:44.505057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b72af075-37d4-42f5-9642-4a661613da73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:44.505543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b72af075-37d4-42f5-9642-4a661613da73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:44.505961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b72af075-37d4-42f5-9642-4a661613da73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:44.644369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b72af075-37d4-42f5-9642-4a661613da73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:44.652967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b72af075-37d4-42f5-9642-4a661613da73 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.160696 Oct 28 20:30:44.653515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1465/2934] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:44 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:45.677230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e014b0c-cf6a-4eb7-91be-e47b3be94cc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:45.677878 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4e014b0c-cf6a-4eb7-91be-e47b3be94cc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:45.679835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:30:45.679985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:30:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 (ip 10.222.0.66) !!! Oct 28 20:30:45.692801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e014b0c-cf6a-4eb7-91be-e47b3be94cc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:45.693288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e014b0c-cf6a-4eb7-91be-e47b3be94cc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:45.693918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e014b0c-cf6a-4eb7-91be-e47b3be94cc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:45.694623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e014b0c-cf6a-4eb7-91be-e47b3be94cc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:45.695083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e014b0c-cf6a-4eb7-91be-e47b3be94cc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:45.695514 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e014b0c-cf6a-4eb7-91be-e47b3be94cc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:45.833544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e014b0c-cf6a-4eb7-91be-e47b3be94cc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:45.842542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4e014b0c-cf6a-4eb7-91be-e47b3be94cc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.168920 Oct 28 20:30:45.843206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1470/2935] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:45 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:46.867464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-938f594e-ceb2-49fd-9a89-8768381fea4f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:46.868082 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-938f594e-ceb2-49fd-9a89-8768381fea4f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:46.875782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-938f594e-ceb2-49fd-9a89-8768381fea4f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:46.876266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-938f594e-ceb2-49fd-9a89-8768381fea4f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:46.876713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-938f594e-ceb2-49fd-9a89-8768381fea4f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:46.877429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-938f594e-ceb2-49fd-9a89-8768381fea4f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:46.877888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-938f594e-ceb2-49fd-9a89-8768381fea4f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:46.878319 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-938f594e-ceb2-49fd-9a89-8768381fea4f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:47.012478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-938f594e-ceb2-49fd-9a89-8768381fea4f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:47.021881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-938f594e-ceb2-49fd-9a89-8768381fea4f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.158204 Oct 28 20:30:47.022711 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1466/2936] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:46 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:48.045001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-648b4a1a-5b3d-4cad-8a08-31a6252fbe99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:48.045644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-648b4a1a-5b3d-4cad-8a08-31a6252fbe99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:48.052551 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-648b4a1a-5b3d-4cad-8a08-31a6252fbe99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:48.053041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-648b4a1a-5b3d-4cad-8a08-31a6252fbe99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:48.053510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-648b4a1a-5b3d-4cad-8a08-31a6252fbe99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:48.054205 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-648b4a1a-5b3d-4cad-8a08-31a6252fbe99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:48.054661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-648b4a1a-5b3d-4cad-8a08-31a6252fbe99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:48.055082 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-648b4a1a-5b3d-4cad-8a08-31a6252fbe99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:48.195236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-648b4a1a-5b3d-4cad-8a08-31a6252fbe99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:48.205939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-648b4a1a-5b3d-4cad-8a08-31a6252fbe99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.164793 Oct 28 20:30:48.206807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1471/2937] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:48 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:49.231400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7504852f-ec0d-4d34-be3a-aa481a99d598 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:49.232045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7504852f-ec0d-4d34-be3a-aa481a99d598 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:49.239561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7504852f-ec0d-4d34-be3a-aa481a99d598 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:49.240055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7504852f-ec0d-4d34-be3a-aa481a99d598 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:49.240497 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7504852f-ec0d-4d34-be3a-aa481a99d598 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:49.241196 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7504852f-ec0d-4d34-be3a-aa481a99d598 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:49.241677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7504852f-ec0d-4d34-be3a-aa481a99d598 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:49.242107 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7504852f-ec0d-4d34-be3a-aa481a99d598 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:49.375445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7504852f-ec0d-4d34-be3a-aa481a99d598 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:49.383841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7504852f-ec0d-4d34-be3a-aa481a99d598 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.156434 Oct 28 20:30:49.384629 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1467/2938] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:49 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:50.407373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5db10c9c-7bc6-4d14-9839-150163c4b4bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:50.407943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5db10c9c-7bc6-4d14-9839-150163c4b4bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:50.414363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5db10c9c-7bc6-4d14-9839-150163c4b4bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:50.414849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5db10c9c-7bc6-4d14-9839-150163c4b4bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:50.415284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5db10c9c-7bc6-4d14-9839-150163c4b4bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:50.415972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5db10c9c-7bc6-4d14-9839-150163c4b4bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:50.416425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5db10c9c-7bc6-4d14-9839-150163c4b4bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:50.416854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5db10c9c-7bc6-4d14-9839-150163c4b4bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:50.558519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5db10c9c-7bc6-4d14-9839-150163c4b4bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:50.558519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5db10c9c-7bc6-4d14-9839-150163c4b4bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154772 Oct 28 20:30:50.558519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1472/2939] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:50 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:51.582321 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-216f0ee3-712a-4668-8223-76efbf71086e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:51.582939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-216f0ee3-712a-4668-8223-76efbf71086e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:51.589644 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-216f0ee3-712a-4668-8223-76efbf71086e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:51.590135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-216f0ee3-712a-4668-8223-76efbf71086e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:51.590579 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-216f0ee3-712a-4668-8223-76efbf71086e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:51.591270 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-216f0ee3-712a-4668-8223-76efbf71086e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:51.591722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-216f0ee3-712a-4668-8223-76efbf71086e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:51.592147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-216f0ee3-712a-4668-8223-76efbf71086e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:51.754417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-216f0ee3-712a-4668-8223-76efbf71086e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:51.769190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-216f0ee3-712a-4668-8223-76efbf71086e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.190488 Oct 28 20:30:51.770090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1468/2940] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:51 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:52.797487 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fa368f6e-7af2-4bcf-884a-f6ffca3d3560 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:52.798086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fa368f6e-7af2-4bcf-884a-f6ffca3d3560 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:52.804511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa368f6e-7af2-4bcf-884a-f6ffca3d3560 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:52.804988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa368f6e-7af2-4bcf-884a-f6ffca3d3560 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:52.805454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa368f6e-7af2-4bcf-884a-f6ffca3d3560 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:52.806134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa368f6e-7af2-4bcf-884a-f6ffca3d3560 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:52.806585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa368f6e-7af2-4bcf-884a-f6ffca3d3560 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:52.807007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa368f6e-7af2-4bcf-884a-f6ffca3d3560 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:52.939855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fa368f6e-7af2-4bcf-884a-f6ffca3d3560 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:52.948396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fa368f6e-7af2-4bcf-884a-f6ffca3d3560 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155298 Oct 28 20:30:52.948964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1473/2941] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:52 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:53.972411 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cb466e19-9053-4116-98e7-248b8c80e680 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:53.972815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cb466e19-9053-4116-98e7-248b8c80e680 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:53.979551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb466e19-9053-4116-98e7-248b8c80e680 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:53.980040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb466e19-9053-4116-98e7-248b8c80e680 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:53.980481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb466e19-9053-4116-98e7-248b8c80e680 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:53.981176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb466e19-9053-4116-98e7-248b8c80e680 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:53.981663 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb466e19-9053-4116-98e7-248b8c80e680 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:53.982099 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb466e19-9053-4116-98e7-248b8c80e680 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:54.114692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-cb466e19-9053-4116-98e7-248b8c80e680 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:54.122930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cb466e19-9053-4116-98e7-248b8c80e680 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154767 Oct 28 20:30:54.123493 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1469/2942] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:53 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:55.146246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fab0b668-a01e-46c9-a04a-7e56d519525b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:55.146853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fab0b668-a01e-46c9-a04a-7e56d519525b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:55.153274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab0b668-a01e-46c9-a04a-7e56d519525b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:55.153804 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab0b668-a01e-46c9-a04a-7e56d519525b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:55.154241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab0b668-a01e-46c9-a04a-7e56d519525b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:55.154907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab0b668-a01e-46c9-a04a-7e56d519525b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:55.155353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab0b668-a01e-46c9-a04a-7e56d519525b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:55.156384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab0b668-a01e-46c9-a04a-7e56d519525b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:55.281497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fab0b668-a01e-46c9-a04a-7e56d519525b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:55.289532 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fab0b668-a01e-46c9-a04a-7e56d519525b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.147023 Oct 28 20:30:55.290029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1474/2943] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:55 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:56.311588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a29bb92-9288-4a89-a00d-c36294255281 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:56.312173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9a29bb92-9288-4a89-a00d-c36294255281 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:56.318269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a29bb92-9288-4a89-a00d-c36294255281 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:56.318750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a29bb92-9288-4a89-a00d-c36294255281 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:56.319184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a29bb92-9288-4a89-a00d-c36294255281 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:56.319862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a29bb92-9288-4a89-a00d-c36294255281 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:56.320309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a29bb92-9288-4a89-a00d-c36294255281 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:56.320729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a29bb92-9288-4a89-a00d-c36294255281 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:56.449918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9a29bb92-9288-4a89-a00d-c36294255281 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:56.458905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9a29bb92-9288-4a89-a00d-c36294255281 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151178 Oct 28 20:30:56.459461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1470/2944] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:56 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:30:57.483396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5c99da4a-5ce9-4814-a0db-1cb4acf38c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:57.484062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5c99da4a-5ce9-4814-a0db-1cb4acf38c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:57.485978 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:30:57.486116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:30:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 (ip 10.222.0.66) !!! Oct 28 20:30:57.492640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c99da4a-5ce9-4814-a0db-1cb4acf38c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:57.493122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c99da4a-5ce9-4814-a0db-1cb4acf38c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:57.493583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c99da4a-5ce9-4814-a0db-1cb4acf38c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:57.494269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c99da4a-5ce9-4814-a0db-1cb4acf38c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:57.494721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c99da4a-5ce9-4814-a0db-1cb4acf38c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:57.495148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c99da4a-5ce9-4814-a0db-1cb4acf38c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:57.623854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5c99da4a-5ce9-4814-a0db-1cb4acf38c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:57.632730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5c99da4a-5ce9-4814-a0db-1cb4acf38c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153184 Oct 28 20:30:57.633341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1475/2945] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:57 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:58.656974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-13039871-4514-4835-a5ea-45c1b861ce1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:58.657623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-13039871-4514-4835-a5ea-45c1b861ce1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:58.659734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:30:58.659871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:30:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 (ip 10.222.0.66) !!! Oct 28 20:30:58.667861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13039871-4514-4835-a5ea-45c1b861ce1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:58.668356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13039871-4514-4835-a5ea-45c1b861ce1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:58.668802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13039871-4514-4835-a5ea-45c1b861ce1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:58.669527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13039871-4514-4835-a5ea-45c1b861ce1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:58.669992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13039871-4514-4835-a5ea-45c1b861ce1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:58.670422 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13039871-4514-4835-a5ea-45c1b861ce1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:58.807351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-13039871-4514-4835-a5ea-45c1b861ce1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:58.816916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-13039871-4514-4835-a5ea-45c1b861ce1f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.164082 Oct 28 20:30:58.817530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1471/2946] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:58 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:59.840396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b098dcce-e3a8-4301-80a8-0836d19c7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:59.841011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b098dcce-e3a8-4301-80a8-0836d19c7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:59.847656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b098dcce-e3a8-4301-80a8-0836d19c7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:59.848139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b098dcce-e3a8-4301-80a8-0836d19c7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:59.848580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b098dcce-e3a8-4301-80a8-0836d19c7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:59.849266 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b098dcce-e3a8-4301-80a8-0836d19c7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:59.850007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b098dcce-e3a8-4301-80a8-0836d19c7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:59.850432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b098dcce-e3a8-4301-80a8-0836d19c7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:59.988840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b098dcce-e3a8-4301-80a8-0836d19c7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:59.997406 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b098dcce-e3a8-4301-80a8-0836d19c7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.160873 Oct 28 20:30:59.997972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1476/2947] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:59 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:01.021670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f0db92ba-0421-480a-a196-0facd60807b3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:01.022286 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f0db92ba-0421-480a-a196-0facd60807b3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:01.028766 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0db92ba-0421-480a-a196-0facd60807b3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:01.029254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0db92ba-0421-480a-a196-0facd60807b3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:01.029725 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0db92ba-0421-480a-a196-0facd60807b3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:01.030418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0db92ba-0421-480a-a196-0facd60807b3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:01.030874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0db92ba-0421-480a-a196-0facd60807b3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:01.031305 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0db92ba-0421-480a-a196-0facd60807b3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:01.158140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f0db92ba-0421-480a-a196-0facd60807b3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:01.166146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f0db92ba-0421-480a-a196-0facd60807b3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148330 Oct 28 20:31:01.166707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1472/2948] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:01 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:02.190193 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e1998dd7-c0d2-4968-8520-2233ddfad30e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:02.190801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e1998dd7-c0d2-4968-8520-2233ddfad30e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:02.197179 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1998dd7-c0d2-4968-8520-2233ddfad30e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:02.197686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1998dd7-c0d2-4968-8520-2233ddfad30e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:02.198118 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1998dd7-c0d2-4968-8520-2233ddfad30e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:02.198810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1998dd7-c0d2-4968-8520-2233ddfad30e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:02.199257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1998dd7-c0d2-4968-8520-2233ddfad30e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:02.200037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1998dd7-c0d2-4968-8520-2233ddfad30e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:02.379940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e1998dd7-c0d2-4968-8520-2233ddfad30e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:02.395309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e1998dd7-c0d2-4968-8520-2233ddfad30e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.208203 Oct 28 20:31:02.405525 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1477/2949] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:02 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:03.420075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-153e2d95-28c3-4b41-9535-35bea86b59bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:03.420811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-153e2d95-28c3-4b41-9535-35bea86b59bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:03.427285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-153e2d95-28c3-4b41-9535-35bea86b59bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:03.427776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-153e2d95-28c3-4b41-9535-35bea86b59bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:03.428238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-153e2d95-28c3-4b41-9535-35bea86b59bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:03.428934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-153e2d95-28c3-4b41-9535-35bea86b59bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:03.429412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-153e2d95-28c3-4b41-9535-35bea86b59bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:03.429843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-153e2d95-28c3-4b41-9535-35bea86b59bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:03.565500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-153e2d95-28c3-4b41-9535-35bea86b59bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:03.574677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-153e2d95-28c3-4b41-9535-35bea86b59bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.158216 Oct 28 20:31:03.575016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1473/2950] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:03 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:04.598693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-53e34bbf-4a32-4e14-9fc4-68ffed759ab6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:04.599237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-53e34bbf-4a32-4e14-9fc4-68ffed759ab6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:04.606154 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53e34bbf-4a32-4e14-9fc4-68ffed759ab6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:04.608123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53e34bbf-4a32-4e14-9fc4-68ffed759ab6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:04.608123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53e34bbf-4a32-4e14-9fc4-68ffed759ab6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:04.608123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53e34bbf-4a32-4e14-9fc4-68ffed759ab6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:04.608550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53e34bbf-4a32-4e14-9fc4-68ffed759ab6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:04.608741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53e34bbf-4a32-4e14-9fc4-68ffed759ab6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:04.613448 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=78 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:31:04.747245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-53e34bbf-4a32-4e14-9fc4-68ffed759ab6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:04.756065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-53e34bbf-4a32-4e14-9fc4-68ffed759ab6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.161943 Oct 28 20:31:04.756670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1478/2951] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:04 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:05.779696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-daa16334-acb6-4356-9229-f184dd436a5b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:05.780303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-daa16334-acb6-4356-9229-f184dd436a5b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:05.782588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=26 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:31:05.788058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daa16334-acb6-4356-9229-f184dd436a5b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:05.790185 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daa16334-acb6-4356-9229-f184dd436a5b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:05.790185 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daa16334-acb6-4356-9229-f184dd436a5b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:05.790185 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daa16334-acb6-4356-9229-f184dd436a5b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:05.790185 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daa16334-acb6-4356-9229-f184dd436a5b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:05.790675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daa16334-acb6-4356-9229-f184dd436a5b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:05.926409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-daa16334-acb6-4356-9229-f184dd436a5b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:05.934752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-daa16334-acb6-4356-9229-f184dd436a5b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.158869 Oct 28 20:31:05.935326 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1474/2952] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:05 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:06.958760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82c944d2-974f-4d2e-bef0-dc2eeb960802 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:06.959383 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-82c944d2-974f-4d2e-bef0-dc2eeb960802 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:06.961726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=26 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:31:06.966384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82c944d2-974f-4d2e-bef0-dc2eeb960802 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:06.966866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82c944d2-974f-4d2e-bef0-dc2eeb960802 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:06.967307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82c944d2-974f-4d2e-bef0-dc2eeb960802 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:06.967996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82c944d2-974f-4d2e-bef0-dc2eeb960802 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:06.968452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82c944d2-974f-4d2e-bef0-dc2eeb960802 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:06.968879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82c944d2-974f-4d2e-bef0-dc2eeb960802 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:07.105706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-82c944d2-974f-4d2e-bef0-dc2eeb960802 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:07.113817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-82c944d2-974f-4d2e-bef0-dc2eeb960802 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.159471 Oct 28 20:31:07.114383 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1479/2953] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:06 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:08.137627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7a7adb1c-c56f-4c96-b9d3-3f1eb8326e00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:08.138247 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7a7adb1c-c56f-4c96-b9d3-3f1eb8326e00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:08.145271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a7adb1c-c56f-4c96-b9d3-3f1eb8326e00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:08.145796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a7adb1c-c56f-4c96-b9d3-3f1eb8326e00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:08.146239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a7adb1c-c56f-4c96-b9d3-3f1eb8326e00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:08.146931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a7adb1c-c56f-4c96-b9d3-3f1eb8326e00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:08.147388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a7adb1c-c56f-4c96-b9d3-3f1eb8326e00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:08.147819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a7adb1c-c56f-4c96-b9d3-3f1eb8326e00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:08.150392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=78 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:31:08.276075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7a7adb1c-c56f-4c96-b9d3-3f1eb8326e00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:08.284925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7a7adb1c-c56f-4c96-b9d3-3f1eb8326e00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151144 Oct 28 20:31:08.285448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1475/2954] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:08 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:09.308134 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-37a884ac-1890-42ec-bec5-5c67b1463ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:09.308779 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-37a884ac-1890-42ec-bec5-5c67b1463ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:09.316186 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37a884ac-1890-42ec-bec5-5c67b1463ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:09.316666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37a884ac-1890-42ec-bec5-5c67b1463ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:09.317103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37a884ac-1890-42ec-bec5-5c67b1463ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:09.317817 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37a884ac-1890-42ec-bec5-5c67b1463ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:09.318273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37a884ac-1890-42ec-bec5-5c67b1463ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:09.318691 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37a884ac-1890-42ec-bec5-5c67b1463ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:09.444879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-37a884ac-1890-42ec-bec5-5c67b1463ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:09.452956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-37a884ac-1890-42ec-bec5-5c67b1463ba0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148670 Oct 28 20:31:09.453545 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1480/2955] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:09 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:10.476723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cc220101-2a43-4f5a-908e-11cd158dbb0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:10.477400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cc220101-2a43-4f5a-908e-11cd158dbb0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:10.483857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc220101-2a43-4f5a-908e-11cd158dbb0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:10.484344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc220101-2a43-4f5a-908e-11cd158dbb0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:10.484792 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc220101-2a43-4f5a-908e-11cd158dbb0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:10.485522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc220101-2a43-4f5a-908e-11cd158dbb0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:10.485982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc220101-2a43-4f5a-908e-11cd158dbb0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:10.487065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc220101-2a43-4f5a-908e-11cd158dbb0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:10.617547 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-cc220101-2a43-4f5a-908e-11cd158dbb0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:10.625543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cc220101-2a43-4f5a-908e-11cd158dbb0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152990 Oct 28 20:31:10.626102 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1476/2956] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:10 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:11.649550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e8cd692-830b-4c07-a35e-b3a18fc3cdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:11.650148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4e8cd692-830b-4c07-a35e-b3a18fc3cdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:11.656565 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8cd692-830b-4c07-a35e-b3a18fc3cdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:11.657049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8cd692-830b-4c07-a35e-b3a18fc3cdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:11.657532 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8cd692-830b-4c07-a35e-b3a18fc3cdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:11.658247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8cd692-830b-4c07-a35e-b3a18fc3cdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:11.659163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8cd692-830b-4c07-a35e-b3a18fc3cdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:11.659595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8cd692-830b-4c07-a35e-b3a18fc3cdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:11.789139 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e8cd692-830b-4c07-a35e-b3a18fc3cdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:11.797283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4e8cd692-830b-4c07-a35e-b3a18fc3cdb0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151624 Oct 28 20:31:11.797871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1481/2957] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:11 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:12.821084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-83201e93-05c2-43ac-9a61-ef4f8925e1af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:12.821715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-83201e93-05c2-43ac-9a61-ef4f8925e1af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:12.828232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83201e93-05c2-43ac-9a61-ef4f8925e1af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:12.828720 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83201e93-05c2-43ac-9a61-ef4f8925e1af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:12.829166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83201e93-05c2-43ac-9a61-ef4f8925e1af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:12.829889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83201e93-05c2-43ac-9a61-ef4f8925e1af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:12.831088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83201e93-05c2-43ac-9a61-ef4f8925e1af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:12.831596 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83201e93-05c2-43ac-9a61-ef4f8925e1af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:12.961952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-83201e93-05c2-43ac-9a61-ef4f8925e1af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:12.969970 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-83201e93-05c2-43ac-9a61-ef4f8925e1af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152819 Oct 28 20:31:12.970535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1477/2958] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:12 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:13.996280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34843e50-8142-4a8e-8308-e7acbd9bfc60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:13.996929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-34843e50-8142-4a8e-8308-e7acbd9bfc60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:14.003839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34843e50-8142-4a8e-8308-e7acbd9bfc60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:14.004324 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34843e50-8142-4a8e-8308-e7acbd9bfc60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:14.004765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34843e50-8142-4a8e-8308-e7acbd9bfc60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:14.005508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34843e50-8142-4a8e-8308-e7acbd9bfc60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:14.005965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34843e50-8142-4a8e-8308-e7acbd9bfc60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:14.006392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34843e50-8142-4a8e-8308-e7acbd9bfc60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:14.136714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-34843e50-8142-4a8e-8308-e7acbd9bfc60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:14.145562 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-34843e50-8142-4a8e-8308-e7acbd9bfc60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154341 Oct 28 20:31:14.146129 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1482/2959] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:13 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:15.169287 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ad449075-b255-43aa-a19f-336b629432a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:15.169947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ad449075-b255-43aa-a19f-336b629432a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:15.176762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad449075-b255-43aa-a19f-336b629432a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:15.177246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad449075-b255-43aa-a19f-336b629432a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:15.177706 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad449075-b255-43aa-a19f-336b629432a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:15.178387 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad449075-b255-43aa-a19f-336b629432a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:15.178840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad449075-b255-43aa-a19f-336b629432a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:15.179263 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad449075-b255-43aa-a19f-336b629432a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:15.307542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ad449075-b255-43aa-a19f-336b629432a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:15.316825 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ad449075-b255-43aa-a19f-336b629432a2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151384 Oct 28 20:31:15.317416 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1478/2960] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:15 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:16.340736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c52376a9-0b3a-4cc7-9c9d-f324c86ad95a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:16.341313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c52376a9-0b3a-4cc7-9c9d-f324c86ad95a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:16.347893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c52376a9-0b3a-4cc7-9c9d-f324c86ad95a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:16.348378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c52376a9-0b3a-4cc7-9c9d-f324c86ad95a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:16.348815 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c52376a9-0b3a-4cc7-9c9d-f324c86ad95a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:16.349534 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c52376a9-0b3a-4cc7-9c9d-f324c86ad95a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:16.350247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c52376a9-0b3a-4cc7-9c9d-f324c86ad95a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:16.350678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c52376a9-0b3a-4cc7-9c9d-f324c86ad95a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:16.477017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c52376a9-0b3a-4cc7-9c9d-f324c86ad95a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:16.485086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c52376a9-0b3a-4cc7-9c9d-f324c86ad95a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148470 Oct 28 20:31:16.485778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1483/2961] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:16 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:17.509187 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e5d6b77-abd1-4825-8757-e93d5507b509 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:17.509838 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4e5d6b77-abd1-4825-8757-e93d5507b509 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:17.516370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5d6b77-abd1-4825-8757-e93d5507b509 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:17.516853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5d6b77-abd1-4825-8757-e93d5507b509 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:17.517284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5d6b77-abd1-4825-8757-e93d5507b509 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:17.518135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5d6b77-abd1-4825-8757-e93d5507b509 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:17.518662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5d6b77-abd1-4825-8757-e93d5507b509 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:17.519079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5d6b77-abd1-4825-8757-e93d5507b509 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:17.646093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e5d6b77-abd1-4825-8757-e93d5507b509 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:17.654485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4e5d6b77-abd1-4825-8757-e93d5507b509 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149127 Oct 28 20:31:17.655134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1479/2962] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:17 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:18.679025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7e4f2127-8695-432d-b0c0-107299993364 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:18.679626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7e4f2127-8695-432d-b0c0-107299993364 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:18.685965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e4f2127-8695-432d-b0c0-107299993364 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:18.686450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e4f2127-8695-432d-b0c0-107299993364 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:18.686889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e4f2127-8695-432d-b0c0-107299993364 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:18.687571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e4f2127-8695-432d-b0c0-107299993364 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:18.688023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e4f2127-8695-432d-b0c0-107299993364 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:18.688487 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e4f2127-8695-432d-b0c0-107299993364 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:18.820107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7e4f2127-8695-432d-b0c0-107299993364 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:18.828303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7e4f2127-8695-432d-b0c0-107299993364 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153210 Oct 28 20:31:18.828868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1484/2963] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:18 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:19.852431 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f00d6aea-aa0d-4b3e-88ef-2c4723571e0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:19.853115 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f00d6aea-aa0d-4b3e-88ef-2c4723571e0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:19.859491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f00d6aea-aa0d-4b3e-88ef-2c4723571e0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:19.859978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f00d6aea-aa0d-4b3e-88ef-2c4723571e0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:19.860420 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f00d6aea-aa0d-4b3e-88ef-2c4723571e0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:19.861103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f00d6aea-aa0d-4b3e-88ef-2c4723571e0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:19.861586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f00d6aea-aa0d-4b3e-88ef-2c4723571e0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:19.862072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f00d6aea-aa0d-4b3e-88ef-2c4723571e0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:19.993037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f00d6aea-aa0d-4b3e-88ef-2c4723571e0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:20.001127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f00d6aea-aa0d-4b3e-88ef-2c4723571e0c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152919 Oct 28 20:31:20.001731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1480/2964] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:19 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:21.028872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b201c2ae-c1b9-4c05-8246-222a845e3425 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:21.029529 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b201c2ae-c1b9-4c05-8246-222a845e3425 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:21.036806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b201c2ae-c1b9-4c05-8246-222a845e3425 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:21.037288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b201c2ae-c1b9-4c05-8246-222a845e3425 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:21.037745 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b201c2ae-c1b9-4c05-8246-222a845e3425 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:21.038430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b201c2ae-c1b9-4c05-8246-222a845e3425 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:21.038878 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b201c2ae-c1b9-4c05-8246-222a845e3425 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:21.039297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b201c2ae-c1b9-4c05-8246-222a845e3425 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:21.170411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b201c2ae-c1b9-4c05-8246-222a845e3425 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:21.178472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b201c2ae-c1b9-4c05-8246-222a845e3425 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153433 Oct 28 20:31:21.179030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1485/2965] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:21 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:22.201822 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-366cf2e4-5d7f-4f39-8996-b823414a18f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:22.202435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-366cf2e4-5d7f-4f39-8996-b823414a18f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:22.209889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366cf2e4-5d7f-4f39-8996-b823414a18f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:22.210381 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366cf2e4-5d7f-4f39-8996-b823414a18f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:22.210821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366cf2e4-5d7f-4f39-8996-b823414a18f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:22.211517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366cf2e4-5d7f-4f39-8996-b823414a18f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:22.211973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366cf2e4-5d7f-4f39-8996-b823414a18f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:22.212403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366cf2e4-5d7f-4f39-8996-b823414a18f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:22.343104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-366cf2e4-5d7f-4f39-8996-b823414a18f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:22.352131 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-366cf2e4-5d7f-4f39-8996-b823414a18f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154209 Oct 28 20:31:22.352703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1481/2966] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:22 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:23.376161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48c8a6cc-d36c-453e-bdf1-4b696193ae2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:23.376776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48c8a6cc-d36c-453e-bdf1-4b696193ae2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:23.379070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:31:23.384645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:31:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 (ip 10.222.0.66) !!! Oct 28 20:31:23.390601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48c8a6cc-d36c-453e-bdf1-4b696193ae2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:23.391181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48c8a6cc-d36c-453e-bdf1-4b696193ae2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:23.391647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48c8a6cc-d36c-453e-bdf1-4b696193ae2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:23.392339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48c8a6cc-d36c-453e-bdf1-4b696193ae2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:23.392792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48c8a6cc-d36c-453e-bdf1-4b696193ae2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:23.393770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48c8a6cc-d36c-453e-bdf1-4b696193ae2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:23.526898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-48c8a6cc-d36c-453e-bdf1-4b696193ae2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:23.535274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48c8a6cc-d36c-453e-bdf1-4b696193ae2f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.163157 Oct 28 20:31:23.535837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1486/2967] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:23 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:24.559431 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-04f56d01-fc2b-474e-8bdc-f2f53ae7eb00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:24.560045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-04f56d01-fc2b-474e-8bdc-f2f53ae7eb00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:24.566799 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04f56d01-fc2b-474e-8bdc-f2f53ae7eb00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:24.567303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04f56d01-fc2b-474e-8bdc-f2f53ae7eb00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:24.567723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04f56d01-fc2b-474e-8bdc-f2f53ae7eb00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:24.568473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04f56d01-fc2b-474e-8bdc-f2f53ae7eb00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:24.568926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04f56d01-fc2b-474e-8bdc-f2f53ae7eb00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:24.569375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04f56d01-fc2b-474e-8bdc-f2f53ae7eb00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:24.698743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-04f56d01-fc2b-474e-8bdc-f2f53ae7eb00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:24.707691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-04f56d01-fc2b-474e-8bdc-f2f53ae7eb00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152244 Oct 28 20:31:24.708509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1482/2968] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:24 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:25.731829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0dace8a7-9041-478d-9e5d-6d98134872e9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:25.732438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0dace8a7-9041-478d-9e5d-6d98134872e9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:25.738933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dace8a7-9041-478d-9e5d-6d98134872e9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:25.739421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dace8a7-9041-478d-9e5d-6d98134872e9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:25.739863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dace8a7-9041-478d-9e5d-6d98134872e9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:25.740554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dace8a7-9041-478d-9e5d-6d98134872e9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:25.741011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dace8a7-9041-478d-9e5d-6d98134872e9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:25.741473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dace8a7-9041-478d-9e5d-6d98134872e9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:25.870968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0dace8a7-9041-478d-9e5d-6d98134872e9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:25.880269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0dace8a7-9041-478d-9e5d-6d98134872e9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152329 Oct 28 20:31:25.880832 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1487/2969] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:25 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:26.903840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cfa71895-8c0f-4922-9d33-5e01bd4f25af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:26.904453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cfa71895-8c0f-4922-9d33-5e01bd4f25af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:26.911576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfa71895-8c0f-4922-9d33-5e01bd4f25af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:26.912062 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfa71895-8c0f-4922-9d33-5e01bd4f25af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:26.912498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfa71895-8c0f-4922-9d33-5e01bd4f25af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:26.913183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfa71895-8c0f-4922-9d33-5e01bd4f25af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:26.913685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfa71895-8c0f-4922-9d33-5e01bd4f25af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:26.914114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfa71895-8c0f-4922-9d33-5e01bd4f25af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:27.046301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-cfa71895-8c0f-4922-9d33-5e01bd4f25af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:27.054381 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cfa71895-8c0f-4922-9d33-5e01bd4f25af tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154649 Oct 28 20:31:27.054934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1483/2970] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:26 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:28.078012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-80dd7e8e-eea0-4b20-9082-63cf0c8553a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:28.078674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-80dd7e8e-eea0-4b20-9082-63cf0c8553a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:28.086046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80dd7e8e-eea0-4b20-9082-63cf0c8553a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:28.086533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80dd7e8e-eea0-4b20-9082-63cf0c8553a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:28.086975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80dd7e8e-eea0-4b20-9082-63cf0c8553a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:28.087761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80dd7e8e-eea0-4b20-9082-63cf0c8553a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:28.088225 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80dd7e8e-eea0-4b20-9082-63cf0c8553a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:28.088659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80dd7e8e-eea0-4b20-9082-63cf0c8553a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:28.219888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-80dd7e8e-eea0-4b20-9082-63cf0c8553a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:28.228786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-80dd7e8e-eea0-4b20-9082-63cf0c8553a7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154698 Oct 28 20:31:28.229365 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1488/2971] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:28 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:29.252323 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-85076feb-5399-4e85-9bb0-8ab7d7d2cb13 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:29.253637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-85076feb-5399-4e85-9bb0-8ab7d7d2cb13 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:29.260026 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85076feb-5399-4e85-9bb0-8ab7d7d2cb13 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:29.260509 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85076feb-5399-4e85-9bb0-8ab7d7d2cb13 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:29.260947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85076feb-5399-4e85-9bb0-8ab7d7d2cb13 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:29.261662 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85076feb-5399-4e85-9bb0-8ab7d7d2cb13 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:29.262117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85076feb-5399-4e85-9bb0-8ab7d7d2cb13 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:29.262544 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85076feb-5399-4e85-9bb0-8ab7d7d2cb13 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:29.391999 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-85076feb-5399-4e85-9bb0-8ab7d7d2cb13 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:29.400365 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-85076feb-5399-4e85-9bb0-8ab7d7d2cb13 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151918 Oct 28 20:31:29.400942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1484/2972] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:29 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:30.423047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-819ee3c9-21ec-4959-86ff-31c9c68ce916 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:30.423651 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-819ee3c9-21ec-4959-86ff-31c9c68ce916 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:30.430005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-819ee3c9-21ec-4959-86ff-31c9c68ce916 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:30.430480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-819ee3c9-21ec-4959-86ff-31c9c68ce916 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:30.430913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-819ee3c9-21ec-4959-86ff-31c9c68ce916 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:30.431585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-819ee3c9-21ec-4959-86ff-31c9c68ce916 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:30.432040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-819ee3c9-21ec-4959-86ff-31c9c68ce916 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:30.432455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-819ee3c9-21ec-4959-86ff-31c9c68ce916 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:30.559295 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-819ee3c9-21ec-4959-86ff-31c9c68ce916 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:30.568118 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-819ee3c9-21ec-4959-86ff-31c9c68ce916 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148792 Oct 28 20:31:30.568631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1489/2973] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:30 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:31.592329 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-426f36f0-9583-4d4f-b488-4c7b15395741 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:31.592943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-426f36f0-9583-4d4f-b488-4c7b15395741 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:31.600114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-426f36f0-9583-4d4f-b488-4c7b15395741 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:31.600856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-426f36f0-9583-4d4f-b488-4c7b15395741 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:31.601295 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-426f36f0-9583-4d4f-b488-4c7b15395741 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:31.602009 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-426f36f0-9583-4d4f-b488-4c7b15395741 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:31.602493 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-426f36f0-9583-4d4f-b488-4c7b15395741 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:31.602920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-426f36f0-9583-4d4f-b488-4c7b15395741 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:31.729958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-426f36f0-9583-4d4f-b488-4c7b15395741 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:31.738144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-426f36f0-9583-4d4f-b488-4c7b15395741 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149822 Oct 28 20:31:31.738705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1485/2974] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:31 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:32.761209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a8e75b07-672e-4350-be4c-bbda889dbad6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:32.761848 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a8e75b07-672e-4350-be4c-bbda889dbad6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:32.768199 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8e75b07-672e-4350-be4c-bbda889dbad6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:32.768708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8e75b07-672e-4350-be4c-bbda889dbad6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:32.769144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8e75b07-672e-4350-be4c-bbda889dbad6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:32.769852 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8e75b07-672e-4350-be4c-bbda889dbad6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:32.770305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8e75b07-672e-4350-be4c-bbda889dbad6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:32.770730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8e75b07-672e-4350-be4c-bbda889dbad6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:32.899502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a8e75b07-672e-4350-be4c-bbda889dbad6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:32.907564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a8e75b07-672e-4350-be4c-bbda889dbad6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150232 Oct 28 20:31:32.908155 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1490/2975] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:32 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:33.931020 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7dc08afe-1a92-40a6-aef9-4c4a923a932a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:33.931640 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7dc08afe-1a92-40a6-aef9-4c4a923a932a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:33.938132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc08afe-1a92-40a6-aef9-4c4a923a932a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:33.938653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc08afe-1a92-40a6-aef9-4c4a923a932a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:33.939090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc08afe-1a92-40a6-aef9-4c4a923a932a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:33.939776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc08afe-1a92-40a6-aef9-4c4a923a932a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:33.940285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc08afe-1a92-40a6-aef9-4c4a923a932a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:33.940713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc08afe-1a92-40a6-aef9-4c4a923a932a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:34.068363 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7dc08afe-1a92-40a6-aef9-4c4a923a932a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:34.076549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7dc08afe-1a92-40a6-aef9-4c4a923a932a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149451 Oct 28 20:31:34.077113 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1486/2976] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:33 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:35.102228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3528fa92-7baa-4265-92f6-2d89a584ac09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:35.102842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3528fa92-7baa-4265-92f6-2d89a584ac09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:35.109289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3528fa92-7baa-4265-92f6-2d89a584ac09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:35.109803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3528fa92-7baa-4265-92f6-2d89a584ac09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:35.110241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3528fa92-7baa-4265-92f6-2d89a584ac09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:35.110925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3528fa92-7baa-4265-92f6-2d89a584ac09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:35.111377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3528fa92-7baa-4265-92f6-2d89a584ac09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:35.112415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3528fa92-7baa-4265-92f6-2d89a584ac09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:35.114953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=78 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:31:35.242516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3528fa92-7baa-4265-92f6-2d89a584ac09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:35.250674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3528fa92-7baa-4265-92f6-2d89a584ac09 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152605 Oct 28 20:31:35.251244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1491/2977] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:35 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:36.274977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c8d1486e-a921-4902-82d1-a7d32b93e852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:36.275586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c8d1486e-a921-4902-82d1-a7d32b93e852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:36.277894 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=26 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:31:36.282573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8d1486e-a921-4902-82d1-a7d32b93e852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:36.282993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8d1486e-a921-4902-82d1-a7d32b93e852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:36.283426 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8d1486e-a921-4902-82d1-a7d32b93e852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:36.284766 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8d1486e-a921-4902-82d1-a7d32b93e852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:36.285211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8d1486e-a921-4902-82d1-a7d32b93e852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:36.285652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8d1486e-a921-4902-82d1-a7d32b93e852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:36.415270 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c8d1486e-a921-4902-82d1-a7d32b93e852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:36.423315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c8d1486e-a921-4902-82d1-a7d32b93e852 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152202 Oct 28 20:31:36.423879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1487/2978] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:36 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:37.447209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-39913d2e-f249-4b95-b5d4-a1451236e2e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:37.447827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-39913d2e-f249-4b95-b5d4-a1451236e2e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:37.450118 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=26 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:31:37.454761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39913d2e-f249-4b95-b5d4-a1451236e2e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:37.455244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39913d2e-f249-4b95-b5d4-a1451236e2e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:37.456236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39913d2e-f249-4b95-b5d4-a1451236e2e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:37.456953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39913d2e-f249-4b95-b5d4-a1451236e2e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:37.457510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39913d2e-f249-4b95-b5d4-a1451236e2e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:37.457950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39913d2e-f249-4b95-b5d4-a1451236e2e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:37.588285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-39913d2e-f249-4b95-b5d4-a1451236e2e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:37.597252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-39913d2e-f249-4b95-b5d4-a1451236e2e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153819 Oct 28 20:31:37.597863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1492/2979] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:37 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:38.621920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8741e555-dcbb-4af3-a482-951f1cbb530e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:38.622537 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8741e555-dcbb-4af3-a482-951f1cbb530e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:38.629495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8741e555-dcbb-4af3-a482-951f1cbb530e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:38.629980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8741e555-dcbb-4af3-a482-951f1cbb530e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:38.630417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8741e555-dcbb-4af3-a482-951f1cbb530e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:38.631105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8741e555-dcbb-4af3-a482-951f1cbb530e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:38.631563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8741e555-dcbb-4af3-a482-951f1cbb530e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:38.631987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8741e555-dcbb-4af3-a482-951f1cbb530e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:38.634548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=78 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:31:38.762681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8741e555-dcbb-4af3-a482-951f1cbb530e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:38.771450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8741e555-dcbb-4af3-a482-951f1cbb530e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153389 Oct 28 20:31:38.772011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1488/2980] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:38 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:39.794918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b09629ef-ba6b-4c46-ae86-0a1a91c9abec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:39.795536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b09629ef-ba6b-4c46-ae86-0a1a91c9abec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:39.802510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b09629ef-ba6b-4c46-ae86-0a1a91c9abec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:39.802992 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b09629ef-ba6b-4c46-ae86-0a1a91c9abec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:39.803431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b09629ef-ba6b-4c46-ae86-0a1a91c9abec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:39.804116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b09629ef-ba6b-4c46-ae86-0a1a91c9abec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:39.804569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b09629ef-ba6b-4c46-ae86-0a1a91c9abec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:39.804995 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b09629ef-ba6b-4c46-ae86-0a1a91c9abec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:39.929759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b09629ef-ba6b-4c46-ae86-0a1a91c9abec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:39.937741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b09629ef-ba6b-4c46-ae86-0a1a91c9abec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.146646 Oct 28 20:31:39.938304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1493/2981] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:39 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:40.962244 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4527b351-6fcd-45ff-af4e-482d6b7d0b06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:40.962860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4527b351-6fcd-45ff-af4e-482d6b7d0b06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:40.969191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4527b351-6fcd-45ff-af4e-482d6b7d0b06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:40.969700 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4527b351-6fcd-45ff-af4e-482d6b7d0b06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:40.970135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4527b351-6fcd-45ff-af4e-482d6b7d0b06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:40.970821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4527b351-6fcd-45ff-af4e-482d6b7d0b06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:40.971386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4527b351-6fcd-45ff-af4e-482d6b7d0b06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:40.971895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4527b351-6fcd-45ff-af4e-482d6b7d0b06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:41.101279 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4527b351-6fcd-45ff-af4e-482d6b7d0b06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:41.109226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4527b351-6fcd-45ff-af4e-482d6b7d0b06 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150851 Oct 28 20:31:41.109816 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1489/2982] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:40 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:42.132924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0920eb02-6876-4414-b666-5c3f85c6156f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:42.133910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0920eb02-6876-4414-b666-5c3f85c6156f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:42.140361 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0920eb02-6876-4414-b666-5c3f85c6156f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:42.140837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0920eb02-6876-4414-b666-5c3f85c6156f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:42.141271 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0920eb02-6876-4414-b666-5c3f85c6156f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:42.141978 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0920eb02-6876-4414-b666-5c3f85c6156f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:42.142430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0920eb02-6876-4414-b666-5c3f85c6156f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:42.142899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0920eb02-6876-4414-b666-5c3f85c6156f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:42.271103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0920eb02-6876-4414-b666-5c3f85c6156f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:42.279189 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0920eb02-6876-4414-b666-5c3f85c6156f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150023 Oct 28 20:31:42.279746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1494/2983] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:42 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:43.303432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-64c2813d-9689-4795-9cef-fa18d7c5ca80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:43.303981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-64c2813d-9689-4795-9cef-fa18d7c5ca80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:43.310421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64c2813d-9689-4795-9cef-fa18d7c5ca80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:43.310914 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64c2813d-9689-4795-9cef-fa18d7c5ca80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:43.311333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64c2813d-9689-4795-9cef-fa18d7c5ca80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:43.312013 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64c2813d-9689-4795-9cef-fa18d7c5ca80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:43.312464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64c2813d-9689-4795-9cef-fa18d7c5ca80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:43.312887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64c2813d-9689-4795-9cef-fa18d7c5ca80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:43.444431 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-64c2813d-9689-4795-9cef-fa18d7c5ca80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:43.452567 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-64c2813d-9689-4795-9cef-fa18d7c5ca80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154278 Oct 28 20:31:43.453135 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1490/2984] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:43 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:44.475967 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9e03a4a-95c7-4068-b287-b470569e7312 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:44.476557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f9e03a4a-95c7-4068-b287-b470569e7312 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:44.482872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e03a4a-95c7-4068-b287-b470569e7312 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:44.483347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e03a4a-95c7-4068-b287-b470569e7312 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:44.483776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e03a4a-95c7-4068-b287-b470569e7312 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:44.484448 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e03a4a-95c7-4068-b287-b470569e7312 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:44.484890 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e03a4a-95c7-4068-b287-b470569e7312 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:44.485307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e03a4a-95c7-4068-b287-b470569e7312 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:44.613598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f9e03a4a-95c7-4068-b287-b470569e7312 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:44.621790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f9e03a4a-95c7-4068-b287-b470569e7312 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149866 Oct 28 20:31:44.622351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1495/2985] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:44 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:45.645105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dcd49c51-2068-458b-9909-b2e72c831e79 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:45.645751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dcd49c51-2068-458b-9909-b2e72c831e79 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:45.652235 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcd49c51-2068-458b-9909-b2e72c831e79 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:45.652719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcd49c51-2068-458b-9909-b2e72c831e79 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:45.653160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcd49c51-2068-458b-9909-b2e72c831e79 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:45.653889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcd49c51-2068-458b-9909-b2e72c831e79 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:45.654391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcd49c51-2068-458b-9909-b2e72c831e79 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:45.654830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcd49c51-2068-458b-9909-b2e72c831e79 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:45.781903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-dcd49c51-2068-458b-9909-b2e72c831e79 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:45.790143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dcd49c51-2068-458b-9909-b2e72c831e79 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149630 Oct 28 20:31:45.790697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1491/2986] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:45 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:46.814004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91fec13d-1b99-4eaf-9e57-0189cf5465bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:46.815843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-91fec13d-1b99-4eaf-9e57-0189cf5465bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:46.821859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91fec13d-1b99-4eaf-9e57-0189cf5465bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:46.822342 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91fec13d-1b99-4eaf-9e57-0189cf5465bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:46.822781 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91fec13d-1b99-4eaf-9e57-0189cf5465bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:46.823468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91fec13d-1b99-4eaf-9e57-0189cf5465bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:46.823924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91fec13d-1b99-4eaf-9e57-0189cf5465bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:46.824352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91fec13d-1b99-4eaf-9e57-0189cf5465bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:46.954602 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-91fec13d-1b99-4eaf-9e57-0189cf5465bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:46.963053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-91fec13d-1b99-4eaf-9e57-0189cf5465bd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153134 Oct 28 20:31:46.963617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1496/2987] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:46 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:47.987243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c31ad304-8d7b-44e2-8c92-510a4085e4e1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:47.987778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c31ad304-8d7b-44e2-8c92-510a4085e4e1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:47.994031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c31ad304-8d7b-44e2-8c92-510a4085e4e1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:47.994510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c31ad304-8d7b-44e2-8c92-510a4085e4e1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:47.994939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c31ad304-8d7b-44e2-8c92-510a4085e4e1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:47.995669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c31ad304-8d7b-44e2-8c92-510a4085e4e1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:47.996063 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c31ad304-8d7b-44e2-8c92-510a4085e4e1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:47.996480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c31ad304-8d7b-44e2-8c92-510a4085e4e1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:48.125484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c31ad304-8d7b-44e2-8c92-510a4085e4e1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:48.135427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c31ad304-8d7b-44e2-8c92-510a4085e4e1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152171 Oct 28 20:31:48.135989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1492/2988] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:47 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:49.159478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-86c9d76e-c4d8-4557-be12-99038c143212 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:49.160089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-86c9d76e-c4d8-4557-be12-99038c143212 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:49.166455 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86c9d76e-c4d8-4557-be12-99038c143212 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:49.166936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86c9d76e-c4d8-4557-be12-99038c143212 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:49.167373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86c9d76e-c4d8-4557-be12-99038c143212 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:49.168064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86c9d76e-c4d8-4557-be12-99038c143212 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:49.168663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86c9d76e-c4d8-4557-be12-99038c143212 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:49.168966 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86c9d76e-c4d8-4557-be12-99038c143212 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:49.303609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-86c9d76e-c4d8-4557-be12-99038c143212 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:49.311732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-86c9d76e-c4d8-4557-be12-99038c143212 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.156219 Oct 28 20:31:49.312296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1497/2989] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:49 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:50.335757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0aa73ab4-5892-4dd7-bf2a-822917bd3e27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:50.336325 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0aa73ab4-5892-4dd7-bf2a-822917bd3e27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:50.342762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa73ab4-5892-4dd7-bf2a-822917bd3e27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:50.343242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa73ab4-5892-4dd7-bf2a-822917bd3e27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:50.343680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa73ab4-5892-4dd7-bf2a-822917bd3e27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:50.344366 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa73ab4-5892-4dd7-bf2a-822917bd3e27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:50.344824 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa73ab4-5892-4dd7-bf2a-822917bd3e27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:50.345250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa73ab4-5892-4dd7-bf2a-822917bd3e27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:50.477622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0aa73ab4-5892-4dd7-bf2a-822917bd3e27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:50.486893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0aa73ab4-5892-4dd7-bf2a-822917bd3e27 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154505 Oct 28 20:31:50.487650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1493/2990] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:50 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:51.510880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c2b5a519-85eb-452e-944c-59535c5a86f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:51.511502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c2b5a519-85eb-452e-944c-59535c5a86f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:51.518563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2b5a519-85eb-452e-944c-59535c5a86f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:51.519054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2b5a519-85eb-452e-944c-59535c5a86f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:51.519528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2b5a519-85eb-452e-944c-59535c5a86f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:51.520215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2b5a519-85eb-452e-944c-59535c5a86f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:51.520677 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2b5a519-85eb-452e-944c-59535c5a86f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:51.521101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2b5a519-85eb-452e-944c-59535c5a86f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:51.648483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c2b5a519-85eb-452e-944c-59535c5a86f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:51.656605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c2b5a519-85eb-452e-944c-59535c5a86f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149498 Oct 28 20:31:51.657168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1498/2991] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:51 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:52.681535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c7dd5a7e-c4dd-4729-a5af-09d643d933ae tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:52.682150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c7dd5a7e-c4dd-4729-a5af-09d643d933ae tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:52.688409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7dd5a7e-c4dd-4729-a5af-09d643d933ae tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:52.688891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7dd5a7e-c4dd-4729-a5af-09d643d933ae tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:52.689340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7dd5a7e-c4dd-4729-a5af-09d643d933ae tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:52.690812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7dd5a7e-c4dd-4729-a5af-09d643d933ae tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:52.691361 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7dd5a7e-c4dd-4729-a5af-09d643d933ae tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:52.691789 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7dd5a7e-c4dd-4729-a5af-09d643d933ae tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:52.820565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c7dd5a7e-c4dd-4729-a5af-09d643d933ae tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:52.828785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c7dd5a7e-c4dd-4729-a5af-09d643d933ae tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151327 Oct 28 20:31:52.829366 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1494/2992] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:52 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:53.852893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-296468a3-cba9-42d3-9e94-6ba24ee02a71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:53.853543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-296468a3-cba9-42d3-9e94-6ba24ee02a71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:53.859994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-296468a3-cba9-42d3-9e94-6ba24ee02a71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:53.860477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-296468a3-cba9-42d3-9e94-6ba24ee02a71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:53.860915 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-296468a3-cba9-42d3-9e94-6ba24ee02a71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:53.862715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-296468a3-cba9-42d3-9e94-6ba24ee02a71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:53.863180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-296468a3-cba9-42d3-9e94-6ba24ee02a71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:53.863609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-296468a3-cba9-42d3-9e94-6ba24ee02a71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:53.993343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-296468a3-cba9-42d3-9e94-6ba24ee02a71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:54.001435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-296468a3-cba9-42d3-9e94-6ba24ee02a71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152590 Oct 28 20:31:54.002010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1499/2993] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:53 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:55.024861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-24e64f0f-f11c-4a87-8f57-e134eb4769f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:55.025624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-24e64f0f-f11c-4a87-8f57-e134eb4769f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:55.031864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e64f0f-f11c-4a87-8f57-e134eb4769f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:55.032022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e64f0f-f11c-4a87-8f57-e134eb4769f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:55.032461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e64f0f-f11c-4a87-8f57-e134eb4769f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:55.033150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e64f0f-f11c-4a87-8f57-e134eb4769f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:55.034291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e64f0f-f11c-4a87-8f57-e134eb4769f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:55.034783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e64f0f-f11c-4a87-8f57-e134eb4769f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:55.167506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-24e64f0f-f11c-4a87-8f57-e134eb4769f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:55.175748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-24e64f0f-f11c-4a87-8f57-e134eb4769f8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154732 Oct 28 20:31:55.176314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1495/2994] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:55 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:56.206681 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-017f3fb7-e7c9-4761-ad55-7d66a0ee334a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:56.207284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-017f3fb7-e7c9-4761-ad55-7d66a0ee334a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:56.213203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-017f3fb7-e7c9-4761-ad55-7d66a0ee334a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:56.213720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-017f3fb7-e7c9-4761-ad55-7d66a0ee334a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:56.214162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-017f3fb7-e7c9-4761-ad55-7d66a0ee334a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:56.214859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-017f3fb7-e7c9-4761-ad55-7d66a0ee334a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:56.215314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-017f3fb7-e7c9-4761-ad55-7d66a0ee334a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:56.215741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-017f3fb7-e7c9-4761-ad55-7d66a0ee334a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:56.344046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-017f3fb7-e7c9-4761-ad55-7d66a0ee334a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:56.353111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-017f3fb7-e7c9-4761-ad55-7d66a0ee334a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.156557 Oct 28 20:31:56.353692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1500/2995] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:56 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:57.376571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7ff9638c-cc35-42f9-8ca5-e278592e873d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:57.377133 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7ff9638c-cc35-42f9-8ca5-e278592e873d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:57.383717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ff9638c-cc35-42f9-8ca5-e278592e873d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:57.384204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ff9638c-cc35-42f9-8ca5-e278592e873d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:57.384641 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ff9638c-cc35-42f9-8ca5-e278592e873d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:57.385340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ff9638c-cc35-42f9-8ca5-e278592e873d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:57.385806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ff9638c-cc35-42f9-8ca5-e278592e873d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:57.386231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ff9638c-cc35-42f9-8ca5-e278592e873d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:57.514634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7ff9638c-cc35-42f9-8ca5-e278592e873d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:57.523021 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7ff9638c-cc35-42f9-8ca5-e278592e873d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150352 Oct 28 20:31:57.523592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1496/2996] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:57 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:58.546328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-33a8949b-59b3-4cb5-a7ed-65c7ebb024b4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:58.546940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-33a8949b-59b3-4cb5-a7ed-65c7ebb024b4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:58.553532 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33a8949b-59b3-4cb5-a7ed-65c7ebb024b4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:58.554015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33a8949b-59b3-4cb5-a7ed-65c7ebb024b4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:58.554451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33a8949b-59b3-4cb5-a7ed-65c7ebb024b4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:58.555129 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33a8949b-59b3-4cb5-a7ed-65c7ebb024b4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:58.555579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33a8949b-59b3-4cb5-a7ed-65c7ebb024b4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:58.556006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33a8949b-59b3-4cb5-a7ed-65c7ebb024b4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:58.682463 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-33a8949b-59b3-4cb5-a7ed-65c7ebb024b4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:31:58.690568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-33a8949b-59b3-4cb5-a7ed-65c7ebb024b4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148089 Oct 28 20:31:58.691744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1501/2997] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:58 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:31:59.886631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7009bbb-a481-4fab-818f-2ada97ff0615 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:31:59.887239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7009bbb-a481-4fab-818f-2ada97ff0615 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:31:59.893208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7009bbb-a481-4fab-818f-2ada97ff0615 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:59.893809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7009bbb-a481-4fab-818f-2ada97ff0615 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:59.894829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7009bbb-a481-4fab-818f-2ada97ff0615 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:31:59.895537 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7009bbb-a481-4fab-818f-2ada97ff0615 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:31:59.895988 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7009bbb-a481-4fab-818f-2ada97ff0615 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:31:59.896409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7009bbb-a481-4fab-818f-2ada97ff0615 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:00.022277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7009bbb-a481-4fab-818f-2ada97ff0615 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:00.030329 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7009bbb-a481-4fab-818f-2ada97ff0615 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.319630 Oct 28 20:32:00.030883 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1497/2998] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:31:59 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:01.054943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3cca7cd4-1ea7-4d5b-9b96-e6fe373e5623 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:01.055559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3cca7cd4-1ea7-4d5b-9b96-e6fe373e5623 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:01.061956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cca7cd4-1ea7-4d5b-9b96-e6fe373e5623 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:01.062440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cca7cd4-1ea7-4d5b-9b96-e6fe373e5623 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:01.062882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cca7cd4-1ea7-4d5b-9b96-e6fe373e5623 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:01.063570 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cca7cd4-1ea7-4d5b-9b96-e6fe373e5623 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:01.064023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cca7cd4-1ea7-4d5b-9b96-e6fe373e5623 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:01.064449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cca7cd4-1ea7-4d5b-9b96-e6fe373e5623 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:01.194542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3cca7cd4-1ea7-4d5b-9b96-e6fe373e5623 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:01.202897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3cca7cd4-1ea7-4d5b-9b96-e6fe373e5623 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152980 Oct 28 20:32:01.203471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1502/2999] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:01 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:02.227382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e9666737-5741-4289-aa00-f02b95aedbc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:02.227988 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e9666737-5741-4289-aa00-f02b95aedbc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:02.234396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9666737-5741-4289-aa00-f02b95aedbc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:02.234870 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9666737-5741-4289-aa00-f02b95aedbc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:02.235306 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9666737-5741-4289-aa00-f02b95aedbc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:02.235978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9666737-5741-4289-aa00-f02b95aedbc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:02.236424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9666737-5741-4289-aa00-f02b95aedbc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:02.236842 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9666737-5741-4289-aa00-f02b95aedbc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:02.361612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e9666737-5741-4289-aa00-f02b95aedbc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:02.370287 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e9666737-5741-4289-aa00-f02b95aedbc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.147012 Oct 28 20:32:02.370848 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1498/3000] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:02 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:03.431297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6a661415-fba3-4c53-a790-64934bfd1f99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:03.431297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6a661415-fba3-4c53-a790-64934bfd1f99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:03.431297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a661415-fba3-4c53-a790-64934bfd1f99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:03.431297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a661415-fba3-4c53-a790-64934bfd1f99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:03.432231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a661415-fba3-4c53-a790-64934bfd1f99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:03.432231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a661415-fba3-4c53-a790-64934bfd1f99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:03.432231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a661415-fba3-4c53-a790-64934bfd1f99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:03.432231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a661415-fba3-4c53-a790-64934bfd1f99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:03.545651 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6a661415-fba3-4c53-a790-64934bfd1f99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:03.554428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6a661415-fba3-4c53-a790-64934bfd1f99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.163857 Oct 28 20:32:03.554993 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1503/3001] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:03 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:04.579902 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8614efff-ca6e-4d2c-b309-e6af8f81f6e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:04.580540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8614efff-ca6e-4d2c-b309-e6af8f81f6e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:04.587462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8614efff-ca6e-4d2c-b309-e6af8f81f6e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:04.587946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8614efff-ca6e-4d2c-b309-e6af8f81f6e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:04.588386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8614efff-ca6e-4d2c-b309-e6af8f81f6e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:04.589160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8614efff-ca6e-4d2c-b309-e6af8f81f6e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:04.589640 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8614efff-ca6e-4d2c-b309-e6af8f81f6e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:04.590052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8614efff-ca6e-4d2c-b309-e6af8f81f6e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:04.742625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8614efff-ca6e-4d2c-b309-e6af8f81f6e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:04.766330 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8614efff-ca6e-4d2c-b309-e6af8f81f6e3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.181620 Oct 28 20:32:04.766330 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1499/3002] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:04 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:05.785852 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fee2bee0-9cc9-4eb9-8f8c-698aadda676b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:05.786491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fee2bee0-9cc9-4eb9-8f8c-698aadda676b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:05.792917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fee2bee0-9cc9-4eb9-8f8c-698aadda676b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:05.793428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fee2bee0-9cc9-4eb9-8f8c-698aadda676b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:05.793867 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fee2bee0-9cc9-4eb9-8f8c-698aadda676b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:05.794768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fee2bee0-9cc9-4eb9-8f8c-698aadda676b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:05.795232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fee2bee0-9cc9-4eb9-8f8c-698aadda676b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:05.795656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fee2bee0-9cc9-4eb9-8f8c-698aadda676b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:05.799503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=78 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:32:05.925123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fee2bee0-9cc9-4eb9-8f8c-698aadda676b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:05.933149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fee2bee0-9cc9-4eb9-8f8c-698aadda676b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151772 Oct 28 20:32:05.933744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1504/3003] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:05 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:06.956069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f0969f0-11f7-4651-8a92-374eff246b3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:06.957239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0f0969f0-11f7-4651-8a92-374eff246b3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:06.959610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=26 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:32:06.964317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f0969f0-11f7-4651-8a92-374eff246b3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:06.971483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f0969f0-11f7-4651-8a92-374eff246b3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:06.971483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f0969f0-11f7-4651-8a92-374eff246b3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:06.971483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f0969f0-11f7-4651-8a92-374eff246b3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:06.971483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f0969f0-11f7-4651-8a92-374eff246b3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:06.971919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f0969f0-11f7-4651-8a92-374eff246b3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:07.114619 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0f0969f0-11f7-4651-8a92-374eff246b3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:07.123125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0f0969f0-11f7-4651-8a92-374eff246b3b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.170942 Oct 28 20:32:07.123691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1500/3004] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:06 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:08.147851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ce39b278-93e9-41ea-b2b5-ddd6fc196ae0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:08.152524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ce39b278-93e9-41ea-b2b5-ddd6fc196ae0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:08.152524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=26 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:32:08.155529 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce39b278-93e9-41ea-b2b5-ddd6fc196ae0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:08.156076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce39b278-93e9-41ea-b2b5-ddd6fc196ae0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:08.156535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce39b278-93e9-41ea-b2b5-ddd6fc196ae0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:08.157284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce39b278-93e9-41ea-b2b5-ddd6fc196ae0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:08.157761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce39b278-93e9-41ea-b2b5-ddd6fc196ae0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:08.158178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce39b278-93e9-41ea-b2b5-ddd6fc196ae0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:08.303151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ce39b278-93e9-41ea-b2b5-ddd6fc196ae0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:08.311274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ce39b278-93e9-41ea-b2b5-ddd6fc196ae0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.168133 Oct 28 20:32:08.311978 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1505/3005] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:08 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:09.335405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2b795bf2-f8f9-4bfe-a209-4e47a7987ede tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:09.336010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2b795bf2-f8f9-4bfe-a209-4e47a7987ede tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:09.342480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b795bf2-f8f9-4bfe-a209-4e47a7987ede tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:09.342958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b795bf2-f8f9-4bfe-a209-4e47a7987ede tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:09.343411 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b795bf2-f8f9-4bfe-a209-4e47a7987ede tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:09.344116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b795bf2-f8f9-4bfe-a209-4e47a7987ede tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:09.344568 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b795bf2-f8f9-4bfe-a209-4e47a7987ede tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:09.344989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b795bf2-f8f9-4bfe-a209-4e47a7987ede tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:09.347607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=78 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:32:09.473870 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2b795bf2-f8f9-4bfe-a209-4e47a7987ede tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:09.482185 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2b795bf2-f8f9-4bfe-a209-4e47a7987ede tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151293 Oct 28 20:32:09.482750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1501/3006] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:09 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:10.506114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-38732876-72c6-4734-afff-ec280fe0f94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:10.506731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-38732876-72c6-4734-afff-ec280fe0f94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:10.513160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38732876-72c6-4734-afff-ec280fe0f94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:10.513684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38732876-72c6-4734-afff-ec280fe0f94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:10.514124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38732876-72c6-4734-afff-ec280fe0f94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:10.514808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38732876-72c6-4734-afff-ec280fe0f94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:10.515274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38732876-72c6-4734-afff-ec280fe0f94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:10.515693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38732876-72c6-4734-afff-ec280fe0f94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:10.646141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-38732876-72c6-4734-afff-ec280fe0f94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:10.654167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-38732876-72c6-4734-afff-ec280fe0f94b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153065 Oct 28 20:32:10.654733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1506/3007] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:10 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:11.678138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e1d96f21-f885-440d-b87d-344f8e4adf52 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:11.678755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e1d96f21-f885-440d-b87d-344f8e4adf52 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:11.685362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d96f21-f885-440d-b87d-344f8e4adf52 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:11.685847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d96f21-f885-440d-b87d-344f8e4adf52 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:11.686279 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d96f21-f885-440d-b87d-344f8e4adf52 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:11.686954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d96f21-f885-440d-b87d-344f8e4adf52 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:11.687464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d96f21-f885-440d-b87d-344f8e4adf52 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:11.687883 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1d96f21-f885-440d-b87d-344f8e4adf52 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:11.813241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e1d96f21-f885-440d-b87d-344f8e4adf52 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:11.821517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e1d96f21-f885-440d-b87d-344f8e4adf52 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148142 Oct 28 20:32:11.822074 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1502/3008] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:11 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:12.845218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cef791ee-b191-44ad-ba10-8e85f4952c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:12.845853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cef791ee-b191-44ad-ba10-8e85f4952c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:12.853154 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cef791ee-b191-44ad-ba10-8e85f4952c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:12.853671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cef791ee-b191-44ad-ba10-8e85f4952c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:12.854102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cef791ee-b191-44ad-ba10-8e85f4952c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:12.854783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cef791ee-b191-44ad-ba10-8e85f4952c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:12.855230 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cef791ee-b191-44ad-ba10-8e85f4952c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:12.855648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cef791ee-b191-44ad-ba10-8e85f4952c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:12.982326 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cef791ee-b191-44ad-ba10-8e85f4952c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:12.991216 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cef791ee-b191-44ad-ba10-8e85f4952c56 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149922 Oct 28 20:32:12.991778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1507/3009] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:12 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:14.014951 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3c8fee2b-fdf5-4c39-b42f-26f6a37e1b43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:14.015581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3c8fee2b-fdf5-4c39-b42f-26f6a37e1b43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:14.022147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c8fee2b-fdf5-4c39-b42f-26f6a37e1b43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:14.022626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c8fee2b-fdf5-4c39-b42f-26f6a37e1b43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:14.023065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c8fee2b-fdf5-4c39-b42f-26f6a37e1b43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:14.023739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c8fee2b-fdf5-4c39-b42f-26f6a37e1b43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:14.024187 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c8fee2b-fdf5-4c39-b42f-26f6a37e1b43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:14.024608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c8fee2b-fdf5-4c39-b42f-26f6a37e1b43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:14.156707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3c8fee2b-fdf5-4c39-b42f-26f6a37e1b43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:14.164989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3c8fee2b-fdf5-4c39-b42f-26f6a37e1b43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154001 Oct 28 20:32:14.165597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1503/3010] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:14 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:15.188444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-672b0ecc-1b37-44b3-a263-3bcd4c3db95e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:15.189055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-672b0ecc-1b37-44b3-a263-3bcd4c3db95e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:15.195970 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-672b0ecc-1b37-44b3-a263-3bcd4c3db95e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:15.196456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-672b0ecc-1b37-44b3-a263-3bcd4c3db95e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:15.196897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-672b0ecc-1b37-44b3-a263-3bcd4c3db95e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:15.197609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-672b0ecc-1b37-44b3-a263-3bcd4c3db95e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:15.198061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-672b0ecc-1b37-44b3-a263-3bcd4c3db95e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:15.198483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-672b0ecc-1b37-44b3-a263-3bcd4c3db95e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:15.327090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-672b0ecc-1b37-44b3-a263-3bcd4c3db95e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:15.335191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-672b0ecc-1b37-44b3-a263-3bcd4c3db95e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150647 Oct 28 20:32:15.335769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1508/3011] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:15 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:16.359412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e0a0842c-abb8-47e2-b14e-4a9d1b81ff55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:16.359966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e0a0842c-abb8-47e2-b14e-4a9d1b81ff55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:16.366376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0a0842c-abb8-47e2-b14e-4a9d1b81ff55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:16.366860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0a0842c-abb8-47e2-b14e-4a9d1b81ff55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:16.367299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0a0842c-abb8-47e2-b14e-4a9d1b81ff55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:16.367983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0a0842c-abb8-47e2-b14e-4a9d1b81ff55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:16.368438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0a0842c-abb8-47e2-b14e-4a9d1b81ff55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:16.368864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0a0842c-abb8-47e2-b14e-4a9d1b81ff55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:16.499599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e0a0842c-abb8-47e2-b14e-4a9d1b81ff55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:16.508114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e0a0842c-abb8-47e2-b14e-4a9d1b81ff55 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152681 Oct 28 20:32:16.508670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1504/3012] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:16 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:17.531343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-415e91f6-425b-4445-a3e9-5691d7c49d77 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:17.531959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-415e91f6-425b-4445-a3e9-5691d7c49d77 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:17.538721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-415e91f6-425b-4445-a3e9-5691d7c49d77 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:17.539202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-415e91f6-425b-4445-a3e9-5691d7c49d77 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:17.539641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-415e91f6-425b-4445-a3e9-5691d7c49d77 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:17.540324 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-415e91f6-425b-4445-a3e9-5691d7c49d77 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:17.540786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-415e91f6-425b-4445-a3e9-5691d7c49d77 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:17.541210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-415e91f6-425b-4445-a3e9-5691d7c49d77 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:17.666925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-415e91f6-425b-4445-a3e9-5691d7c49d77 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:17.675947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-415e91f6-425b-4445-a3e9-5691d7c49d77 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148585 Oct 28 20:32:17.676520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1509/3013] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:17 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:18.699128 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8b97c889-b913-416c-8bbc-75e25d553f96 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:18.699749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8b97c889-b913-416c-8bbc-75e25d553f96 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:18.706114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b97c889-b913-416c-8bbc-75e25d553f96 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:18.706597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b97c889-b913-416c-8bbc-75e25d553f96 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:18.707709 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b97c889-b913-416c-8bbc-75e25d553f96 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:18.708403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b97c889-b913-416c-8bbc-75e25d553f96 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:18.708860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b97c889-b913-416c-8bbc-75e25d553f96 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:18.709286 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b97c889-b913-416c-8bbc-75e25d553f96 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:18.839279 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8b97c889-b913-416c-8bbc-75e25d553f96 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:18.847478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8b97c889-b913-416c-8bbc-75e25d553f96 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152243 Oct 28 20:32:18.848112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1505/3014] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:18 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:19.870947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a9a21fd-c125-46b3-a3d1-91511df7891b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:19.871575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2a9a21fd-c125-46b3-a3d1-91511df7891b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:19.878144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a9a21fd-c125-46b3-a3d1-91511df7891b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:19.878618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a9a21fd-c125-46b3-a3d1-91511df7891b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:19.879711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a9a21fd-c125-46b3-a3d1-91511df7891b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:19.880428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a9a21fd-c125-46b3-a3d1-91511df7891b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:19.880871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a9a21fd-c125-46b3-a3d1-91511df7891b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:19.881284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a9a21fd-c125-46b3-a3d1-91511df7891b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:20.009212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2a9a21fd-c125-46b3-a3d1-91511df7891b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:20.017475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a9a21fd-c125-46b3-a3d1-91511df7891b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150289 Oct 28 20:32:20.018043 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1510/3015] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:19 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:21.040838 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6238d066-098e-4a18-be5b-5981cfc3befb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:21.041503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6238d066-098e-4a18-be5b-5981cfc3befb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:21.047965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6238d066-098e-4a18-be5b-5981cfc3befb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:21.048450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6238d066-098e-4a18-be5b-5981cfc3befb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:21.048883 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6238d066-098e-4a18-be5b-5981cfc3befb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:21.049582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6238d066-098e-4a18-be5b-5981cfc3befb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:21.050029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6238d066-098e-4a18-be5b-5981cfc3befb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:21.050447 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6238d066-098e-4a18-be5b-5981cfc3befb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:21.181923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6238d066-098e-4a18-be5b-5981cfc3befb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:21.193050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6238d066-098e-4a18-be5b-5981cfc3befb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155375 Oct 28 20:32:21.193863 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1506/3016] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:21 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:22.218648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1b15be4-1147-45ef-ba00-a32e765cb185 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:22.219259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f1b15be4-1147-45ef-ba00-a32e765cb185 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:22.227318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1b15be4-1147-45ef-ba00-a32e765cb185 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:22.227789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1b15be4-1147-45ef-ba00-a32e765cb185 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:22.228211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1b15be4-1147-45ef-ba00-a32e765cb185 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:22.229038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1b15be4-1147-45ef-ba00-a32e765cb185 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:22.229519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1b15be4-1147-45ef-ba00-a32e765cb185 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:22.229941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1b15be4-1147-45ef-ba00-a32e765cb185 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:22.360357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1b15be4-1147-45ef-ba00-a32e765cb185 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:22.368448 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1b15be4-1147-45ef-ba00-a32e765cb185 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153626 Oct 28 20:32:22.369007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1511/3017] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:22 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:23.392200 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-200ca979-7e55-4528-b9c6-27352c67dcc3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:23.392833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-200ca979-7e55-4528-b9c6-27352c67dcc3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:23.400302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-200ca979-7e55-4528-b9c6-27352c67dcc3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:23.400790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-200ca979-7e55-4528-b9c6-27352c67dcc3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:23.401236 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-200ca979-7e55-4528-b9c6-27352c67dcc3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:23.401957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-200ca979-7e55-4528-b9c6-27352c67dcc3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:23.402416 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-200ca979-7e55-4528-b9c6-27352c67dcc3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:23.402906 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-200ca979-7e55-4528-b9c6-27352c67dcc3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:23.533673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-200ca979-7e55-4528-b9c6-27352c67dcc3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:23.542822 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-200ca979-7e55-4528-b9c6-27352c67dcc3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154682 Oct 28 20:32:23.543388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1507/3018] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:23 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:24.566419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2609e047-fac2-4766-8be3-77e5e636c58e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:24.567028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2609e047-fac2-4766-8be3-77e5e636c58e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:24.573602 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2609e047-fac2-4766-8be3-77e5e636c58e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:24.574086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2609e047-fac2-4766-8be3-77e5e636c58e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:24.574528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2609e047-fac2-4766-8be3-77e5e636c58e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:24.575206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2609e047-fac2-4766-8be3-77e5e636c58e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:24.575661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2609e047-fac2-4766-8be3-77e5e636c58e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:24.576083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2609e047-fac2-4766-8be3-77e5e636c58e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:24.951920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2609e047-fac2-4766-8be3-77e5e636c58e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:24.961049 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2609e047-fac2-4766-8be3-77e5e636c58e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.398539 Oct 28 20:32:24.961649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1512/3019] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:24 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:25.985077 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-125ddeda-ae14-404d-9c79-609763569df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:25.985655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-125ddeda-ae14-404d-9c79-609763569df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:25.991860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-125ddeda-ae14-404d-9c79-609763569df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:25.992347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-125ddeda-ae14-404d-9c79-609763569df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:25.992785 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-125ddeda-ae14-404d-9c79-609763569df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:25.993490 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-125ddeda-ae14-404d-9c79-609763569df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:25.993945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-125ddeda-ae14-404d-9c79-609763569df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:25.994369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-125ddeda-ae14-404d-9c79-609763569df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:26.119320 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-125ddeda-ae14-404d-9c79-609763569df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:26.127388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-125ddeda-ae14-404d-9c79-609763569df8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.146233 Oct 28 20:32:26.127948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1508/3020] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:25 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:27.151671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-942205ce-8ca5-4b2b-bb81-812b145fea7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:27.152276 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-942205ce-8ca5-4b2b-bb81-812b145fea7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:27.158888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-942205ce-8ca5-4b2b-bb81-812b145fea7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:27.159364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-942205ce-8ca5-4b2b-bb81-812b145fea7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:27.159800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-942205ce-8ca5-4b2b-bb81-812b145fea7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:27.160473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-942205ce-8ca5-4b2b-bb81-812b145fea7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:27.160918 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-942205ce-8ca5-4b2b-bb81-812b145fea7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:27.161417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-942205ce-8ca5-4b2b-bb81-812b145fea7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:27.293266 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-942205ce-8ca5-4b2b-bb81-812b145fea7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:27.301529 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-942205ce-8ca5-4b2b-bb81-812b145fea7c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153679 Oct 28 20:32:27.302593 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1513/3021] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:27 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:32:28.325279 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-772fcfcc-76ab-4dba-9784-1914bb5c4d2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:28.325867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-772fcfcc-76ab-4dba-9784-1914bb5c4d2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:28.332191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-772fcfcc-76ab-4dba-9784-1914bb5c4d2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:28.332699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-772fcfcc-76ab-4dba-9784-1914bb5c4d2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:28.333138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-772fcfcc-76ab-4dba-9784-1914bb5c4d2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:28.333856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-772fcfcc-76ab-4dba-9784-1914bb5c4d2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:28.334301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-772fcfcc-76ab-4dba-9784-1914bb5c4d2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:28.334727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-772fcfcc-76ab-4dba-9784-1914bb5c4d2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:28.464519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-772fcfcc-76ab-4dba-9784-1914bb5c4d2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:28.472754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-772fcfcc-76ab-4dba-9784-1914bb5c4d2d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151418 Oct 28 20:32:28.473341 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1509/3022] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:28 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:29.496574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4adc93bc-d944-4f21-9221-6d56c673946f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:29.497222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4adc93bc-d944-4f21-9221-6d56c673946f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:29.503719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4adc93bc-d944-4f21-9221-6d56c673946f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:29.504202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4adc93bc-d944-4f21-9221-6d56c673946f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:29.504644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4adc93bc-d944-4f21-9221-6d56c673946f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:29.506092 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4adc93bc-d944-4f21-9221-6d56c673946f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:29.506588 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4adc93bc-d944-4f21-9221-6d56c673946f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:29.507019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4adc93bc-d944-4f21-9221-6d56c673946f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:29.633212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4adc93bc-d944-4f21-9221-6d56c673946f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:29.641446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4adc93bc-d944-4f21-9221-6d56c673946f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148665 Oct 28 20:32:29.642050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1514/3023] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:29 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:30.664880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5d146224-02e8-4c0e-8dec-793e5dc73e94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:30.665467 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5d146224-02e8-4c0e-8dec-793e5dc73e94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:30.671698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d146224-02e8-4c0e-8dec-793e5dc73e94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:30.672174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d146224-02e8-4c0e-8dec-793e5dc73e94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:30.672605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d146224-02e8-4c0e-8dec-793e5dc73e94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:30.673281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d146224-02e8-4c0e-8dec-793e5dc73e94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:30.673751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d146224-02e8-4c0e-8dec-793e5dc73e94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:30.674169 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d146224-02e8-4c0e-8dec-793e5dc73e94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:30.804518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5d146224-02e8-4c0e-8dec-793e5dc73e94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:30.812612 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5d146224-02e8-4c0e-8dec-793e5dc73e94 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151783 Oct 28 20:32:30.813228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1510/3024] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:30 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:31.838076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8b214ef9-bb86-4497-b7c5-84aa45c79fb5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:31.838708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8b214ef9-bb86-4497-b7c5-84aa45c79fb5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:31.845129 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b214ef9-bb86-4497-b7c5-84aa45c79fb5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:31.845646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b214ef9-bb86-4497-b7c5-84aa45c79fb5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:31.846084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b214ef9-bb86-4497-b7c5-84aa45c79fb5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:31.846771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b214ef9-bb86-4497-b7c5-84aa45c79fb5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:31.847213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b214ef9-bb86-4497-b7c5-84aa45c79fb5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:31.847635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b214ef9-bb86-4497-b7c5-84aa45c79fb5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:31.972157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8b214ef9-bb86-4497-b7c5-84aa45c79fb5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:31.981136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8b214ef9-bb86-4497-b7c5-84aa45c79fb5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.147712 Oct 28 20:32:31.981733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1515/3025] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:31 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:33.004491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2cfb5abb-44ce-4062-9b1c-f7b65e92f6f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:33.005125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2cfb5abb-44ce-4062-9b1c-f7b65e92f6f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:33.012454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cfb5abb-44ce-4062-9b1c-f7b65e92f6f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:33.012948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cfb5abb-44ce-4062-9b1c-f7b65e92f6f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:33.013438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cfb5abb-44ce-4062-9b1c-f7b65e92f6f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:33.014158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cfb5abb-44ce-4062-9b1c-f7b65e92f6f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:33.014615 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cfb5abb-44ce-4062-9b1c-f7b65e92f6f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:33.015045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cfb5abb-44ce-4062-9b1c-f7b65e92f6f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:33.144930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2cfb5abb-44ce-4062-9b1c-f7b65e92f6f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:33.153884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2cfb5abb-44ce-4062-9b1c-f7b65e92f6f7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153288 Oct 28 20:32:33.154454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1511/3026] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:32 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:34.177450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14ec2e6f-61fe-4386-8006-3c39283cb790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:34.178611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-14ec2e6f-61fe-4386-8006-3c39283cb790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:34.185227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14ec2e6f-61fe-4386-8006-3c39283cb790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:34.185740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14ec2e6f-61fe-4386-8006-3c39283cb790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:34.186173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14ec2e6f-61fe-4386-8006-3c39283cb790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:34.186852 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14ec2e6f-61fe-4386-8006-3c39283cb790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:34.187298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14ec2e6f-61fe-4386-8006-3c39283cb790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:34.187744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14ec2e6f-61fe-4386-8006-3c39283cb790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:34.320004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-14ec2e6f-61fe-4386-8006-3c39283cb790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:34.328217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14ec2e6f-61fe-4386-8006-3c39283cb790 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154691 Oct 28 20:32:34.328777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1516/3027] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:34 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:35.351762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9ae15524-75bd-4532-a8db-cc60e3f28f86 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:35.352613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9ae15524-75bd-4532-a8db-cc60e3f28f86 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:35.358858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ae15524-75bd-4532-a8db-cc60e3f28f86 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:35.359336 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ae15524-75bd-4532-a8db-cc60e3f28f86 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:35.359770 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ae15524-75bd-4532-a8db-cc60e3f28f86 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:35.360451 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ae15524-75bd-4532-a8db-cc60e3f28f86 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:35.360897 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ae15524-75bd-4532-a8db-cc60e3f28f86 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:35.361314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ae15524-75bd-4532-a8db-cc60e3f28f86 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:35.488250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9ae15524-75bd-4532-a8db-cc60e3f28f86 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:35.497572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9ae15524-75bd-4532-a8db-cc60e3f28f86 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149921 Oct 28 20:32:35.498358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1512/3028] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:35 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:36.520874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8b51b834-0b9c-403b-b12e-a572407d84df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:36.522540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8b51b834-0b9c-403b-b12e-a572407d84df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:36.528979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b51b834-0b9c-403b-b12e-a572407d84df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:36.529504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b51b834-0b9c-403b-b12e-a572407d84df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:36.529949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b51b834-0b9c-403b-b12e-a572407d84df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:36.530632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b51b834-0b9c-403b-b12e-a572407d84df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:36.531097 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b51b834-0b9c-403b-b12e-a572407d84df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:36.531524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b51b834-0b9c-403b-b12e-a572407d84df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:36.534063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=78 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:32:36.663616 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8b51b834-0b9c-403b-b12e-a572407d84df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:36.671574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8b51b834-0b9c-403b-b12e-a572407d84df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154580 Oct 28 20:32:36.672138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1517/3029] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:36 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:37.695447 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5cb079f7-263b-4978-a338-f1795d6e792a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:37.696104 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5cb079f7-263b-4978-a338-f1795d6e792a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:37.698430 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=26 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:32:37.703091 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cb079f7-263b-4978-a338-f1795d6e792a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:37.703574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cb079f7-263b-4978-a338-f1795d6e792a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:37.704012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cb079f7-263b-4978-a338-f1795d6e792a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:37.704692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cb079f7-263b-4978-a338-f1795d6e792a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:37.705147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cb079f7-263b-4978-a338-f1795d6e792a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:37.705596 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cb079f7-263b-4978-a338-f1795d6e792a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:37.832607 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5cb079f7-263b-4978-a338-f1795d6e792a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:37.840653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5cb079f7-263b-4978-a338-f1795d6e792a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149643 Oct 28 20:32:37.841222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1513/3030] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:37 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:38.863710 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5826b3fa-bd55-4205-964f-ddbdfe7fea60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:38.864324 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5826b3fa-bd55-4205-964f-ddbdfe7fea60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:38.867666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=26 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:32:38.872556 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5826b3fa-bd55-4205-964f-ddbdfe7fea60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:38.873094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5826b3fa-bd55-4205-964f-ddbdfe7fea60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:38.873590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5826b3fa-bd55-4205-964f-ddbdfe7fea60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:38.874304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5826b3fa-bd55-4205-964f-ddbdfe7fea60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:38.874750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5826b3fa-bd55-4205-964f-ddbdfe7fea60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:38.875185 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5826b3fa-bd55-4205-964f-ddbdfe7fea60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:39.006996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5826b3fa-bd55-4205-964f-ddbdfe7fea60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:39.015148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5826b3fa-bd55-4205-964f-ddbdfe7fea60 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155237 Oct 28 20:32:39.015716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1518/3031] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:38 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:40.039741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bd26e18a-c2fc-433f-b3c1-355806733b84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:40.040391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bd26e18a-c2fc-433f-b3c1-355806733b84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:40.047058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd26e18a-c2fc-433f-b3c1-355806733b84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:40.047546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd26e18a-c2fc-433f-b3c1-355806733b84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:40.047986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd26e18a-c2fc-433f-b3c1-355806733b84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:40.048675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd26e18a-c2fc-433f-b3c1-355806733b84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:40.049132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd26e18a-c2fc-433f-b3c1-355806733b84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:40.049591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd26e18a-c2fc-433f-b3c1-355806733b84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:40.052096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=78 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:32:40.178140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bd26e18a-c2fc-433f-b3c1-355806733b84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:40.186143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bd26e18a-c2fc-433f-b3c1-355806733b84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150990 Oct 28 20:32:40.186701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1514/3032] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:40 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:41.209960 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7d241d24-ffed-4b5b-8dfa-c9bf6b551a97 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:41.210606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7d241d24-ffed-4b5b-8dfa-c9bf6b551a97 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:41.216996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d241d24-ffed-4b5b-8dfa-c9bf6b551a97 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:41.217517 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d241d24-ffed-4b5b-8dfa-c9bf6b551a97 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:41.217962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d241d24-ffed-4b5b-8dfa-c9bf6b551a97 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:41.218648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d241d24-ffed-4b5b-8dfa-c9bf6b551a97 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:41.219107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d241d24-ffed-4b5b-8dfa-c9bf6b551a97 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:41.219533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d241d24-ffed-4b5b-8dfa-c9bf6b551a97 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:41.353254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7d241d24-ffed-4b5b-8dfa-c9bf6b551a97 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:41.361276 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7d241d24-ffed-4b5b-8dfa-c9bf6b551a97 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155602 Oct 28 20:32:41.361856 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1519/3033] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:41 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:42.384296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a16f26a9-427f-43f3-a8aa-f5b7ba275fc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:42.384873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a16f26a9-427f-43f3-a8aa-f5b7ba275fc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:42.391167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a16f26a9-427f-43f3-a8aa-f5b7ba275fc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:42.391647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a16f26a9-427f-43f3-a8aa-f5b7ba275fc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:42.392077 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a16f26a9-427f-43f3-a8aa-f5b7ba275fc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:42.392761 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a16f26a9-427f-43f3-a8aa-f5b7ba275fc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:42.393209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a16f26a9-427f-43f3-a8aa-f5b7ba275fc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:42.393657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a16f26a9-427f-43f3-a8aa-f5b7ba275fc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:42.519677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a16f26a9-427f-43f3-a8aa-f5b7ba275fc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:42.528609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a16f26a9-427f-43f3-a8aa-f5b7ba275fc1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148303 Oct 28 20:32:42.529181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1515/3034] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:42 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:32:43.552059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fed493be-27a2-4a98-a279-6e3430374ca7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:43.552959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fed493be-27a2-4a98-a279-6e3430374ca7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:43.559470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed493be-27a2-4a98-a279-6e3430374ca7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:43.559952 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed493be-27a2-4a98-a279-6e3430374ca7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:43.560424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed493be-27a2-4a98-a279-6e3430374ca7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:43.561114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed493be-27a2-4a98-a279-6e3430374ca7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:43.561597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed493be-27a2-4a98-a279-6e3430374ca7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:43.562026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fed493be-27a2-4a98-a279-6e3430374ca7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:43.695399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fed493be-27a2-4a98-a279-6e3430374ca7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:43.703471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fed493be-27a2-4a98-a279-6e3430374ca7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155333 Oct 28 20:32:43.704042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1520/3035] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:43 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:32:44.727411 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7dff88c2-c4b6-4015-9110-622a8e5f7e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:44.728005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7dff88c2-c4b6-4015-9110-622a8e5f7e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:44.734402 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dff88c2-c4b6-4015-9110-622a8e5f7e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:44.734879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dff88c2-c4b6-4015-9110-622a8e5f7e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:44.735310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dff88c2-c4b6-4015-9110-622a8e5f7e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:44.735986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dff88c2-c4b6-4015-9110-622a8e5f7e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:44.736433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dff88c2-c4b6-4015-9110-622a8e5f7e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:44.736849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dff88c2-c4b6-4015-9110-622a8e5f7e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:44.866475 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7dff88c2-c4b6-4015-9110-622a8e5f7e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:44.874725 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7dff88c2-c4b6-4015-9110-622a8e5f7e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152258 Oct 28 20:32:44.875293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1516/3036] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:44 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:45.899265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-268e0fb4-1f8a-41bb-abec-e06613824179 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:45.899909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-268e0fb4-1f8a-41bb-abec-e06613824179 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:45.906421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-268e0fb4-1f8a-41bb-abec-e06613824179 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:45.906904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-268e0fb4-1f8a-41bb-abec-e06613824179 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:45.907346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-268e0fb4-1f8a-41bb-abec-e06613824179 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:45.908034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-268e0fb4-1f8a-41bb-abec-e06613824179 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:45.908492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-268e0fb4-1f8a-41bb-abec-e06613824179 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:45.908915 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-268e0fb4-1f8a-41bb-abec-e06613824179 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:46.036908 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-268e0fb4-1f8a-41bb-abec-e06613824179 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:46.045196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-268e0fb4-1f8a-41bb-abec-e06613824179 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150422 Oct 28 20:32:46.045781 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1521/3037] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:45 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:47.069860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-070e7486-65ea-40e4-8192-7616fad695d2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:47.070562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-070e7486-65ea-40e4-8192-7616fad695d2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:47.076939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-070e7486-65ea-40e4-8192-7616fad695d2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:47.077446 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-070e7486-65ea-40e4-8192-7616fad695d2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:47.077896 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-070e7486-65ea-40e4-8192-7616fad695d2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:47.078581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-070e7486-65ea-40e4-8192-7616fad695d2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:47.079040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-070e7486-65ea-40e4-8192-7616fad695d2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:47.079478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-070e7486-65ea-40e4-8192-7616fad695d2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:47.208616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-070e7486-65ea-40e4-8192-7616fad695d2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:47.216968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-070e7486-65ea-40e4-8192-7616fad695d2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151806 Oct 28 20:32:47.221772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1517/3038] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:47 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:48.241130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc024cb8-a45c-4b68-ab7d-0272ef89b367 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:48.241792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dc024cb8-a45c-4b68-ab7d-0272ef89b367 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:48.247715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc024cb8-a45c-4b68-ab7d-0272ef89b367 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:48.248210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc024cb8-a45c-4b68-ab7d-0272ef89b367 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:48.248651 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc024cb8-a45c-4b68-ab7d-0272ef89b367 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:48.249359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc024cb8-a45c-4b68-ab7d-0272ef89b367 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:48.249823 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc024cb8-a45c-4b68-ab7d-0272ef89b367 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:48.250249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc024cb8-a45c-4b68-ab7d-0272ef89b367 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:48.378454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dc024cb8-a45c-4b68-ab7d-0272ef89b367 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:48.387557 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc024cb8-a45c-4b68-ab7d-0272ef89b367 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151472 Oct 28 20:32:48.388114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1522/3039] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:48 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:49.411422 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-253267bd-602f-4cfc-9e4a-9deddbcd7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:49.412523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-253267bd-602f-4cfc-9e4a-9deddbcd7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:49.419119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-253267bd-602f-4cfc-9e4a-9deddbcd7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:49.419606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-253267bd-602f-4cfc-9e4a-9deddbcd7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:49.420043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-253267bd-602f-4cfc-9e4a-9deddbcd7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:49.420729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-253267bd-602f-4cfc-9e4a-9deddbcd7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:49.421187 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-253267bd-602f-4cfc-9e4a-9deddbcd7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:49.421642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-253267bd-602f-4cfc-9e4a-9deddbcd7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:49.548125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-253267bd-602f-4cfc-9e4a-9deddbcd7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:49.556351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-253267bd-602f-4cfc-9e4a-9deddbcd7ffa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148884 Oct 28 20:32:49.560823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1518/3040] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:49 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:50.580647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9b4dcadd-b138-41cc-ac60-2826c078019a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:50.581264 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9b4dcadd-b138-41cc-ac60-2826c078019a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:50.588197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b4dcadd-b138-41cc-ac60-2826c078019a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:50.595484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b4dcadd-b138-41cc-ac60-2826c078019a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:50.595484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b4dcadd-b138-41cc-ac60-2826c078019a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:50.595484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b4dcadd-b138-41cc-ac60-2826c078019a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:50.595484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b4dcadd-b138-41cc-ac60-2826c078019a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:50.596027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b4dcadd-b138-41cc-ac60-2826c078019a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:50.722180 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9b4dcadd-b138-41cc-ac60-2826c078019a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:50.730603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9b4dcadd-b138-41cc-ac60-2826c078019a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153870 Oct 28 20:32:50.731168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1523/3041] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:50 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:51.754345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-13bfa2b9-7981-49c5-b638-9685da0be0a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:51.754954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-13bfa2b9-7981-49c5-b638-9685da0be0a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:51.762134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13bfa2b9-7981-49c5-b638-9685da0be0a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:51.762622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13bfa2b9-7981-49c5-b638-9685da0be0a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:51.763064 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13bfa2b9-7981-49c5-b638-9685da0be0a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:51.763751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13bfa2b9-7981-49c5-b638-9685da0be0a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:51.764210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13bfa2b9-7981-49c5-b638-9685da0be0a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:51.764655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13bfa2b9-7981-49c5-b638-9685da0be0a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:51.891257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-13bfa2b9-7981-49c5-b638-9685da0be0a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:51.900169 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-13bfa2b9-7981-49c5-b638-9685da0be0a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149667 Oct 28 20:32:51.900740 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1519/3042] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:51 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:32:52.923377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-02997120-74d6-4f89-ac3c-8e5cda69b3de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:52.923997 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-02997120-74d6-4f89-ac3c-8e5cda69b3de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:52.930555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02997120-74d6-4f89-ac3c-8e5cda69b3de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:52.931030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02997120-74d6-4f89-ac3c-8e5cda69b3de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:52.931464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02997120-74d6-4f89-ac3c-8e5cda69b3de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:52.932136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02997120-74d6-4f89-ac3c-8e5cda69b3de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:52.932584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02997120-74d6-4f89-ac3c-8e5cda69b3de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:52.933001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02997120-74d6-4f89-ac3c-8e5cda69b3de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:53.063506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-02997120-74d6-4f89-ac3c-8e5cda69b3de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:53.071696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-02997120-74d6-4f89-ac3c-8e5cda69b3de tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152151 Oct 28 20:32:53.072255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1524/3043] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:52 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:54.095491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1567e2b1-d5d2-4df2-ad3b-b22a42b173a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:54.096096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1567e2b1-d5d2-4df2-ad3b-b22a42b173a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:54.102856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1567e2b1-d5d2-4df2-ad3b-b22a42b173a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:54.103329 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1567e2b1-d5d2-4df2-ad3b-b22a42b173a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:54.103757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1567e2b1-d5d2-4df2-ad3b-b22a42b173a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:54.104426 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1567e2b1-d5d2-4df2-ad3b-b22a42b173a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:54.104872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1567e2b1-d5d2-4df2-ad3b-b22a42b173a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:54.105292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1567e2b1-d5d2-4df2-ad3b-b22a42b173a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:54.236140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1567e2b1-d5d2-4df2-ad3b-b22a42b173a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:54.244836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1567e2b1-d5d2-4df2-ad3b-b22a42b173a1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153186 Oct 28 20:32:54.245418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1520/3044] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:54 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:55.268760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-220364af-0d9d-4945-917f-fbe213edeb71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:55.269401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-220364af-0d9d-4945-917f-fbe213edeb71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:55.275834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-220364af-0d9d-4945-917f-fbe213edeb71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:55.276319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-220364af-0d9d-4945-917f-fbe213edeb71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:55.276754 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-220364af-0d9d-4945-917f-fbe213edeb71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:55.277467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-220364af-0d9d-4945-917f-fbe213edeb71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:55.277923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-220364af-0d9d-4945-917f-fbe213edeb71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:55.278375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-220364af-0d9d-4945-917f-fbe213edeb71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:55.408866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-220364af-0d9d-4945-917f-fbe213edeb71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:55.417623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-220364af-0d9d-4945-917f-fbe213edeb71 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152690 Oct 28 20:32:55.418196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1525/3045] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:55 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:56.441967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-263039ee-9437-46bd-b559-887f8f4b3977 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:56.442508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-263039ee-9437-46bd-b559-887f8f4b3977 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:56.449396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-263039ee-9437-46bd-b559-887f8f4b3977 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:56.449883 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-263039ee-9437-46bd-b559-887f8f4b3977 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:56.450321 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-263039ee-9437-46bd-b559-887f8f4b3977 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:56.451003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-263039ee-9437-46bd-b559-887f8f4b3977 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:56.451452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-263039ee-9437-46bd-b559-887f8f4b3977 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:56.451873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-263039ee-9437-46bd-b559-887f8f4b3977 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:56.580485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-263039ee-9437-46bd-b559-887f8f4b3977 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:56.588566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-263039ee-9437-46bd-b559-887f8f4b3977 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150528 Oct 28 20:32:56.589128 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1521/3046] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:56 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:57.612478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78d93e32-adfa-4734-8e90-02a5f5e3a920 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:57.613084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-78d93e32-adfa-4734-8e90-02a5f5e3a920 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:57.620624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78d93e32-adfa-4734-8e90-02a5f5e3a920 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:57.621101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78d93e32-adfa-4734-8e90-02a5f5e3a920 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:57.621638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78d93e32-adfa-4734-8e90-02a5f5e3a920 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:57.622329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78d93e32-adfa-4734-8e90-02a5f5e3a920 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:57.622761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78d93e32-adfa-4734-8e90-02a5f5e3a920 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:57.623182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78d93e32-adfa-4734-8e90-02a5f5e3a920 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:57.754319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-78d93e32-adfa-4734-8e90-02a5f5e3a920 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:57.762712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-78d93e32-adfa-4734-8e90-02a5f5e3a920 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154114 Oct 28 20:32:57.763274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1526/3047] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:57 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:58.786280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a2e1dc5-24af-4b5a-a107-485ab4c2c902 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:58.786924 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9a2e1dc5-24af-4b5a-a107-485ab4c2c902 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:58.793624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a2e1dc5-24af-4b5a-a107-485ab4c2c902 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:58.794114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a2e1dc5-24af-4b5a-a107-485ab4c2c902 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:58.794551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a2e1dc5-24af-4b5a-a107-485ab4c2c902 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:58.795240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a2e1dc5-24af-4b5a-a107-485ab4c2c902 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:58.796944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a2e1dc5-24af-4b5a-a107-485ab4c2c902 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:58.797444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a2e1dc5-24af-4b5a-a107-485ab4c2c902 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:58.932731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9a2e1dc5-24af-4b5a-a107-485ab4c2c902 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:58.941297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9a2e1dc5-24af-4b5a-a107-485ab4c2c902 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.158773 Oct 28 20:32:58.941910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1522/3048] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:58 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:59.966719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-812c7427-27f2-444d-94b5-d11e1a201269 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:59.967334 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-812c7427-27f2-444d-94b5-d11e1a201269 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:59.973698 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-812c7427-27f2-444d-94b5-d11e1a201269 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:59.974183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-812c7427-27f2-444d-94b5-d11e1a201269 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:59.974625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-812c7427-27f2-444d-94b5-d11e1a201269 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:59.975310 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-812c7427-27f2-444d-94b5-d11e1a201269 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:59.975765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-812c7427-27f2-444d-94b5-d11e1a201269 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:59.976251 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-812c7427-27f2-444d-94b5-d11e1a201269 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:00.107388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-812c7427-27f2-444d-94b5-d11e1a201269 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:00.115407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-812c7427-27f2-444d-94b5-d11e1a201269 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152589 Oct 28 20:33:00.115977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1527/3049] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:59 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:01.139533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2468754f-a07b-4baa-8cc3-586c169d112e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:01.140148 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2468754f-a07b-4baa-8cc3-586c169d112e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:01.146582 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2468754f-a07b-4baa-8cc3-586c169d112e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:01.147068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2468754f-a07b-4baa-8cc3-586c169d112e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:01.147510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2468754f-a07b-4baa-8cc3-586c169d112e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:01.148251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2468754f-a07b-4baa-8cc3-586c169d112e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:01.148707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2468754f-a07b-4baa-8cc3-586c169d112e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:01.149133 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2468754f-a07b-4baa-8cc3-586c169d112e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:01.280199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2468754f-a07b-4baa-8cc3-586c169d112e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:01.288392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2468754f-a07b-4baa-8cc3-586c169d112e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152681 Oct 28 20:33:01.289521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1523/3050] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:01 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:02.312454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc16758d-f112-48f1-87c8-19959d58fcc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:02.312992 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dc16758d-f112-48f1-87c8-19959d58fcc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:02.319292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc16758d-f112-48f1-87c8-19959d58fcc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:02.320338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc16758d-f112-48f1-87c8-19959d58fcc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:02.320946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc16758d-f112-48f1-87c8-19959d58fcc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:02.321666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc16758d-f112-48f1-87c8-19959d58fcc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:02.322123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc16758d-f112-48f1-87c8-19959d58fcc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:02.322544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc16758d-f112-48f1-87c8-19959d58fcc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:02.476668 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dc16758d-f112-48f1-87c8-19959d58fcc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:02.487900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc16758d-f112-48f1-87c8-19959d58fcc6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.179348 Oct 28 20:33:02.489552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1528/3051] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:02 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:03.512728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-366b8d05-9ba8-4d48-b1cf-a0e91699e4ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:03.513353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-366b8d05-9ba8-4d48-b1cf-a0e91699e4ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:03.519673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366b8d05-9ba8-4d48-b1cf-a0e91699e4ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:03.520152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366b8d05-9ba8-4d48-b1cf-a0e91699e4ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:03.520587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366b8d05-9ba8-4d48-b1cf-a0e91699e4ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:03.521261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366b8d05-9ba8-4d48-b1cf-a0e91699e4ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:03.521743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366b8d05-9ba8-4d48-b1cf-a0e91699e4ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:03.522162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-366b8d05-9ba8-4d48-b1cf-a0e91699e4ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:03.650704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-366b8d05-9ba8-4d48-b1cf-a0e91699e4ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:03.658807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-366b8d05-9ba8-4d48-b1cf-a0e91699e4ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149947 Oct 28 20:33:03.659362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1524/3052] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:03 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:04.682541 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1906948b-3f91-4959-b08b-391b26935117 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:04.683158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1906948b-3f91-4959-b08b-391b26935117 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:04.690771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1906948b-3f91-4959-b08b-391b26935117 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:04.691782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1906948b-3f91-4959-b08b-391b26935117 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:04.692221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1906948b-3f91-4959-b08b-391b26935117 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:04.692987 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1906948b-3f91-4959-b08b-391b26935117 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:04.693503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1906948b-3f91-4959-b08b-391b26935117 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:04.693930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1906948b-3f91-4959-b08b-391b26935117 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:04.850805 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1906948b-3f91-4959-b08b-391b26935117 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:04.863563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1906948b-3f91-4959-b08b-391b26935117 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.185257 Oct 28 20:33:04.871857 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1529/3053] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:04 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:05.891729 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-476517a7-e4a8-4585-b9a4-0b62ebefaef2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:05.892339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-476517a7-e4a8-4585-b9a4-0b62ebefaef2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:05.899629 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-476517a7-e4a8-4585-b9a4-0b62ebefaef2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:05.900117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-476517a7-e4a8-4585-b9a4-0b62ebefaef2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:05.900556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-476517a7-e4a8-4585-b9a4-0b62ebefaef2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:05.901246 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-476517a7-e4a8-4585-b9a4-0b62ebefaef2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:05.901737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-476517a7-e4a8-4585-b9a4-0b62ebefaef2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:05.902170 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-476517a7-e4a8-4585-b9a4-0b62ebefaef2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:06.039873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-476517a7-e4a8-4585-b9a4-0b62ebefaef2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:06.048012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-476517a7-e4a8-4585-b9a4-0b62ebefaef2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.160111 Oct 28 20:33:06.048597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1525/3054] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:05 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:07.071578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2cd5f63b-026d-4111-ad55-4c8200559805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:07.072192 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2cd5f63b-026d-4111-ad55-4c8200559805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:07.078539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cd5f63b-026d-4111-ad55-4c8200559805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:07.079028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cd5f63b-026d-4111-ad55-4c8200559805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:07.079472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cd5f63b-026d-4111-ad55-4c8200559805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:07.080164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cd5f63b-026d-4111-ad55-4c8200559805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:07.080620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cd5f63b-026d-4111-ad55-4c8200559805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:07.081052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cd5f63b-026d-4111-ad55-4c8200559805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:07.083609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=78 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:33:07.214326 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2cd5f63b-026d-4111-ad55-4c8200559805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:07.222502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2cd5f63b-026d-4111-ad55-4c8200559805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155372 Oct 28 20:33:07.223067 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1530/3055] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:07 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:08.246934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ab2aa27-ffe6-4a0d-9132-2b5b415cadfc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:08.247479 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5ab2aa27-ffe6-4a0d-9132-2b5b415cadfc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:08.249895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=26 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:33:08.254536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ab2aa27-ffe6-4a0d-9132-2b5b415cadfc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:08.255023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ab2aa27-ffe6-4a0d-9132-2b5b415cadfc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:08.255464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ab2aa27-ffe6-4a0d-9132-2b5b415cadfc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:08.256168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ab2aa27-ffe6-4a0d-9132-2b5b415cadfc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:08.256608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ab2aa27-ffe6-4a0d-9132-2b5b415cadfc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:08.257679 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ab2aa27-ffe6-4a0d-9132-2b5b415cadfc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:08.387391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5ab2aa27-ffe6-4a0d-9132-2b5b415cadfc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:08.395324 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5ab2aa27-ffe6-4a0d-9132-2b5b415cadfc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152347 Oct 28 20:33:08.395877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1526/3056] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:08 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:33:09.419221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3d7ee125-bbcb-49b1-9ff6-69a762f60a7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:09.419825 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3d7ee125-bbcb-49b1-9ff6-69a762f60a7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:09.422221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=26 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:33:09.426820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d7ee125-bbcb-49b1-9ff6-69a762f60a7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:09.427296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d7ee125-bbcb-49b1-9ff6-69a762f60a7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:09.427729 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d7ee125-bbcb-49b1-9ff6-69a762f60a7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:09.428406 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d7ee125-bbcb-49b1-9ff6-69a762f60a7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:09.428853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d7ee125-bbcb-49b1-9ff6-69a762f60a7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:09.429300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d7ee125-bbcb-49b1-9ff6-69a762f60a7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:09.560008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3d7ee125-bbcb-49b1-9ff6-69a762f60a7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:09.568279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3d7ee125-bbcb-49b1-9ff6-69a762f60a7f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152917 Oct 28 20:33:09.568982 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1531/3057] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:09 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:10.592670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-788143bd-9c56-4ae1-b527-937f1856db31 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:10.593287 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-788143bd-9c56-4ae1-b527-937f1856db31 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:10.599730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788143bd-9c56-4ae1-b527-937f1856db31 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:10.600215 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788143bd-9c56-4ae1-b527-937f1856db31 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:10.600654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788143bd-9c56-4ae1-b527-937f1856db31 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:10.601559 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788143bd-9c56-4ae1-b527-937f1856db31 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:10.602051 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788143bd-9c56-4ae1-b527-937f1856db31 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:10.602543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788143bd-9c56-4ae1-b527-937f1856db31 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:10.605303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=78 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:33:10.732955 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-788143bd-9c56-4ae1-b527-937f1856db31 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:10.741009 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-788143bd-9c56-4ae1-b527-937f1856db31 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152230 Oct 28 20:33:10.741603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1527/3058] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:10 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:11.764237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d8535516-fc1a-44c6-9f84-5b916577f4ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:11.764839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d8535516-fc1a-44c6-9f84-5b916577f4ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:11.771124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8535516-fc1a-44c6-9f84-5b916577f4ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:11.771596 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8535516-fc1a-44c6-9f84-5b916577f4ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:11.772024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8535516-fc1a-44c6-9f84-5b916577f4ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:11.772690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8535516-fc1a-44c6-9f84-5b916577f4ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:11.773866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8535516-fc1a-44c6-9f84-5b916577f4ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:11.774293 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8535516-fc1a-44c6-9f84-5b916577f4ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:11.902880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d8535516-fc1a-44c6-9f84-5b916577f4ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:11.910832 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d8535516-fc1a-44c6-9f84-5b916577f4ed tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150467 Oct 28 20:33:11.911389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1532/3059] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:11 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:12.934494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3bbc355b-3ed8-4818-a5e2-66c1127c0409 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:12.935042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3bbc355b-3ed8-4818-a5e2-66c1127c0409 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:12.941264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bbc355b-3ed8-4818-a5e2-66c1127c0409 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:12.941771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bbc355b-3ed8-4818-a5e2-66c1127c0409 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:12.942203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bbc355b-3ed8-4818-a5e2-66c1127c0409 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:12.942877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bbc355b-3ed8-4818-a5e2-66c1127c0409 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:12.943331 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bbc355b-3ed8-4818-a5e2-66c1127c0409 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:12.943748 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bbc355b-3ed8-4818-a5e2-66c1127c0409 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:13.074480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3bbc355b-3ed8-4818-a5e2-66c1127c0409 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:13.082608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3bbc355b-3ed8-4818-a5e2-66c1127c0409 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152009 Oct 28 20:33:13.083183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1528/3060] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:12 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:14.106419 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1c6bf136-9e2a-49b5-a61c-cd96c1eabbeb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:14.107078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1c6bf136-9e2a-49b5-a61c-cd96c1eabbeb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:14.113407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c6bf136-9e2a-49b5-a61c-cd96c1eabbeb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:14.113886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c6bf136-9e2a-49b5-a61c-cd96c1eabbeb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:14.114316 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c6bf136-9e2a-49b5-a61c-cd96c1eabbeb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:14.114990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c6bf136-9e2a-49b5-a61c-cd96c1eabbeb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:14.115453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c6bf136-9e2a-49b5-a61c-cd96c1eabbeb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:14.115853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c6bf136-9e2a-49b5-a61c-cd96c1eabbeb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:14.245901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1c6bf136-9e2a-49b5-a61c-cd96c1eabbeb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:14.254062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1c6bf136-9e2a-49b5-a61c-cd96c1eabbeb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151762 Oct 28 20:33:14.254635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1533/3061] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:14 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:15.277499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-160b6f89-cf9c-4277-b245-d566cc22dab9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:15.278116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-160b6f89-cf9c-4277-b245-d566cc22dab9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:15.284618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-160b6f89-cf9c-4277-b245-d566cc22dab9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:15.285052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-160b6f89-cf9c-4277-b245-d566cc22dab9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:15.285515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-160b6f89-cf9c-4277-b245-d566cc22dab9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:15.286197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-160b6f89-cf9c-4277-b245-d566cc22dab9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:15.286650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-160b6f89-cf9c-4277-b245-d566cc22dab9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:15.287073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-160b6f89-cf9c-4277-b245-d566cc22dab9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:15.421904 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-160b6f89-cf9c-4277-b245-d566cc22dab9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:15.430197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-160b6f89-cf9c-4277-b245-d566cc22dab9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.157320 Oct 28 20:33:15.430809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1529/3062] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:15 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:16.453921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-10cbb5e3-9c62-4374-ac43-f1ea9cc59fe3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:16.454523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-10cbb5e3-9c62-4374-ac43-f1ea9cc59fe3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:16.462872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10cbb5e3-9c62-4374-ac43-f1ea9cc59fe3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:16.464387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10cbb5e3-9c62-4374-ac43-f1ea9cc59fe3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:16.466340 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10cbb5e3-9c62-4374-ac43-f1ea9cc59fe3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:16.468244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10cbb5e3-9c62-4374-ac43-f1ea9cc59fe3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:16.468730 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10cbb5e3-9c62-4374-ac43-f1ea9cc59fe3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:16.469171 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10cbb5e3-9c62-4374-ac43-f1ea9cc59fe3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:16.606915 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-10cbb5e3-9c62-4374-ac43-f1ea9cc59fe3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:16.615074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-10cbb5e3-9c62-4374-ac43-f1ea9cc59fe3 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.164970 Oct 28 20:33:16.615637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1534/3063] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:16 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:17.639117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3730785-f675-4215-b798-fd9875ad4c07 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:17.639734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b3730785-f675-4215-b798-fd9875ad4c07 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:17.646187 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3730785-f675-4215-b798-fd9875ad4c07 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:17.646677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3730785-f675-4215-b798-fd9875ad4c07 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:17.647116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3730785-f675-4215-b798-fd9875ad4c07 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:17.647804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3730785-f675-4215-b798-fd9875ad4c07 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:17.648928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3730785-f675-4215-b798-fd9875ad4c07 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:17.649398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3730785-f675-4215-b798-fd9875ad4c07 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:17.779242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b3730785-f675-4215-b798-fd9875ad4c07 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:17.787323 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b3730785-f675-4215-b798-fd9875ad4c07 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152022 Oct 28 20:33:17.787880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1530/3064] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:17 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:18.816995 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d08720a-79be-4d28-b221-f7431dd31d22 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:18.816995 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4d08720a-79be-4d28-b221-f7431dd31d22 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:18.818672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d08720a-79be-4d28-b221-f7431dd31d22 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:18.819150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d08720a-79be-4d28-b221-f7431dd31d22 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:18.819590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d08720a-79be-4d28-b221-f7431dd31d22 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:18.820941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d08720a-79be-4d28-b221-f7431dd31d22 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:18.821409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d08720a-79be-4d28-b221-f7431dd31d22 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:18.821835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d08720a-79be-4d28-b221-f7431dd31d22 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:18.955235 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d08720a-79be-4d28-b221-f7431dd31d22 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:18.964342 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4d08720a-79be-4d28-b221-f7431dd31d22 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.156732 Oct 28 20:33:18.964910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1535/3065] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:18 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:19.987912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-36b6c58c-3a85-4bb5-81fc-113041c6be41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:19.988534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-36b6c58c-3a85-4bb5-81fc-113041c6be41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:19.995316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b6c58c-3a85-4bb5-81fc-113041c6be41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:19.995815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b6c58c-3a85-4bb5-81fc-113041c6be41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:19.996256 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b6c58c-3a85-4bb5-81fc-113041c6be41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:19.996947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b6c58c-3a85-4bb5-81fc-113041c6be41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:19.997425 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b6c58c-3a85-4bb5-81fc-113041c6be41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:19.997856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b6c58c-3a85-4bb5-81fc-113041c6be41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:20.124259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-36b6c58c-3a85-4bb5-81fc-113041c6be41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:20.132970 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-36b6c58c-3a85-4bb5-81fc-113041c6be41 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148263 Oct 28 20:33:20.133569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1531/3066] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:19 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:21.156333 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fb5b4229-4626-4a1a-b619-3429b3a5c6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:21.156954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fb5b4229-4626-4a1a-b619-3429b3a5c6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:21.163462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb5b4229-4626-4a1a-b619-3429b3a5c6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:21.164528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb5b4229-4626-4a1a-b619-3429b3a5c6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:21.164957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb5b4229-4626-4a1a-b619-3429b3a5c6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:21.165665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb5b4229-4626-4a1a-b619-3429b3a5c6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:21.166119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb5b4229-4626-4a1a-b619-3429b3a5c6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:21.166540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb5b4229-4626-4a1a-b619-3429b3a5c6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:21.295325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fb5b4229-4626-4a1a-b619-3429b3a5c6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:21.303324 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fb5b4229-4626-4a1a-b619-3429b3a5c6df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150874 Oct 28 20:33:21.303897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1536/3067] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:21 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:22.327669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4cd6b6a4-8770-4d49-9cf8-f4728ffe6c43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:22.328212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4cd6b6a4-8770-4d49-9cf8-f4728ffe6c43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:22.334624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cd6b6a4-8770-4d49-9cf8-f4728ffe6c43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:22.335116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cd6b6a4-8770-4d49-9cf8-f4728ffe6c43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:22.335948 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cd6b6a4-8770-4d49-9cf8-f4728ffe6c43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:22.336671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cd6b6a4-8770-4d49-9cf8-f4728ffe6c43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:22.337132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cd6b6a4-8770-4d49-9cf8-f4728ffe6c43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:22.337591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cd6b6a4-8770-4d49-9cf8-f4728ffe6c43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:22.463338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4cd6b6a4-8770-4d49-9cf8-f4728ffe6c43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:22.471437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4cd6b6a4-8770-4d49-9cf8-f4728ffe6c43 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.147815 Oct 28 20:33:22.472002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1532/3068] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:22 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:23.495155 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5d93309e-71aa-4456-8f6a-86cfd932a6a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:23.495806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5d93309e-71aa-4456-8f6a-86cfd932a6a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:23.502210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d93309e-71aa-4456-8f6a-86cfd932a6a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:23.502696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d93309e-71aa-4456-8f6a-86cfd932a6a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:23.503135 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d93309e-71aa-4456-8f6a-86cfd932a6a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:23.503822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d93309e-71aa-4456-8f6a-86cfd932a6a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:23.504280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d93309e-71aa-4456-8f6a-86cfd932a6a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:23.504704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d93309e-71aa-4456-8f6a-86cfd932a6a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:23.636592 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5d93309e-71aa-4456-8f6a-86cfd932a6a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:23.644626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5d93309e-71aa-4456-8f6a-86cfd932a6a0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153969 Oct 28 20:33:23.645184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1537/3069] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:23 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:24.668538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-62da15d8-87f3-43fd-8bed-a76e3d80836e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:24.669175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-62da15d8-87f3-43fd-8bed-a76e3d80836e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:24.675049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62da15d8-87f3-43fd-8bed-a76e3d80836e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:24.675523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62da15d8-87f3-43fd-8bed-a76e3d80836e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:24.675952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62da15d8-87f3-43fd-8bed-a76e3d80836e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:24.676621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62da15d8-87f3-43fd-8bed-a76e3d80836e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:24.677066 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62da15d8-87f3-43fd-8bed-a76e3d80836e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:24.677518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62da15d8-87f3-43fd-8bed-a76e3d80836e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:24.805438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-62da15d8-87f3-43fd-8bed-a76e3d80836e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:24.813570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-62da15d8-87f3-43fd-8bed-a76e3d80836e tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149629 Oct 28 20:33:24.814206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1533/3070] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:24 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:25.837177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9551e591-4fba-4384-9acd-466ba986d4c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:25.837813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9551e591-4fba-4384-9acd-466ba986d4c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:25.844092 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9551e591-4fba-4384-9acd-466ba986d4c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:25.844568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9551e591-4fba-4384-9acd-466ba986d4c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:25.845000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9551e591-4fba-4384-9acd-466ba986d4c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:25.845708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9551e591-4fba-4384-9acd-466ba986d4c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:25.846156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9551e591-4fba-4384-9acd-466ba986d4c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:25.846571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9551e591-4fba-4384-9acd-466ba986d4c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:25.979565 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9551e591-4fba-4384-9acd-466ba986d4c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:25.987877 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9551e591-4fba-4384-9acd-466ba986d4c7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154599 Oct 28 20:33:25.993392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1538/3071] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:25 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:27.012211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ed00dae-3f7e-40d7-847c-f9149619c62d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:27.012826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6ed00dae-3f7e-40d7-847c-f9149619c62d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:27.019174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ed00dae-3f7e-40d7-847c-f9149619c62d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:27.019523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ed00dae-3f7e-40d7-847c-f9149619c62d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:27.019961 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ed00dae-3f7e-40d7-847c-f9149619c62d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:27.020657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ed00dae-3f7e-40d7-847c-f9149619c62d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:27.021118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ed00dae-3f7e-40d7-847c-f9149619c62d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:27.021574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ed00dae-3f7e-40d7-847c-f9149619c62d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:27.159755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6ed00dae-3f7e-40d7-847c-f9149619c62d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:27.168552 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6ed00dae-3f7e-40d7-847c-f9149619c62d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.160908 Oct 28 20:33:27.169131 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1534/3072] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:27 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:28.192575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1fd9374a-4a4c-44c8-a872-c2d74604c877 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:28.193174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1fd9374a-4a4c-44c8-a872-c2d74604c877 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:28.199511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fd9374a-4a4c-44c8-a872-c2d74604c877 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:28.205354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fd9374a-4a4c-44c8-a872-c2d74604c877 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:28.205354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fd9374a-4a4c-44c8-a872-c2d74604c877 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:28.205354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fd9374a-4a4c-44c8-a872-c2d74604c877 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:28.205354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fd9374a-4a4c-44c8-a872-c2d74604c877 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:28.205699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fd9374a-4a4c-44c8-a872-c2d74604c877 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:28.332148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1fd9374a-4a4c-44c8-a872-c2d74604c877 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:28.341488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1fd9374a-4a4c-44c8-a872-c2d74604c877 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152658 Oct 28 20:33:28.342140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1539/3073] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:28 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:29.366150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ab6f976b-dd1b-41fe-8282-8884c16c4450 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:29.366713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ab6f976b-dd1b-41fe-8282-8884c16c4450 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:29.373178 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab6f976b-dd1b-41fe-8282-8884c16c4450 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:29.373698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab6f976b-dd1b-41fe-8282-8884c16c4450 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:29.374140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab6f976b-dd1b-41fe-8282-8884c16c4450 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:29.374875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab6f976b-dd1b-41fe-8282-8884c16c4450 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:29.375319 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab6f976b-dd1b-41fe-8282-8884c16c4450 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:29.375745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab6f976b-dd1b-41fe-8282-8884c16c4450 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:29.503707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ab6f976b-dd1b-41fe-8282-8884c16c4450 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:29.512123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ab6f976b-dd1b-41fe-8282-8884c16c4450 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149875 Oct 28 20:33:29.512691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1535/3074] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:29 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:30.535474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9626135-83e6-4aa3-9d66-d63c380e3818 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:30.536091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f9626135-83e6-4aa3-9d66-d63c380e3818 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:30.544943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9626135-83e6-4aa3-9d66-d63c380e3818 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:30.545722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9626135-83e6-4aa3-9d66-d63c380e3818 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:30.546507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9626135-83e6-4aa3-9d66-d63c380e3818 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:30.547509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9626135-83e6-4aa3-9d66-d63c380e3818 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:30.547975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9626135-83e6-4aa3-9d66-d63c380e3818 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:30.548407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9626135-83e6-4aa3-9d66-d63c380e3818 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:30.679259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f9626135-83e6-4aa3-9d66-d63c380e3818 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:30.687326 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f9626135-83e6-4aa3-9d66-d63c380e3818 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155719 Oct 28 20:33:30.687880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1540/3075] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:30 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:31.710291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-09f34d15-2d44-46dd-a15b-3c57f8efe59c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:31.710906 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-09f34d15-2d44-46dd-a15b-3c57f8efe59c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:31.717565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09f34d15-2d44-46dd-a15b-3c57f8efe59c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:31.718357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09f34d15-2d44-46dd-a15b-3c57f8efe59c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:31.718517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09f34d15-2d44-46dd-a15b-3c57f8efe59c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:31.719211 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09f34d15-2d44-46dd-a15b-3c57f8efe59c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:31.719655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09f34d15-2d44-46dd-a15b-3c57f8efe59c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:31.720075 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09f34d15-2d44-46dd-a15b-3c57f8efe59c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:31.846830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-09f34d15-2d44-46dd-a15b-3c57f8efe59c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:31.856053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-09f34d15-2d44-46dd-a15b-3c57f8efe59c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149613 Oct 28 20:33:31.856609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1536/3076] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:31 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:32.879705 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0618a535-1557-474c-a2b4-2467ec2df864 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:32.880319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0618a535-1557-474c-a2b4-2467ec2df864 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:32.887732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0618a535-1557-474c-a2b4-2467ec2df864 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:32.888247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0618a535-1557-474c-a2b4-2467ec2df864 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:32.888688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0618a535-1557-474c-a2b4-2467ec2df864 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:32.889396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0618a535-1557-474c-a2b4-2467ec2df864 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:32.889851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0618a535-1557-474c-a2b4-2467ec2df864 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:32.890278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0618a535-1557-474c-a2b4-2467ec2df864 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:33.021103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0618a535-1557-474c-a2b4-2467ec2df864 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:33.029328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0618a535-1557-474c-a2b4-2467ec2df864 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153450 Oct 28 20:33:33.029917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1541/3077] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:32 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:34.051931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1cbbd557-d011-4d88-bc1e-b54495aa6620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:34.052541 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1cbbd557-d011-4d88-bc1e-b54495aa6620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:34.059661 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cbbd557-d011-4d88-bc1e-b54495aa6620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:34.060143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cbbd557-d011-4d88-bc1e-b54495aa6620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:34.060577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cbbd557-d011-4d88-bc1e-b54495aa6620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:34.061255 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cbbd557-d011-4d88-bc1e-b54495aa6620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:34.061736 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cbbd557-d011-4d88-bc1e-b54495aa6620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:34.062160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cbbd557-d011-4d88-bc1e-b54495aa6620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:34.187504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1cbbd557-d011-4d88-bc1e-b54495aa6620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:34.195821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1cbbd557-d011-4d88-bc1e-b54495aa6620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.147452 Oct 28 20:33:34.196402 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1537/3078] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:34 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:35.218666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0dca64ea-6e15-4084-9191-729d0af43b88 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:35.219278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0dca64ea-6e15-4084-9191-729d0af43b88 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:35.225776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dca64ea-6e15-4084-9191-729d0af43b88 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:35.226254 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dca64ea-6e15-4084-9191-729d0af43b88 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:35.226711 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dca64ea-6e15-4084-9191-729d0af43b88 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:35.227397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dca64ea-6e15-4084-9191-729d0af43b88 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:35.227849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dca64ea-6e15-4084-9191-729d0af43b88 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:35.228522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dca64ea-6e15-4084-9191-729d0af43b88 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:35.363538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0dca64ea-6e15-4084-9191-729d0af43b88 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:35.371618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0dca64ea-6e15-4084-9191-729d0af43b88 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.156791 Oct 28 20:33:35.372170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1542/3079] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:35 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:36.395143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5d8cf88f-33e1-4521-a7b7-07f68d6b7ccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:36.395714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5d8cf88f-33e1-4521-a7b7-07f68d6b7ccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:36.402745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d8cf88f-33e1-4521-a7b7-07f68d6b7ccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:36.403223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d8cf88f-33e1-4521-a7b7-07f68d6b7ccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:36.403651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d8cf88f-33e1-4521-a7b7-07f68d6b7ccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:36.404323 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d8cf88f-33e1-4521-a7b7-07f68d6b7ccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:36.404772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d8cf88f-33e1-4521-a7b7-07f68d6b7ccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:36.405225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d8cf88f-33e1-4521-a7b7-07f68d6b7ccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:36.549903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5d8cf88f-33e1-4521-a7b7-07f68d6b7ccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:36.549903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5d8cf88f-33e1-4521-a7b7-07f68d6b7ccd tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.156934 Oct 28 20:33:36.549903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1538/3080] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:36 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:37.572822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-778285a8-1ac0-4ee8-915b-e70b24d44640 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:37.573470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-778285a8-1ac0-4ee8-915b-e70b24d44640 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:37.579931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-778285a8-1ac0-4ee8-915b-e70b24d44640 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:37.580407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-778285a8-1ac0-4ee8-915b-e70b24d44640 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:37.580842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-778285a8-1ac0-4ee8-915b-e70b24d44640 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:37.581553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-778285a8-1ac0-4ee8-915b-e70b24d44640 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:37.582008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-778285a8-1ac0-4ee8-915b-e70b24d44640 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:37.582428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-778285a8-1ac0-4ee8-915b-e70b24d44640 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:37.586962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=78 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:33:37.719148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-778285a8-1ac0-4ee8-915b-e70b24d44640 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:37.727784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-778285a8-1ac0-4ee8-915b-e70b24d44640 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.159813 Oct 28 20:33:37.728610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1543/3081] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:37 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:38.750449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b929c295-b719-4880-933d-f4ee2803c3f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:38.751088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b929c295-b719-4880-933d-f4ee2803c3f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:38.753403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=26 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:33:38.758119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b929c295-b719-4880-933d-f4ee2803c3f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:38.758610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b929c295-b719-4880-933d-f4ee2803c3f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:38.759056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b929c295-b719-4880-933d-f4ee2803c3f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:38.759735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b929c295-b719-4880-933d-f4ee2803c3f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:38.760190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b929c295-b719-4880-933d-f4ee2803c3f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:38.760614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b929c295-b719-4880-933d-f4ee2803c3f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:38.890656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b929c295-b719-4880-933d-f4ee2803c3f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:38.899847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b929c295-b719-4880-933d-f4ee2803c3f2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152159 Oct 28 20:33:38.900414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1539/3082] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:38 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:39.923975 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b277004e-b757-483b-94f2-967829f6a2ab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:39.924518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b277004e-b757-483b-94f2-967829f6a2ab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:39.926796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=26 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:33:39.932210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b277004e-b757-483b-94f2-967829f6a2ab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:39.932733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b277004e-b757-483b-94f2-967829f6a2ab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:39.933207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b277004e-b757-483b-94f2-967829f6a2ab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:39.933939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b277004e-b757-483b-94f2-967829f6a2ab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:39.934398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b277004e-b757-483b-94f2-967829f6a2ab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:39.934827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b277004e-b757-483b-94f2-967829f6a2ab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:40.064374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b277004e-b757-483b-94f2-967829f6a2ab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:40.073221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b277004e-b757-483b-94f2-967829f6a2ab tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153149 Oct 28 20:33:40.073830 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1544/3083] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:39 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:41.097071 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d309900c-1839-4686-9e5e-cb54a309b719 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:41.097715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d309900c-1839-4686-9e5e-cb54a309b719 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:41.105503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d309900c-1839-4686-9e5e-cb54a309b719 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:41.105994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d309900c-1839-4686-9e5e-cb54a309b719 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:41.106444 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d309900c-1839-4686-9e5e-cb54a309b719 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:41.107131 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d309900c-1839-4686-9e5e-cb54a309b719 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:41.107591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d309900c-1839-4686-9e5e-cb54a309b719 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:41.108040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d309900c-1839-4686-9e5e-cb54a309b719 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:41.110605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=78 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:33:41.242870 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d309900c-1839-4686-9e5e-cb54a309b719 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:41.250997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d309900c-1839-4686-9e5e-cb54a309b719 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.157794 Oct 28 20:33:41.251571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1540/3084] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:41 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:42.274893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9685a66a-a5df-413a-8354-41b61e5775e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:42.275500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9685a66a-a5df-413a-8354-41b61e5775e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:42.281959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9685a66a-a5df-413a-8354-41b61e5775e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:42.282394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9685a66a-a5df-413a-8354-41b61e5775e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:42.282829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9685a66a-a5df-413a-8354-41b61e5775e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:42.283519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9685a66a-a5df-413a-8354-41b61e5775e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:42.283971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9685a66a-a5df-413a-8354-41b61e5775e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:42.284399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9685a66a-a5df-413a-8354-41b61e5775e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:42.416433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9685a66a-a5df-413a-8354-41b61e5775e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:42.424478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9685a66a-a5df-413a-8354-41b61e5775e0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154003 Oct 28 20:33:42.425046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1545/3085] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:42 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:43.448964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9fff4035-d857-4de4-8a07-354516f4256d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:43.449886 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9fff4035-d857-4de4-8a07-354516f4256d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:43.456534 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fff4035-d857-4de4-8a07-354516f4256d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:43.457017 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fff4035-d857-4de4-8a07-354516f4256d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:43.457488 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fff4035-d857-4de4-8a07-354516f4256d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:43.458171 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fff4035-d857-4de4-8a07-354516f4256d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:43.458619 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fff4035-d857-4de4-8a07-354516f4256d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:43.459433 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fff4035-d857-4de4-8a07-354516f4256d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:43.590876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9fff4035-d857-4de4-8a07-354516f4256d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:43.599138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9fff4035-d857-4de4-8a07-354516f4256d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155219 Oct 28 20:33:43.599723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1541/3086] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:43 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:44.622029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9ecffb5-e9da-43b6-82df-c69fd244b6cc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:44.622640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f9ecffb5-e9da-43b6-82df-c69fd244b6cc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:44.629131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9ecffb5-e9da-43b6-82df-c69fd244b6cc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:44.629664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9ecffb5-e9da-43b6-82df-c69fd244b6cc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:44.630100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9ecffb5-e9da-43b6-82df-c69fd244b6cc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:44.630785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9ecffb5-e9da-43b6-82df-c69fd244b6cc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:44.631237 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9ecffb5-e9da-43b6-82df-c69fd244b6cc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:44.631661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9ecffb5-e9da-43b6-82df-c69fd244b6cc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:44.772381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f9ecffb5-e9da-43b6-82df-c69fd244b6cc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:44.780729 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f9ecffb5-e9da-43b6-82df-c69fd244b6cc tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.162539 Oct 28 20:33:44.781493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1546/3087] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:44 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:45.804473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-745b3b5d-a57f-4510-8bb8-3f61c6069357 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:45.805677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-745b3b5d-a57f-4510-8bb8-3f61c6069357 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:45.812076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-745b3b5d-a57f-4510-8bb8-3f61c6069357 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:45.812552 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-745b3b5d-a57f-4510-8bb8-3f61c6069357 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:45.812982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-745b3b5d-a57f-4510-8bb8-3f61c6069357 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:45.813722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-745b3b5d-a57f-4510-8bb8-3f61c6069357 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:45.814172 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-745b3b5d-a57f-4510-8bb8-3f61c6069357 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:45.814590 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-745b3b5d-a57f-4510-8bb8-3f61c6069357 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:45.950391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-745b3b5d-a57f-4510-8bb8-3f61c6069357 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:45.950570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-745b3b5d-a57f-4510-8bb8-3f61c6069357 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150228 Oct 28 20:33:45.951134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1542/3088] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:45 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:46.974837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e3c16eae-475e-4eaa-b340-4edea09475d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:46.975453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e3c16eae-475e-4eaa-b340-4edea09475d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:46.981784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3c16eae-475e-4eaa-b340-4edea09475d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:46.982267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3c16eae-475e-4eaa-b340-4edea09475d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:46.982703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3c16eae-475e-4eaa-b340-4edea09475d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:46.983383 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3c16eae-475e-4eaa-b340-4edea09475d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:46.983837 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3c16eae-475e-4eaa-b340-4edea09475d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:46.984261 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3c16eae-475e-4eaa-b340-4edea09475d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:47.144604 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e3c16eae-475e-4eaa-b340-4edea09475d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:47.152894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e3c16eae-475e-4eaa-b340-4edea09475d9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.182052 Oct 28 20:33:47.153520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1547/3089] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:46 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:48.176592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-009d9f35-e2c6-4f03-9cc0-a79fdd0c3d78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:48.177207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-009d9f35-e2c6-4f03-9cc0-a79fdd0c3d78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:48.184443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-009d9f35-e2c6-4f03-9cc0-a79fdd0c3d78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:48.184927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-009d9f35-e2c6-4f03-9cc0-a79fdd0c3d78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:48.185383 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-009d9f35-e2c6-4f03-9cc0-a79fdd0c3d78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:48.186070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-009d9f35-e2c6-4f03-9cc0-a79fdd0c3d78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:48.186519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-009d9f35-e2c6-4f03-9cc0-a79fdd0c3d78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:48.186939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-009d9f35-e2c6-4f03-9cc0-a79fdd0c3d78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:48.318013 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-009d9f35-e2c6-4f03-9cc0-a79fdd0c3d78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:48.326521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-009d9f35-e2c6-4f03-9cc0-a79fdd0c3d78 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154464 Oct 28 20:33:48.327093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1543/3090] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:48 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:49.349410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-42f5f76d-784c-4269-92e2-462fa7075efa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:49.350017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-42f5f76d-784c-4269-92e2-462fa7075efa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:49.357430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42f5f76d-784c-4269-92e2-462fa7075efa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:49.357912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42f5f76d-784c-4269-92e2-462fa7075efa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:49.358347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42f5f76d-784c-4269-92e2-462fa7075efa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:49.359026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42f5f76d-784c-4269-92e2-462fa7075efa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:49.359477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42f5f76d-784c-4269-92e2-462fa7075efa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:49.359893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42f5f76d-784c-4269-92e2-462fa7075efa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:49.489678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-42f5f76d-784c-4269-92e2-462fa7075efa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:49.498075 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-42f5f76d-784c-4269-92e2-462fa7075efa tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152448 Oct 28 20:33:49.498644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1548/3091] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:49 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:50.522049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0bd6e6f4-36c3-485c-8d18-56c765ee2b3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:50.522663 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0bd6e6f4-36c3-485c-8d18-56c765ee2b3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:50.529633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bd6e6f4-36c3-485c-8d18-56c765ee2b3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:50.530103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bd6e6f4-36c3-485c-8d18-56c765ee2b3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:50.530539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bd6e6f4-36c3-485c-8d18-56c765ee2b3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:50.531391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bd6e6f4-36c3-485c-8d18-56c765ee2b3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:50.531849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bd6e6f4-36c3-485c-8d18-56c765ee2b3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:50.532271 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bd6e6f4-36c3-485c-8d18-56c765ee2b3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:50.660184 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0bd6e6f4-36c3-485c-8d18-56c765ee2b3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:50.670232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0bd6e6f4-36c3-485c-8d18-56c765ee2b3d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152275 Oct 28 20:33:50.671241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1544/3092] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:50 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:51.700828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1d3fbeb-8a39-4ae2-a6a7-1dd09120f17f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:51.701468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f1d3fbeb-8a39-4ae2-a6a7-1dd09120f17f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:51.707842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1d3fbeb-8a39-4ae2-a6a7-1dd09120f17f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:51.708324 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1d3fbeb-8a39-4ae2-a6a7-1dd09120f17f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:51.708761 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1d3fbeb-8a39-4ae2-a6a7-1dd09120f17f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:51.709478 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1d3fbeb-8a39-4ae2-a6a7-1dd09120f17f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:51.709934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1d3fbeb-8a39-4ae2-a6a7-1dd09120f17f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:51.710360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1d3fbeb-8a39-4ae2-a6a7-1dd09120f17f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:51.840228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1d3fbeb-8a39-4ae2-a6a7-1dd09120f17f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:51.848175 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1d3fbeb-8a39-4ae2-a6a7-1dd09120f17f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151206 Oct 28 20:33:51.848729 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1549/3093] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:51 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:52.871392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f4e6667d-b3be-4eef-95ce-f87f4c54e9b6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:52.871998 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f4e6667d-b3be-4eef-95ce-f87f4c54e9b6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:52.878397 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4e6667d-b3be-4eef-95ce-f87f4c54e9b6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:52.878884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4e6667d-b3be-4eef-95ce-f87f4c54e9b6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:52.879324 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4e6667d-b3be-4eef-95ce-f87f4c54e9b6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:52.880007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4e6667d-b3be-4eef-95ce-f87f4c54e9b6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:52.880463 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4e6667d-b3be-4eef-95ce-f87f4c54e9b6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:52.880888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f4e6667d-b3be-4eef-95ce-f87f4c54e9b6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:53.010929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f4e6667d-b3be-4eef-95ce-f87f4c54e9b6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:53.019833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f4e6667d-b3be-4eef-95ce-f87f4c54e9b6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152342 Oct 28 20:33:53.020432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1545/3094] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:52 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:54.043286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-311e4914-304d-489c-9ac5-9f76441b5366 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:54.043903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-311e4914-304d-489c-9ac5-9f76441b5366 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:54.050301 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-311e4914-304d-489c-9ac5-9f76441b5366 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:54.050785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-311e4914-304d-489c-9ac5-9f76441b5366 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:54.051227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-311e4914-304d-489c-9ac5-9f76441b5366 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:54.051916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-311e4914-304d-489c-9ac5-9f76441b5366 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:54.052375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-311e4914-304d-489c-9ac5-9f76441b5366 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:54.052804 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-311e4914-304d-489c-9ac5-9f76441b5366 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:54.178807 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-311e4914-304d-489c-9ac5-9f76441b5366 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:54.187402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-311e4914-304d-489c-9ac5-9f76441b5366 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148017 Oct 28 20:33:54.187965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1550/3095] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:54 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:55.210718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3920090-a00b-457a-8243-7ae2e259bcc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:55.211356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b3920090-a00b-457a-8243-7ae2e259bcc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:55.217515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3920090-a00b-457a-8243-7ae2e259bcc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:55.217999 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3920090-a00b-457a-8243-7ae2e259bcc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:55.218434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3920090-a00b-457a-8243-7ae2e259bcc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:55.219115 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3920090-a00b-457a-8243-7ae2e259bcc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:55.219566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3920090-a00b-457a-8243-7ae2e259bcc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:55.219987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3920090-a00b-457a-8243-7ae2e259bcc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:55.350131 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b3920090-a00b-457a-8243-7ae2e259bcc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:55.359173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b3920090-a00b-457a-8243-7ae2e259bcc5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152445 Oct 28 20:33:55.359735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1546/3096] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:55 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:56.383331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf9657a6-2a80-4bf5-bf97-dbedb2d964ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:56.383920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cf9657a6-2a80-4bf5-bf97-dbedb2d964ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:56.390985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf9657a6-2a80-4bf5-bf97-dbedb2d964ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:56.391464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf9657a6-2a80-4bf5-bf97-dbedb2d964ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:56.391900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf9657a6-2a80-4bf5-bf97-dbedb2d964ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:56.392583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf9657a6-2a80-4bf5-bf97-dbedb2d964ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:56.393038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf9657a6-2a80-4bf5-bf97-dbedb2d964ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:56.393491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf9657a6-2a80-4bf5-bf97-dbedb2d964ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:56.521005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cf9657a6-2a80-4bf5-bf97-dbedb2d964ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:56.529064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cf9657a6-2a80-4bf5-bf97-dbedb2d964ce tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149618 Oct 28 20:33:56.529646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1551/3097] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:56 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:57.552677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-36a7a5d0-e1a1-4aad-94b9-40525f9365a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:57.553357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-36a7a5d0-e1a1-4aad-94b9-40525f9365a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:57.560710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a7a5d0-e1a1-4aad-94b9-40525f9365a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:57.560710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a7a5d0-e1a1-4aad-94b9-40525f9365a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:57.560710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a7a5d0-e1a1-4aad-94b9-40525f9365a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:57.561295 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a7a5d0-e1a1-4aad-94b9-40525f9365a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:57.561772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a7a5d0-e1a1-4aad-94b9-40525f9365a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:57.562194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a7a5d0-e1a1-4aad-94b9-40525f9365a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:57.698965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-36a7a5d0-e1a1-4aad-94b9-40525f9365a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:57.717773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-36a7a5d0-e1a1-4aad-94b9-40525f9365a6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.168806 Oct 28 20:33:57.722769 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1547/3098] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:57 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:58.741568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-269f0c67-8e96-4de7-8f77-74c19447a361 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:58.742206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-269f0c67-8e96-4de7-8f77-74c19447a361 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:58.748607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-269f0c67-8e96-4de7-8f77-74c19447a361 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:58.749093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-269f0c67-8e96-4de7-8f77-74c19447a361 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:58.749575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-269f0c67-8e96-4de7-8f77-74c19447a361 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:58.750262 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-269f0c67-8e96-4de7-8f77-74c19447a361 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:58.750715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-269f0c67-8e96-4de7-8f77-74c19447a361 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:58.751138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-269f0c67-8e96-4de7-8f77-74c19447a361 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:58.883238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-269f0c67-8e96-4de7-8f77-74c19447a361 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:58.893369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-269f0c67-8e96-4de7-8f77-74c19447a361 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154922 Oct 28 20:33:58.893369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1552/3099] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:58 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:59.917804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6956f049-889d-4efd-81be-134b73e5b360 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:59.918359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6956f049-889d-4efd-81be-134b73e5b360 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:59.924628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6956f049-889d-4efd-81be-134b73e5b360 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:59.925110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6956f049-889d-4efd-81be-134b73e5b360 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:59.925581 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6956f049-889d-4efd-81be-134b73e5b360 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:59.926266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6956f049-889d-4efd-81be-134b73e5b360 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:59.926723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6956f049-889d-4efd-81be-134b73e5b360 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:59.927151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6956f049-889d-4efd-81be-134b73e5b360 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:00.053121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6956f049-889d-4efd-81be-134b73e5b360 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:00.062409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6956f049-889d-4efd-81be-134b73e5b360 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149628 Oct 28 20:34:00.062978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1548/3100] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:59 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:01.086370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-86b8d70b-e687-4130-a03b-442b555b5866 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:01.087086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-86b8d70b-e687-4130-a03b-442b555b5866 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:01.093637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86b8d70b-e687-4130-a03b-442b555b5866 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:01.094111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86b8d70b-e687-4130-a03b-442b555b5866 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:01.094540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86b8d70b-e687-4130-a03b-442b555b5866 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:01.095212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86b8d70b-e687-4130-a03b-442b555b5866 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:01.095658 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86b8d70b-e687-4130-a03b-442b555b5866 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:01.096073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86b8d70b-e687-4130-a03b-442b555b5866 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:01.383702 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-86b8d70b-e687-4130-a03b-442b555b5866 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:01.391694 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-86b8d70b-e687-4130-a03b-442b555b5866 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.309072 Oct 28 20:34:01.392250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1553/3101] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:01 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:02.415873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2a382424-9155-42aa-a278-1caeae98642d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:02.416429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2a382424-9155-42aa-a278-1caeae98642d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:02.422807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a382424-9155-42aa-a278-1caeae98642d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:02.423284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a382424-9155-42aa-a278-1caeae98642d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:02.423716 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a382424-9155-42aa-a278-1caeae98642d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:02.424389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a382424-9155-42aa-a278-1caeae98642d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:02.424839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a382424-9155-42aa-a278-1caeae98642d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:02.425255 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a382424-9155-42aa-a278-1caeae98642d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:02.553635 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2a382424-9155-42aa-a278-1caeae98642d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:02.562532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2a382424-9155-42aa-a278-1caeae98642d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151267 Oct 28 20:34:02.563229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1549/3102] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:02 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:03.585769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cb79860b-ec5b-4182-bc03-917d2c094999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:03.586378 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cb79860b-ec5b-4182-bc03-917d2c094999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:03.592633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb79860b-ec5b-4182-bc03-917d2c094999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:03.598470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb79860b-ec5b-4182-bc03-917d2c094999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:03.598470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb79860b-ec5b-4182-bc03-917d2c094999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:03.598470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb79860b-ec5b-4182-bc03-917d2c094999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:03.598470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb79860b-ec5b-4182-bc03-917d2c094999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:03.598759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb79860b-ec5b-4182-bc03-917d2c094999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:03.724936 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cb79860b-ec5b-4182-bc03-917d2c094999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:03.733537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cb79860b-ec5b-4182-bc03-917d2c094999 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151543 Oct 28 20:34:03.734088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1554/3103] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:03 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:04.757157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca68a34f-4ffe-44eb-99de-cfec8aa2a531 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:04.757880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ca68a34f-4ffe-44eb-99de-cfec8aa2a531 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:04.762411 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:34:04.762546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:34:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 (ip 10.222.0.66) !!! Oct 28 20:34:04.770895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca68a34f-4ffe-44eb-99de-cfec8aa2a531 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:04.771390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca68a34f-4ffe-44eb-99de-cfec8aa2a531 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:04.771837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca68a34f-4ffe-44eb-99de-cfec8aa2a531 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:04.772540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca68a34f-4ffe-44eb-99de-cfec8aa2a531 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:04.773000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca68a34f-4ffe-44eb-99de-cfec8aa2a531 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:04.774919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca68a34f-4ffe-44eb-99de-cfec8aa2a531 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:04.902919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ca68a34f-4ffe-44eb-99de-cfec8aa2a531 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:04.911000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ca68a34f-4ffe-44eb-99de-cfec8aa2a531 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.157818 Oct 28 20:34:04.911563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1550/3104] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:04 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:05.937874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-04ddbbde-e49d-401b-b981-7e82b9cb0811 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:05.938503 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-04ddbbde-e49d-401b-b981-7e82b9cb0811 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:05.953684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04ddbbde-e49d-401b-b981-7e82b9cb0811 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:05.954176 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04ddbbde-e49d-401b-b981-7e82b9cb0811 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:05.954612 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04ddbbde-e49d-401b-b981-7e82b9cb0811 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:05.955312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04ddbbde-e49d-401b-b981-7e82b9cb0811 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:05.955766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04ddbbde-e49d-401b-b981-7e82b9cb0811 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:05.956191 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04ddbbde-e49d-401b-b981-7e82b9cb0811 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:06.098077 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-04ddbbde-e49d-401b-b981-7e82b9cb0811 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:06.107047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-04ddbbde-e49d-401b-b981-7e82b9cb0811 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.176178 Oct 28 20:34:06.107611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1555/3105] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:05 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:07.131176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7410b679-ed7e-4d49-98aa-21f705d2fc3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:07.131831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7410b679-ed7e-4d49-98aa-21f705d2fc3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:07.138939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7410b679-ed7e-4d49-98aa-21f705d2fc3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:07.139438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7410b679-ed7e-4d49-98aa-21f705d2fc3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:07.139862 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7410b679-ed7e-4d49-98aa-21f705d2fc3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:07.140652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7410b679-ed7e-4d49-98aa-21f705d2fc3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:07.141001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7410b679-ed7e-4d49-98aa-21f705d2fc3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:07.141821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7410b679-ed7e-4d49-98aa-21f705d2fc3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:07.276979 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7410b679-ed7e-4d49-98aa-21f705d2fc3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:07.285205 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7410b679-ed7e-4d49-98aa-21f705d2fc3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.157816 Oct 28 20:34:07.285809 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1551/3106] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:07 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:08.309537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-28fc666b-d036-46d3-b2d4-304cf6ee1861 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:08.310144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-28fc666b-d036-46d3-b2d4-304cf6ee1861 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:08.312629 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:34:08.312772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:34:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 (ip 10.222.0.66) !!! Oct 28 20:34:08.318640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fc666b-d036-46d3-b2d4-304cf6ee1861 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:08.319122 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fc666b-d036-46d3-b2d4-304cf6ee1861 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:08.319553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fc666b-d036-46d3-b2d4-304cf6ee1861 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:08.320265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fc666b-d036-46d3-b2d4-304cf6ee1861 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:08.320713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fc666b-d036-46d3-b2d4-304cf6ee1861 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:08.321801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fc666b-d036-46d3-b2d4-304cf6ee1861 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:08.325197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=78 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:34:08.450941 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-28fc666b-d036-46d3-b2d4-304cf6ee1861 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:08.458892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-28fc666b-d036-46d3-b2d4-304cf6ee1861 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153767 Oct 28 20:34:08.459436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1556/3107] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:08 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:09.484587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4af49aee-8811-4bb6-ae80-c37ca0ccf7d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:09.485342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4af49aee-8811-4bb6-ae80-c37ca0ccf7d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:09.487661 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=26 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:34:09.492282 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4af49aee-8811-4bb6-ae80-c37ca0ccf7d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:09.492773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4af49aee-8811-4bb6-ae80-c37ca0ccf7d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:09.493864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4af49aee-8811-4bb6-ae80-c37ca0ccf7d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:09.494555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4af49aee-8811-4bb6-ae80-c37ca0ccf7d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:09.495009 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4af49aee-8811-4bb6-ae80-c37ca0ccf7d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:09.495432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4af49aee-8811-4bb6-ae80-c37ca0ccf7d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:09.628574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4af49aee-8811-4bb6-ae80-c37ca0ccf7d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:09.636705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4af49aee-8811-4bb6-ae80-c37ca0ccf7d5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.156005 Oct 28 20:34:09.637282 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1552/3108] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:09 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:10.661036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3167bfdf-55b3-45e9-a57c-f549971970fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:10.661783 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3167bfdf-55b3-45e9-a57c-f549971970fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:10.664023 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=26 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:34:10.668823 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3167bfdf-55b3-45e9-a57c-f549971970fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:10.669294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3167bfdf-55b3-45e9-a57c-f549971970fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:10.669766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3167bfdf-55b3-45e9-a57c-f549971970fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:10.670441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3167bfdf-55b3-45e9-a57c-f549971970fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:10.670891 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3167bfdf-55b3-45e9-a57c-f549971970fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:10.671306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3167bfdf-55b3-45e9-a57c-f549971970fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:10.800093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3167bfdf-55b3-45e9-a57c-f549971970fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:10.809452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3167bfdf-55b3-45e9-a57c-f549971970fe tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152269 Oct 28 20:34:10.810011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1557/3109] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:10 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:11.833554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dab055b5-ad54-4de7-bd91-4a872172ddc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:11.834204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dab055b5-ad54-4de7-bd91-4a872172ddc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:11.841156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab055b5-ad54-4de7-bd91-4a872172ddc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:11.841682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab055b5-ad54-4de7-bd91-4a872172ddc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:11.842121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab055b5-ad54-4de7-bd91-4a872172ddc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:11.842803 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab055b5-ad54-4de7-bd91-4a872172ddc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:11.843257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab055b5-ad54-4de7-bd91-4a872172ddc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:11.843680 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab055b5-ad54-4de7-bd91-4a872172ddc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:11.847542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=78 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:34:11.971510 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-dab055b5-ad54-4de7-bd91-4a872172ddc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:11.980037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dab055b5-ad54-4de7-bd91-4a872172ddc0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150371 Oct 28 20:34:11.980602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1553/3110] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:11 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:13.003839 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75c2bdcb-ccab-4dc9-b9be-6a8b30749e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:13.004488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-75c2bdcb-ccab-4dc9-b9be-6a8b30749e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:13.011857 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75c2bdcb-ccab-4dc9-b9be-6a8b30749e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:13.012348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75c2bdcb-ccab-4dc9-b9be-6a8b30749e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:13.012794 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75c2bdcb-ccab-4dc9-b9be-6a8b30749e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:13.013522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75c2bdcb-ccab-4dc9-b9be-6a8b30749e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:13.013984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75c2bdcb-ccab-4dc9-b9be-6a8b30749e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:13.014424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75c2bdcb-ccab-4dc9-b9be-6a8b30749e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:13.144431 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-75c2bdcb-ccab-4dc9-b9be-6a8b30749e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:13.153488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-75c2bdcb-ccab-4dc9-b9be-6a8b30749e03 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153479 Oct 28 20:34:13.154045 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1558/3111] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:12 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:14.176564 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-716df97e-0c48-4dc7-a006-f23b48a6407d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:14.177186 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-716df97e-0c48-4dc7-a006-f23b48a6407d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:14.183696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-716df97e-0c48-4dc7-a006-f23b48a6407d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:14.184180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-716df97e-0c48-4dc7-a006-f23b48a6407d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:14.184622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-716df97e-0c48-4dc7-a006-f23b48a6407d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:14.185304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-716df97e-0c48-4dc7-a006-f23b48a6407d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:14.185792 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-716df97e-0c48-4dc7-a006-f23b48a6407d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:14.186218 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-716df97e-0c48-4dc7-a006-f23b48a6407d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:14.313836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-716df97e-0c48-4dc7-a006-f23b48a6407d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:14.321949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-716df97e-0c48-4dc7-a006-f23b48a6407d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149185 Oct 28 20:34:14.322518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1554/3112] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:14 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:15.346031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f83968c0-ecb6-4c7c-b4e7-819ee8b01095 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:15.346564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f83968c0-ecb6-4c7c-b4e7-819ee8b01095 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:15.352798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f83968c0-ecb6-4c7c-b4e7-819ee8b01095 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:15.353799 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f83968c0-ecb6-4c7c-b4e7-819ee8b01095 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:15.354476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f83968c0-ecb6-4c7c-b4e7-819ee8b01095 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:15.355155 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f83968c0-ecb6-4c7c-b4e7-819ee8b01095 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:15.355601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f83968c0-ecb6-4c7c-b4e7-819ee8b01095 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:15.356013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f83968c0-ecb6-4c7c-b4e7-819ee8b01095 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:15.484172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f83968c0-ecb6-4c7c-b4e7-819ee8b01095 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:15.492197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f83968c0-ecb6-4c7c-b4e7-819ee8b01095 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150095 Oct 28 20:34:15.492758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1559/3113] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:15 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:16.515649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f76412ed-bdbd-4ead-bd4d-b5715ac6ef00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:16.516293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f76412ed-bdbd-4ead-bd4d-b5715ac6ef00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:16.522622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f76412ed-bdbd-4ead-bd4d-b5715ac6ef00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:16.523131 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f76412ed-bdbd-4ead-bd4d-b5715ac6ef00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:16.523572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f76412ed-bdbd-4ead-bd4d-b5715ac6ef00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:16.524254 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f76412ed-bdbd-4ead-bd4d-b5715ac6ef00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:16.524708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f76412ed-bdbd-4ead-bd4d-b5715ac6ef00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:16.525901 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f76412ed-bdbd-4ead-bd4d-b5715ac6ef00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:16.663623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f76412ed-bdbd-4ead-bd4d-b5715ac6ef00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:16.671697 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f76412ed-bdbd-4ead-bd4d-b5715ac6ef00 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.159913 Oct 28 20:34:16.672266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1555/3114] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:16 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:17.694947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1994104b-54bc-4c3c-a9ef-ee7cf89f2244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:17.695707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1994104b-54bc-4c3c-a9ef-ee7cf89f2244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:17.702735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1994104b-54bc-4c3c-a9ef-ee7cf89f2244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:17.703224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1994104b-54bc-4c3c-a9ef-ee7cf89f2244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:17.703727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1994104b-54bc-4c3c-a9ef-ee7cf89f2244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:17.704415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1994104b-54bc-4c3c-a9ef-ee7cf89f2244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:17.704868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1994104b-54bc-4c3c-a9ef-ee7cf89f2244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:17.705291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1994104b-54bc-4c3c-a9ef-ee7cf89f2244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:17.835806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1994104b-54bc-4c3c-a9ef-ee7cf89f2244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:17.843996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1994104b-54bc-4c3c-a9ef-ee7cf89f2244 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153098 Oct 28 20:34:17.844544 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1560/3115] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:17 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:18.866353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d234a940-d45a-4062-880b-72be28e3220c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:18.866957 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d234a940-d45a-4062-880b-72be28e3220c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:18.875539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d234a940-d45a-4062-880b-72be28e3220c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:18.876039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d234a940-d45a-4062-880b-72be28e3220c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:18.876483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d234a940-d45a-4062-880b-72be28e3220c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:18.877295 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d234a940-d45a-4062-880b-72be28e3220c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:18.877776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d234a940-d45a-4062-880b-72be28e3220c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:18.878204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d234a940-d45a-4062-880b-72be28e3220c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:19.010645 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d234a940-d45a-4062-880b-72be28e3220c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:19.018960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d234a940-d45a-4062-880b-72be28e3220c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.156437 Oct 28 20:34:19.019530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1556/3116] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:18 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:34:20.043987 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-16650a92-1cdb-40f7-9c3b-c2cd5a01f731 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:20.044594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-16650a92-1cdb-40f7-9c3b-c2cd5a01f731 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:20.047076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:34:20.047217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:34:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 (ip 10.222.0.66) !!! Oct 28 20:34:20.053024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16650a92-1cdb-40f7-9c3b-c2cd5a01f731 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:20.053535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16650a92-1cdb-40f7-9c3b-c2cd5a01f731 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:20.053964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16650a92-1cdb-40f7-9c3b-c2cd5a01f731 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:20.054638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16650a92-1cdb-40f7-9c3b-c2cd5a01f731 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:20.055085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16650a92-1cdb-40f7-9c3b-c2cd5a01f731 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:20.055504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16650a92-1cdb-40f7-9c3b-c2cd5a01f731 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:20.187458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-16650a92-1cdb-40f7-9c3b-c2cd5a01f731 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:20.195373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-16650a92-1cdb-40f7-9c3b-c2cd5a01f731 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155760 Oct 28 20:34:20.195924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1561/3117] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:20 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:21.218655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-da6c6a91-2544-49c8-8608-e9f387e5f707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:21.219269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-da6c6a91-2544-49c8-8608-e9f387e5f707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:21.221704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:34:21.221850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:34:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 (ip 10.222.0.66) !!! Oct 28 20:34:21.228654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da6c6a91-2544-49c8-8608-e9f387e5f707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:21.229216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da6c6a91-2544-49c8-8608-e9f387e5f707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:21.229937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da6c6a91-2544-49c8-8608-e9f387e5f707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:21.230626 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da6c6a91-2544-49c8-8608-e9f387e5f707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:21.231079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da6c6a91-2544-49c8-8608-e9f387e5f707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:21.231503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da6c6a91-2544-49c8-8608-e9f387e5f707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:21.357904 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-da6c6a91-2544-49c8-8608-e9f387e5f707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:21.366086 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-da6c6a91-2544-49c8-8608-e9f387e5f707 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151234 Oct 28 20:34:21.366647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1557/3118] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:21 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:22.390332 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34838586-2d03-4c60-9b6a-03dd3d03d9ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:22.390945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-34838586-2d03-4c60-9b6a-03dd3d03d9ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:22.397434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34838586-2d03-4c60-9b6a-03dd3d03d9ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:22.397919 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34838586-2d03-4c60-9b6a-03dd3d03d9ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:22.398361 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34838586-2d03-4c60-9b6a-03dd3d03d9ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:22.399050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34838586-2d03-4c60-9b6a-03dd3d03d9ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:22.399507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34838586-2d03-4c60-9b6a-03dd3d03d9ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:22.400179 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34838586-2d03-4c60-9b6a-03dd3d03d9ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:22.525030 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-34838586-2d03-4c60-9b6a-03dd3d03d9ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:22.533464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-34838586-2d03-4c60-9b6a-03dd3d03d9ee tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.146899 Oct 28 20:34:22.534095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1562/3119] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:22 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:23.556844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c22d465f-6311-4c77-9802-39914740febb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:23.557504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c22d465f-6311-4c77-9802-39914740febb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:23.563812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c22d465f-6311-4c77-9802-39914740febb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:23.564292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c22d465f-6311-4c77-9802-39914740febb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:23.564726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c22d465f-6311-4c77-9802-39914740febb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:23.565428 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c22d465f-6311-4c77-9802-39914740febb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:23.565915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c22d465f-6311-4c77-9802-39914740febb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:23.566385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c22d465f-6311-4c77-9802-39914740febb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:23.703613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c22d465f-6311-4c77-9802-39914740febb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:23.711702 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c22d465f-6311-4c77-9802-39914740febb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.158914 Oct 28 20:34:23.712952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1558/3120] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:23 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:24.736018 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85d3ec91-b82a-44a1-887a-0d9c9108574a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:24.740658 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-85d3ec91-b82a-44a1-887a-0d9c9108574a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:24.743084 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d3ec91-b82a-44a1-887a-0d9c9108574a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:24.744064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d3ec91-b82a-44a1-887a-0d9c9108574a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:24.744496 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d3ec91-b82a-44a1-887a-0d9c9108574a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:24.745164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d3ec91-b82a-44a1-887a-0d9c9108574a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:24.745647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d3ec91-b82a-44a1-887a-0d9c9108574a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:24.746098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d3ec91-b82a-44a1-887a-0d9c9108574a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:24.881979 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-85d3ec91-b82a-44a1-887a-0d9c9108574a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:24.892686 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-85d3ec91-b82a-44a1-887a-0d9c9108574a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.160478 Oct 28 20:34:24.893246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1563/3121] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:24 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:25.916156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d8dfd3f7-7641-4ea3-b464-d89dad7dbf18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:25.916892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d8dfd3f7-7641-4ea3-b464-d89dad7dbf18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:25.922751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8dfd3f7-7641-4ea3-b464-d89dad7dbf18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:25.923231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8dfd3f7-7641-4ea3-b464-d89dad7dbf18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:25.923664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8dfd3f7-7641-4ea3-b464-d89dad7dbf18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:25.924339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8dfd3f7-7641-4ea3-b464-d89dad7dbf18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:25.924788 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8dfd3f7-7641-4ea3-b464-d89dad7dbf18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:25.925207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8dfd3f7-7641-4ea3-b464-d89dad7dbf18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:26.058704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d8dfd3f7-7641-4ea3-b464-d89dad7dbf18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:26.066823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d8dfd3f7-7641-4ea3-b464-d89dad7dbf18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154674 Oct 28 20:34:26.067392 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1559/3122] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:25 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:27.090740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5f70c096-64e1-43be-a3bd-095bde64107a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:27.091338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5f70c096-64e1-43be-a3bd-095bde64107a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:27.097738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f70c096-64e1-43be-a3bd-095bde64107a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:27.098206 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f70c096-64e1-43be-a3bd-095bde64107a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:27.098666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f70c096-64e1-43be-a3bd-095bde64107a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:27.099298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f70c096-64e1-43be-a3bd-095bde64107a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:27.099739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f70c096-64e1-43be-a3bd-095bde64107a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:27.100160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f70c096-64e1-43be-a3bd-095bde64107a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:27.230131 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5f70c096-64e1-43be-a3bd-095bde64107a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:27.238335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5f70c096-64e1-43be-a3bd-095bde64107a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151622 Oct 28 20:34:27.238893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1564/3123] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:27 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:28.262570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9ed8de6-d624-4fdf-accd-8a29dc4b1097 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:28.263186 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f9ed8de6-d624-4fdf-accd-8a29dc4b1097 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:28.269627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9ed8de6-d624-4fdf-accd-8a29dc4b1097 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:28.270113 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9ed8de6-d624-4fdf-accd-8a29dc4b1097 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:28.270555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9ed8de6-d624-4fdf-accd-8a29dc4b1097 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:28.271278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9ed8de6-d624-4fdf-accd-8a29dc4b1097 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:28.271804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9ed8de6-d624-4fdf-accd-8a29dc4b1097 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:28.272233 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9ed8de6-d624-4fdf-accd-8a29dc4b1097 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:28.400164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f9ed8de6-d624-4fdf-accd-8a29dc4b1097 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:28.409028 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f9ed8de6-d624-4fdf-accd-8a29dc4b1097 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150612 Oct 28 20:34:28.409632 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1560/3124] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:28 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:29.433018 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf7db897-b9e6-4876-9343-2a35b535ae20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:29.433580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cf7db897-b9e6-4876-9343-2a35b535ae20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:29.439971 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf7db897-b9e6-4876-9343-2a35b535ae20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:29.440456 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf7db897-b9e6-4876-9343-2a35b535ae20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:29.440897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf7db897-b9e6-4876-9343-2a35b535ae20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:29.441619 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf7db897-b9e6-4876-9343-2a35b535ae20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:29.442086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf7db897-b9e6-4876-9343-2a35b535ae20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:29.442512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf7db897-b9e6-4876-9343-2a35b535ae20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:29.576014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cf7db897-b9e6-4876-9343-2a35b535ae20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:29.584026 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cf7db897-b9e6-4876-9343-2a35b535ae20 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155010 Oct 28 20:34:29.584577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1565/3125] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:29 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:30.607583 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40624778-919d-4802-8e86-6610017ac78f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:30.608202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-40624778-919d-4802-8e86-6610017ac78f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:30.610772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:34:30.610919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:34:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 (ip 10.222.0.66) !!! Oct 28 20:34:30.616476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40624778-919d-4802-8e86-6610017ac78f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:30.616959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40624778-919d-4802-8e86-6610017ac78f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:30.617427 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40624778-919d-4802-8e86-6610017ac78f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:30.618116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40624778-919d-4802-8e86-6610017ac78f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:30.618571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40624778-919d-4802-8e86-6610017ac78f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:30.618994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40624778-919d-4802-8e86-6610017ac78f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:30.747834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-40624778-919d-4802-8e86-6610017ac78f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:30.755977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-40624778-919d-4802-8e86-6610017ac78f tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153054 Oct 28 20:34:30.756546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1561/3126] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:30 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:31.780609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d55ff3a0-b666-42c3-8bdf-f01b9180813c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:31.781257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d55ff3a0-b666-42c3-8bdf-f01b9180813c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:31.787806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d55ff3a0-b666-42c3-8bdf-f01b9180813c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:31.788286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d55ff3a0-b666-42c3-8bdf-f01b9180813c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:31.788727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d55ff3a0-b666-42c3-8bdf-f01b9180813c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:31.789515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d55ff3a0-b666-42c3-8bdf-f01b9180813c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:31.789977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d55ff3a0-b666-42c3-8bdf-f01b9180813c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:31.790407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d55ff3a0-b666-42c3-8bdf-f01b9180813c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:31.921141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d55ff3a0-b666-42c3-8bdf-f01b9180813c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:31.929366 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d55ff3a0-b666-42c3-8bdf-f01b9180813c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153367 Oct 28 20:34:31.929921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1566/3127] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:31 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:32.954203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4983e3af-a6ea-497e-92d5-280e38b93e3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:32.954835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4983e3af-a6ea-497e-92d5-280e38b93e3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:32.961138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4983e3af-a6ea-497e-92d5-280e38b93e3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:32.961652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4983e3af-a6ea-497e-92d5-280e38b93e3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:32.962086 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4983e3af-a6ea-497e-92d5-280e38b93e3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:32.962763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4983e3af-a6ea-497e-92d5-280e38b93e3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:32.963212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4983e3af-a6ea-497e-92d5-280e38b93e3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:32.963630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4983e3af-a6ea-497e-92d5-280e38b93e3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:33.093935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4983e3af-a6ea-497e-92d5-280e38b93e3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:33.102045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4983e3af-a6ea-497e-92d5-280e38b93e3c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151706 Oct 28 20:34:33.102602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1562/3128] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:32 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:34.126740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-59ea5052-8ae9-441a-b42f-222a0fb4de7a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:34.127356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-59ea5052-8ae9-441a-b42f-222a0fb4de7a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:34.133785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59ea5052-8ae9-441a-b42f-222a0fb4de7a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:34.134268 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59ea5052-8ae9-441a-b42f-222a0fb4de7a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:34.134735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59ea5052-8ae9-441a-b42f-222a0fb4de7a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:34.135420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59ea5052-8ae9-441a-b42f-222a0fb4de7a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:34.135875 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59ea5052-8ae9-441a-b42f-222a0fb4de7a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:34.136299 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59ea5052-8ae9-441a-b42f-222a0fb4de7a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:34.265504 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-59ea5052-8ae9-441a-b42f-222a0fb4de7a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:34.273591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-59ea5052-8ae9-441a-b42f-222a0fb4de7a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150656 Oct 28 20:34:34.274157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1567/3129] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:34 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:35.298106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-00048ed7-b35a-4f7d-9048-41b7574a5e39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:35.298671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-00048ed7-b35a-4f7d-9048-41b7574a5e39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:35.305156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00048ed7-b35a-4f7d-9048-41b7574a5e39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:35.305667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00048ed7-b35a-4f7d-9048-41b7574a5e39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:35.306101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00048ed7-b35a-4f7d-9048-41b7574a5e39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:35.306780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00048ed7-b35a-4f7d-9048-41b7574a5e39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:35.307231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00048ed7-b35a-4f7d-9048-41b7574a5e39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:35.307649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00048ed7-b35a-4f7d-9048-41b7574a5e39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:35.682749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-00048ed7-b35a-4f7d-9048-41b7574a5e39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:35.691209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-00048ed7-b35a-4f7d-9048-41b7574a5e39 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.396995 Oct 28 20:34:35.691776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1563/3130] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:35 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:36.714158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0bf6c7ab-0f80-442a-845d-b619646a54df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:36.715103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0bf6c7ab-0f80-442a-845d-b619646a54df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:36.721384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bf6c7ab-0f80-442a-845d-b619646a54df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:36.721866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bf6c7ab-0f80-442a-845d-b619646a54df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:36.722305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bf6c7ab-0f80-442a-845d-b619646a54df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:36.722986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bf6c7ab-0f80-442a-845d-b619646a54df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:36.723440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bf6c7ab-0f80-442a-845d-b619646a54df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:36.723864 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bf6c7ab-0f80-442a-845d-b619646a54df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:36.850721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0bf6c7ab-0f80-442a-845d-b619646a54df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:36.859833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0bf6c7ab-0f80-442a-845d-b619646a54df tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.149489 Oct 28 20:34:36.860396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1568/3131] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:36 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:37.883834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b0bad498-2711-4b1d-ac97-3cd56139cfdb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:37.884480 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b0bad498-2711-4b1d-ac97-3cd56139cfdb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:37.891875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0bad498-2711-4b1d-ac97-3cd56139cfdb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:37.892369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0bad498-2711-4b1d-ac97-3cd56139cfdb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:37.892857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0bad498-2711-4b1d-ac97-3cd56139cfdb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:37.893589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0bad498-2711-4b1d-ac97-3cd56139cfdb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:37.894052 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0bad498-2711-4b1d-ac97-3cd56139cfdb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:37.894483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0bad498-2711-4b1d-ac97-3cd56139cfdb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:38.025249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b0bad498-2711-4b1d-ac97-3cd56139cfdb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:38.035001 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b0bad498-2711-4b1d-ac97-3cd56139cfdb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154906 Oct 28 20:34:38.035574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1564/3132] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:37 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:39.059989 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-692ef6ef-b222-4b30-8cbc-80469707d605 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:39.060629 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-692ef6ef-b222-4b30-8cbc-80469707d605 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:39.066976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-692ef6ef-b222-4b30-8cbc-80469707d605 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:39.067460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-692ef6ef-b222-4b30-8cbc-80469707d605 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:39.067900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-692ef6ef-b222-4b30-8cbc-80469707d605 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:39.068591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-692ef6ef-b222-4b30-8cbc-80469707d605 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:39.069045 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-692ef6ef-b222-4b30-8cbc-80469707d605 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:39.069507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-692ef6ef-b222-4b30-8cbc-80469707d605 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:39.073351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=78 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:34:39.195240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-692ef6ef-b222-4b30-8cbc-80469707d605 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:39.203286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-692ef6ef-b222-4b30-8cbc-80469707d605 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148116 Oct 28 20:34:39.203784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1569/3133] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:39 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:40.226411 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0d709831-2d57-4c08-8f46-9c4e16befb89 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:40.227022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0d709831-2d57-4c08-8f46-9c4e16befb89 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:40.229284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=26 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:34:40.235158 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d709831-2d57-4c08-8f46-9c4e16befb89 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:40.235644 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d709831-2d57-4c08-8f46-9c4e16befb89 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:40.236084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d709831-2d57-4c08-8f46-9c4e16befb89 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:40.236765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d709831-2d57-4c08-8f46-9c4e16befb89 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:40.237218 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d709831-2d57-4c08-8f46-9c4e16befb89 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:40.237667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d709831-2d57-4c08-8f46-9c4e16befb89 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:40.365231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0d709831-2d57-4c08-8f46-9c4e16befb89 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:40.373833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0d709831-2d57-4c08-8f46-9c4e16befb89 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151235 Oct 28 20:34:40.374406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1565/3134] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:40 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:41.397012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b4257be3-a90a-4b91-bcac-be5fa81857a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:41.397601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b4257be3-a90a-4b91-bcac-be5fa81857a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:41.399844 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=26 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:34:41.404693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4257be3-a90a-4b91-bcac-be5fa81857a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:41.405171 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4257be3-a90a-4b91-bcac-be5fa81857a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:41.405644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4257be3-a90a-4b91-bcac-be5fa81857a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:41.406996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4257be3-a90a-4b91-bcac-be5fa81857a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:41.407471 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4257be3-a90a-4b91-bcac-be5fa81857a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:41.407910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4257be3-a90a-4b91-bcac-be5fa81857a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:41.533458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b4257be3-a90a-4b91-bcac-be5fa81857a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:41.541676 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b4257be3-a90a-4b91-bcac-be5fa81857a9 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148620 Oct 28 20:34:41.542236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1570/3135] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:41 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:42.565364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-057072f8-6849-4fbf-b1ec-9757921a1b93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:42.565975 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-057072f8-6849-4fbf-b1ec-9757921a1b93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:42.572402 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-057072f8-6849-4fbf-b1ec-9757921a1b93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:42.572881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-057072f8-6849-4fbf-b1ec-9757921a1b93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:42.573313 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-057072f8-6849-4fbf-b1ec-9757921a1b93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:42.574817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-057072f8-6849-4fbf-b1ec-9757921a1b93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:42.575313 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-057072f8-6849-4fbf-b1ec-9757921a1b93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:42.575731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-057072f8-6849-4fbf-b1ec-9757921a1b93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:42.578279 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=78 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:34:42.708008 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-057072f8-6849-4fbf-b1ec-9757921a1b93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:42.714855 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-057072f8-6849-4fbf-b1ec-9757921a1b93 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.153097 Oct 28 20:34:42.715437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1566/3136] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:42 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:43.739102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4f396f3d-a3db-4927-bd1c-e22ff2e6a805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:43.739635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4f396f3d-a3db-4927-bd1c-e22ff2e6a805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:43.746291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f396f3d-a3db-4927-bd1c-e22ff2e6a805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:43.746757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f396f3d-a3db-4927-bd1c-e22ff2e6a805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:43.747196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f396f3d-a3db-4927-bd1c-e22ff2e6a805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:43.747900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f396f3d-a3db-4927-bd1c-e22ff2e6a805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:43.748363 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f396f3d-a3db-4927-bd1c-e22ff2e6a805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:43.748785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f396f3d-a3db-4927-bd1c-e22ff2e6a805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:43.877810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f396f3d-a3db-4927-bd1c-e22ff2e6a805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:43.885860 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4f396f3d-a3db-4927-bd1c-e22ff2e6a805 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150750 Oct 28 20:34:43.886538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1571/3137] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:43 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:44.909040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-499dd497-48f3-4a12-b4b2-0b355d2a9309 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:44.909691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-499dd497-48f3-4a12-b4b2-0b355d2a9309 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:44.915978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-499dd497-48f3-4a12-b4b2-0b355d2a9309 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:44.916454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-499dd497-48f3-4a12-b4b2-0b355d2a9309 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:44.916881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-499dd497-48f3-4a12-b4b2-0b355d2a9309 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:44.918209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-499dd497-48f3-4a12-b4b2-0b355d2a9309 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:44.918659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-499dd497-48f3-4a12-b4b2-0b355d2a9309 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:44.919083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-499dd497-48f3-4a12-b4b2-0b355d2a9309 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:45.055167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-499dd497-48f3-4a12-b4b2-0b355d2a9309 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:45.063659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-499dd497-48f3-4a12-b4b2-0b355d2a9309 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.158323 Oct 28 20:34:45.064167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1567/3138] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:44 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:46.087101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8e6d1df5-197f-4c15-9989-7e0ab1453bb2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:46.087704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8e6d1df5-197f-4c15-9989-7e0ab1453bb2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:46.089793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:34:46.089935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:34:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 (ip 10.222.0.66) !!! Oct 28 20:34:46.095814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e6d1df5-197f-4c15-9989-7e0ab1453bb2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:46.096289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e6d1df5-197f-4c15-9989-7e0ab1453bb2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:46.096721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e6d1df5-197f-4c15-9989-7e0ab1453bb2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:46.097430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e6d1df5-197f-4c15-9989-7e0ab1453bb2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:46.097879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e6d1df5-197f-4c15-9989-7e0ab1453bb2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:46.098309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e6d1df5-197f-4c15-9989-7e0ab1453bb2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:46.230332 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8e6d1df5-197f-4c15-9989-7e0ab1453bb2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:46.238657 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8e6d1df5-197f-4c15-9989-7e0ab1453bb2 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155283 Oct 28 20:34:46.239216 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1572/3139] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:46 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:47.263044 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5e93895a-0afa-4546-9632-adcef03574d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:47.263655 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5e93895a-0afa-4546-9632-adcef03574d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:47.270007 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e93895a-0afa-4546-9632-adcef03574d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:47.270491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e93895a-0afa-4546-9632-adcef03574d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:47.270937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e93895a-0afa-4546-9632-adcef03574d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:47.271608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e93895a-0afa-4546-9632-adcef03574d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:47.272064 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e93895a-0afa-4546-9632-adcef03574d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:47.272491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e93895a-0afa-4546-9632-adcef03574d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:47.400078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5e93895a-0afa-4546-9632-adcef03574d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:47.409134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5e93895a-0afa-4546-9632-adcef03574d8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150774 Oct 28 20:34:47.414653 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1568/3140] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:47 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:48.432314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fbd779bf-7153-4432-89fd-ce64d445fca0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:48.432871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fbd779bf-7153-4432-89fd-ce64d445fca0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:48.439357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd779bf-7153-4432-89fd-ce64d445fca0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:48.439836 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd779bf-7153-4432-89fd-ce64d445fca0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:48.440267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd779bf-7153-4432-89fd-ce64d445fca0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:48.440945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd779bf-7153-4432-89fd-ce64d445fca0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:48.441435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd779bf-7153-4432-89fd-ce64d445fca0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:48.441838 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd779bf-7153-4432-89fd-ce64d445fca0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:48.577145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fbd779bf-7153-4432-89fd-ce64d445fca0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:48.585404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fbd779bf-7153-4432-89fd-ce64d445fca0 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.157219 Oct 28 20:34:48.586022 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1573/3141] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:48 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:49.610069 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4d336453-630c-4a77-bb15-ad0a1ad2701d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:49.610683 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4d336453-630c-4a77-bb15-ad0a1ad2701d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:49.617335 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d336453-630c-4a77-bb15-ad0a1ad2701d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:49.617837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d336453-630c-4a77-bb15-ad0a1ad2701d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:49.618284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d336453-630c-4a77-bb15-ad0a1ad2701d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:49.618999 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d336453-630c-4a77-bb15-ad0a1ad2701d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:49.619487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d336453-630c-4a77-bb15-ad0a1ad2701d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:49.619916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d336453-630c-4a77-bb15-ad0a1ad2701d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:49.747940 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4d336453-630c-4a77-bb15-ad0a1ad2701d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:49.756076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4d336453-630c-4a77-bb15-ad0a1ad2701d tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151177 Oct 28 20:34:49.756648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1569/3142] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:49 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:50.779282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b0ad1f0e-9fc0-43b4-8eec-c28652a612b8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:50.779924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b0ad1f0e-9fc0-43b4-8eec-c28652a612b8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:50.786278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0ad1f0e-9fc0-43b4-8eec-c28652a612b8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:50.786767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0ad1f0e-9fc0-43b4-8eec-c28652a612b8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:50.787204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0ad1f0e-9fc0-43b4-8eec-c28652a612b8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:50.787892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0ad1f0e-9fc0-43b4-8eec-c28652a612b8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:50.788347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0ad1f0e-9fc0-43b4-8eec-c28652a612b8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:50.788773 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0ad1f0e-9fc0-43b4-8eec-c28652a612b8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:50.915411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b0ad1f0e-9fc0-43b4-8eec-c28652a612b8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:50.923463 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b0ad1f0e-9fc0-43b4-8eec-c28652a612b8 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.148478 Oct 28 20:34:50.924015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1574/3143] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:50 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:51.946503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c8579319-b786-4299-ad0a-da0dd2b4e52b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:51.947112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c8579319-b786-4299-ad0a-da0dd2b4e52b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:51.953728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8579319-b786-4299-ad0a-da0dd2b4e52b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:51.954207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8579319-b786-4299-ad0a-da0dd2b4e52b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:51.954643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8579319-b786-4299-ad0a-da0dd2b4e52b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:51.955316 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8579319-b786-4299-ad0a-da0dd2b4e52b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:51.955762 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8579319-b786-4299-ad0a-da0dd2b4e52b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:51.956189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8579319-b786-4299-ad0a-da0dd2b4e52b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:52.085561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c8579319-b786-4299-ad0a-da0dd2b4e52b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:52.093898 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c8579319-b786-4299-ad0a-da0dd2b4e52b tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151240 Oct 28 20:34:52.094466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1570/3144] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:51 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:53.118301 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0d125db0-324d-4ac7-9fd4-3c710bc485f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:53.118913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0d125db0-324d-4ac7-9fd4-3c710bc485f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:53.125821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d125db0-324d-4ac7-9fd4-3c710bc485f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:53.126302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d125db0-324d-4ac7-9fd4-3c710bc485f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:53.126736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d125db0-324d-4ac7-9fd4-3c710bc485f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:53.127415 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d125db0-324d-4ac7-9fd4-3c710bc485f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:53.127862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d125db0-324d-4ac7-9fd4-3c710bc485f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:53.128280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d125db0-324d-4ac7-9fd4-3c710bc485f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:53.261449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0d125db0-324d-4ac7-9fd4-3c710bc485f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:53.269965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0d125db0-324d-4ac7-9fd4-3c710bc485f1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155366 Oct 28 20:34:53.270739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1575/3145] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:53 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:34:54.293077 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c345e2c-72f9-40c1-8343-9f9fc918c510 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:54.293633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8c345e2c-72f9-40c1-8343-9f9fc918c510 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:54.300105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c345e2c-72f9-40c1-8343-9f9fc918c510 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:54.300596 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c345e2c-72f9-40c1-8343-9f9fc918c510 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:54.301028 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c345e2c-72f9-40c1-8343-9f9fc918c510 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:54.301731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c345e2c-72f9-40c1-8343-9f9fc918c510 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:54.302181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c345e2c-72f9-40c1-8343-9f9fc918c510 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:54.302599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c345e2c-72f9-40c1-8343-9f9fc918c510 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:54.431471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8c345e2c-72f9-40c1-8343-9f9fc918c510 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:54.440044 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8c345e2c-72f9-40c1-8343-9f9fc918c510 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.150985 Oct 28 20:34:54.440599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1571/3146] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:54 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:55.463054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6514eeca-9621-40b2-9ef8-419934fb5e08 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:55.463691 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6514eeca-9621-40b2-9ef8-419934fb5e08 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:55.471143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6514eeca-9621-40b2-9ef8-419934fb5e08 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:55.471623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6514eeca-9621-40b2-9ef8-419934fb5e08 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:55.472063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6514eeca-9621-40b2-9ef8-419934fb5e08 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:55.472749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6514eeca-9621-40b2-9ef8-419934fb5e08 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:55.473208 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6514eeca-9621-40b2-9ef8-419934fb5e08 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:55.473670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6514eeca-9621-40b2-9ef8-419934fb5e08 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:55.601566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-6514eeca-9621-40b2-9ef8-419934fb5e08 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:55.611055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6514eeca-9621-40b2-9ef8-419934fb5e08 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.151816 Oct 28 20:34:55.613482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1576/3147] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:55 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:56.635593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f98b7bea-2a05-4e58-bd95-af5a7861f578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:56.636204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f98b7bea-2a05-4e58-bd95-af5a7861f578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:56.642648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f98b7bea-2a05-4e58-bd95-af5a7861f578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:56.643129 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f98b7bea-2a05-4e58-bd95-af5a7861f578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:56.643559 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f98b7bea-2a05-4e58-bd95-af5a7861f578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:56.644243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f98b7bea-2a05-4e58-bd95-af5a7861f578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:56.644694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f98b7bea-2a05-4e58-bd95-af5a7861f578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:56.645114 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f98b7bea-2a05-4e58-bd95-af5a7861f578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:56.778237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f98b7bea-2a05-4e58-bd95-af5a7861f578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:56.786314 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f98b7bea-2a05-4e58-bd95-af5a7861f578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.154751 Oct 28 20:34:56.786874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1572/3148] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:56 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:57.809944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c064c1a3-471c-419c-8bfe-a21c78a5b72c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:57.810550 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c064c1a3-471c-419c-8bfe-a21c78a5b72c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:57.817097 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c064c1a3-471c-419c-8bfe-a21c78a5b72c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:57.817615 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c064c1a3-471c-419c-8bfe-a21c78a5b72c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:57.818052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c064c1a3-471c-419c-8bfe-a21c78a5b72c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:57.818731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c064c1a3-471c-419c-8bfe-a21c78a5b72c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:57.819179 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c064c1a3-471c-419c-8bfe-a21c78a5b72c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:57.819597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c064c1a3-471c-419c-8bfe-a21c78a5b72c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:57.946828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c064c1a3-471c-419c-8bfe-a21c78a5b72c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:57.962905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c064c1a3-471c-419c-8bfe-a21c78a5b72c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.157354 Oct 28 20:34:57.963633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1577/3149] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:57 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:58.987132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd9fcaba-bead-457d-bb02-eb6bcd916a72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:58.987745 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd9fcaba-bead-457d-bb02-eb6bcd916a72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:58.994457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd9fcaba-bead-457d-bb02-eb6bcd916a72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:58.994928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd9fcaba-bead-457d-bb02-eb6bcd916a72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:58.995367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd9fcaba-bead-457d-bb02-eb6bcd916a72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:58.996083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd9fcaba-bead-457d-bb02-eb6bcd916a72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:58.996587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd9fcaba-bead-457d-bb02-eb6bcd916a72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:58.997272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd9fcaba-bead-457d-bb02-eb6bcd916a72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:59.128023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fd9fcaba-bead-457d-bb02-eb6bcd916a72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:59.136090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd9fcaba-bead-457d-bb02-eb6bcd916a72 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.152747 Oct 28 20:34:59.136657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1573/3150] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:58 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:00.159972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-51fbaad2-14c4-4e07-a985-03e1dd355e69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:00.160522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-51fbaad2-14c4-4e07-a985-03e1dd355e69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:00.166873 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51fbaad2-14c4-4e07-a985-03e1dd355e69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:00.167335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51fbaad2-14c4-4e07-a985-03e1dd355e69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:00.167771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51fbaad2-14c4-4e07-a985-03e1dd355e69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:00.168490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51fbaad2-14c4-4e07-a985-03e1dd355e69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:00.168945 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51fbaad2-14c4-4e07-a985-03e1dd355e69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:00.169398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51fbaad2-14c4-4e07-a985-03e1dd355e69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:00.303034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-51fbaad2-14c4-4e07-a985-03e1dd355e69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:00.311291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-51fbaad2-14c4-4e07-a985-03e1dd355e69 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.155297 Oct 28 20:35:00.311889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1578/3151] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:00 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:01.334934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8d873a02-857d-4f39-b80b-8f5c27cdd778 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:01.335543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8d873a02-857d-4f39-b80b-8f5c27cdd778 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:01.342164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d873a02-857d-4f39-b80b-8f5c27cdd778 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:01.342650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d873a02-857d-4f39-b80b-8f5c27cdd778 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:01.343085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d873a02-857d-4f39-b80b-8f5c27cdd778 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:01.343766 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d873a02-857d-4f39-b80b-8f5c27cdd778 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:01.344221 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d873a02-857d-4f39-b80b-8f5c27cdd778 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:01.344647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d873a02-857d-4f39-b80b-8f5c27cdd778 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:01.623904 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8d873a02-857d-4f39-b80b-8f5c27cdd778 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:01.631956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8d873a02-857d-4f39-b80b-8f5c27cdd778 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.300841 Oct 28 20:35:01.632519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1574/3152] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:01 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:02.656440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3dd19ffb-1ff8-4021-9d9e-5ab74ec95f80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:02.657048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3dd19ffb-1ff8-4021-9d9e-5ab74ec95f80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:02.663404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dd19ffb-1ff8-4021-9d9e-5ab74ec95f80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:02.664002 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dd19ffb-1ff8-4021-9d9e-5ab74ec95f80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:02.664440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dd19ffb-1ff8-4021-9d9e-5ab74ec95f80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:02.665121 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dd19ffb-1ff8-4021-9d9e-5ab74ec95f80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:02.665605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dd19ffb-1ff8-4021-9d9e-5ab74ec95f80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:02.666021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dd19ffb-1ff8-4021-9d9e-5ab74ec95f80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:02.801891 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3dd19ffb-1ff8-4021-9d9e-5ab74ec95f80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:02.810646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3dd19ffb-1ff8-4021-9d9e-5ab74ec95f80 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 200 len: 1720 microversion: 2.1 time: 0.158198 Oct 28 20:35:02.810963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1579/3153] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:02 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:02.834576 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-763cce97-c070-47aa-9c63-f8f25fd21dec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '.version_select at 0x7f1f50686430>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:02.967966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-763cce97-c070-47aa-9c63-f8f25fd21dec tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479577245" status: 202 len: 0 microversion: 2.1 time: 0.137233 Oct 28 20:35:02.972199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1575/3154] 10.222.0.66 () {58 vars in 1221 bytes} [Fri Oct 28 20:35:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479577245 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:35:03.018109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-946d22f5-9016-4cc4-b8fa-693bf79cb121 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:03.018606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-946d22f5-9016-4cc4-b8fa-693bf79cb121 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:03.024808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-946d22f5-9016-4cc4-b8fa-693bf79cb121 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:03.025574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-946d22f5-9016-4cc4-b8fa-693bf79cb121 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:03.026536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-946d22f5-9016-4cc4-b8fa-693bf79cb121 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:03.027473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-946d22f5-9016-4cc4-b8fa-693bf79cb121 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:03.028142 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-946d22f5-9016-4cc4-b8fa-693bf79cb121 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:03.029700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-946d22f5-9016-4cc4-b8fa-693bf79cb121 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:03.068696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-946d22f5-9016-4cc4-b8fa-693bf79cb121 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:35:03.383628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-946d22f5-9016-4cc4-b8fa-693bf79cb121 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 204 len: 0 microversion: 2.1 time: 0.369105 Oct 28 20:35:03.384217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1580/3155] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:35:03 2022] DELETE /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:35:03.392691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5590ab54-79a4-4725-bce0-f16de00c2b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:03.393298 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5590ab54-79a4-4725-bce0-f16de00c2b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:03.399189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5590ab54-79a4-4725-bce0-f16de00c2b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:03.399674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5590ab54-79a4-4725-bce0-f16de00c2b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:03.400396 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5590ab54-79a4-4725-bce0-f16de00c2b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:03.401260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5590ab54-79a4-4725-bce0-f16de00c2b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:03.401744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5590ab54-79a4-4725-bce0-f16de00c2b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:03.402333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5590ab54-79a4-4725-bce0-f16de00c2b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:03.567157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5590ab54-79a4-4725-bce0-f16de00c2b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:03.574986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5590ab54-79a4-4725-bce0-f16de00c2b93 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1508 microversion: 2.1 time: 0.186145 Oct 28 20:35:03.575718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1576/3156] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:03 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:35:04.382086 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-25e362c0-e1b5-4501-82bf-79a4ac906ae6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Action: 'create', calling method: .version_select at 0x7f1f507efb80>, body: {"keypair": {"name": "tempest-keypair-1664650839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5YYR0QdKG0OQrcPKES7VLIJkO0CyBpCvo+006b25+iC1alsAPRS5HnR3tm4Max/1dNcMSYmbb1Uv2XJx/gndDP5zO71CQOukA2ZZZ0zV1/lac/dCiRcU6HtQUUSxFgYg=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:35:04.415027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b33546a6-1187-44e4-a522-b8dff7bb16b3 req-9c7c4dcd-11e4-47f7-b356-0f0b63f58b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91", "tag": "bdcc9207-f285-46ee-9af9-3f76e3f40aa4"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:35:04.432851 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-25e362c0-e1b5-4501-82bf-79a4ac906ae6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Getting quotas for project 8b163bdfc7544a3d833bd69dc027c7d6. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:35:04.436231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b33546a6-1187-44e4-a522-b8dff7bb16b3 req-9c7c4dcd-11e4-47f7-b356-0f0b63f58b12 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:04.436725 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b33546a6-1187-44e4-a522-b8dff7bb16b3 req-9c7c4dcd-11e4-47f7-b356-0f0b63f58b12 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:04.437159 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b33546a6-1187-44e4-a522-b8dff7bb16b3 req-9c7c4dcd-11e4-47f7-b356-0f0b63f58b12 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:04.438162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-25e362c0-e1b5-4501-82bf-79a4ac906ae6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Getting quotas for user 15db5106efbd434f99a4d102810cc7a6 and project 8b163bdfc7544a3d833bd69dc027c7d6. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:35:04.463517 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b33546a6-1187-44e4-a522-b8dff7bb16b3 req-9c7c4dcd-11e4-47f7-b356-0f0b63f58b12 service nova] Creating event network-changed:bdcc9207-f285-46ee-9af9-3f76e3f40aa4 for instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 on hv-cinder-86236 Oct 28 20:35:04.469287 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b33546a6-1187-44e4-a522-b8dff7bb16b3 req-9c7c4dcd-11e4-47f7-b356-0f0b63f58b12 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.353190 Oct 28 20:35:04.470292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1581/3157] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:35:04.560486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-cbb47109-6737-4a6c-8266-982577827cba req-03e14e7a-2fc6-40bf-a1c1-8eb8d535ca6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91", "name": "network-vif-deleted", "tag": "bdcc9207-f285-46ee-9af9-3f76e3f40aa4"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:35:04.563631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-25e362c0-e1b5-4501-82bf-79a4ac906ae6 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.185474 Oct 28 20:35:04.564904 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1577/3158] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Oct 28 20:35:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:35:04.575542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-cbb47109-6737-4a6c-8266-982577827cba req-03e14e7a-2fc6-40bf-a1c1-8eb8d535ca6c service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:04.576303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-cbb47109-6737-4a6c-8266-982577827cba req-03e14e7a-2fc6-40bf-a1c1-8eb8d535ca6c service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:04.577209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-cbb47109-6737-4a6c-8266-982577827cba req-03e14e7a-2fc6-40bf-a1c1-8eb8d535ca6c service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:04.594797 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-cbb47109-6737-4a6c-8266-982577827cba req-03e14e7a-2fc6-40bf-a1c1-8eb8d535ca6c service nova] Creating event network-vif-deleted:bdcc9207-f285-46ee-9af9-3f76e3f40aa4 for instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 on hv-cinder-86236 Oct 28 20:35:04.598369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f1efcedd-b5d1-4014-99dd-2201c52c98fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:04.599226 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f1efcedd-b5d1-4014-99dd-2201c52c98fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:04.601348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-cbb47109-6737-4a6c-8266-982577827cba req-03e14e7a-2fc6-40bf-a1c1-8eb8d535ca6c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116037 Oct 28 20:35:04.602249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1582/3159] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:35:04.622837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efcedd-b5d1-4014-99dd-2201c52c98fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:04.622837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efcedd-b5d1-4014-99dd-2201c52c98fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:04.622837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efcedd-b5d1-4014-99dd-2201c52c98fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:04.622837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efcedd-b5d1-4014-99dd-2201c52c98fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:04.623288 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efcedd-b5d1-4014-99dd-2201c52c98fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:04.623288 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1efcedd-b5d1-4014-99dd-2201c52c98fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:04.832829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f1efcedd-b5d1-4014-99dd-2201c52c98fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:04.855290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f1efcedd-b5d1-4014-99dd-2201c52c98fd tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1508 microversion: 2.1 time: 0.259029 Oct 28 20:35:04.873928 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1578/3160] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:04 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:05.939150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9d69e232-d22a-429b-b966-c7053d265bba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:05.939863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9d69e232-d22a-429b-b966-c7053d265bba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:05.946024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d69e232-d22a-429b-b966-c7053d265bba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:05.946559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d69e232-d22a-429b-b966-c7053d265bba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:05.946942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d69e232-d22a-429b-b966-c7053d265bba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:05.947635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d69e232-d22a-429b-b966-c7053d265bba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:05.948085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d69e232-d22a-429b-b966-c7053d265bba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:05.948508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d69e232-d22a-429b-b966-c7053d265bba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:05.979929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d69e232-d22a-429b-b966-c7053d265bba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:05.980393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d69e232-d22a-429b-b966-c7053d265bba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:05.981093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d69e232-d22a-429b-b966-c7053d265bba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:05.982165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-9d69e232-d22a-429b-b966-c7053d265bba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lazy-loading 'fault' on Instance uuid 0e147ba2-cd15-490e-aac0-236beaf41e8d {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:35:06.034300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9d69e232-d22a-429b-b966-c7053d265bba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:06.042350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9d69e232-d22a-429b-b966-c7053d265bba tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 200 len: 1312 microversion: 2.1 time: 0.107970 Oct 28 20:35:06.042923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1583/3161] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:05 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:06.487817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-54a14b10-25fc-46e5-b7d3-7fbd63d8df6e req-deca1dde-f5df-4a3c-8620-79678d4a9dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e147ba2-cd15-490e-aac0-236beaf41e8d", "name": "network-vif-deleted", "tag": "6cbf02ec-6953-458c-9564-3dba0bc9146a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:35:06.498494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-54a14b10-25fc-46e5-b7d3-7fbd63d8df6e req-deca1dde-f5df-4a3c-8620-79678d4a9dc1 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:06.498970 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-54a14b10-25fc-46e5-b7d3-7fbd63d8df6e req-deca1dde-f5df-4a3c-8620-79678d4a9dc1 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:06.499406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-54a14b10-25fc-46e5-b7d3-7fbd63d8df6e req-deca1dde-f5df-4a3c-8620-79678d4a9dc1 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:06.513592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-54a14b10-25fc-46e5-b7d3-7fbd63d8df6e req-deca1dde-f5df-4a3c-8620-79678d4a9dc1 service nova] Creating event network-vif-deleted:6cbf02ec-6953-458c-9564-3dba0bc9146a for instance 0e147ba2-cd15-490e-aac0-236beaf41e8d on hv-cinder-86236 Oct 28 20:35:06.522139 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-54a14b10-25fc-46e5-b7d3-7fbd63d8df6e req-deca1dde-f5df-4a3c-8620-79678d4a9dc1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041273 Oct 28 20:35:06.522735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1579/3162] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:35:07.069786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e7f90585-3f65-47e9-98d4-9ec3cb4e81d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:07.070511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e7f90585-3f65-47e9-98d4-9ec3cb4e81d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 0e147ba2-cd15-490e-aac0-236beaf41e8d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:07.078209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7f90585-3f65-47e9-98d4-9ec3cb4e81d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:07.078703 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7f90585-3f65-47e9-98d4-9ec3cb4e81d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:07.079144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7f90585-3f65-47e9-98d4-9ec3cb4e81d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:07.079962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7f90585-3f65-47e9-98d4-9ec3cb4e81d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:07.080396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7f90585-3f65-47e9-98d4-9ec3cb4e81d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:07.080849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7f90585-3f65-47e9-98d4-9ec3cb4e81d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:07.097682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-e7f90585-3f65-47e9-98d4-9ec3cb4e81d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] HTTP exception thrown: Instance 0e147ba2-cd15-490e-aac0-236beaf41e8d could not be found. Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e7f90585-3f65-47e9-98d4-9ec3cb4e81d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Request method failure captured: Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d HTTP/1.1 Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYVUSBBagLPNomxBBxHq3ECVaXkAjtcHj9JcVNYMaxZVPvZeFF2LWhPgX8h0QTtA_g0RNm0uMh_rJGZJiYwnK43exvmZqU6ooe06pRY35HWRYRkiTryZNEJfiI_TmdWen5RbyVIKZtJPJnUeqzCW__uExFDyZXfsIgrO0yv6wQJTu0 Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: ab907bf956554681beae45b8973db6e5 Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1880496931 Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:35:07.100323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:35:07.101899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ab907bf956554681beae45b8973db6e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ab907bf956554681beae45b8973db6e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ab907bf956554681beae45b8973db6e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ab907bf956554681beae45b8973db6e5", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:35:07.101899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1880496931 Oct 28 20:35:07.101899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: ab907bf956554681beae45b8973db6e5 Oct 28 20:35:07.101899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1880496931 Oct 28 20:35:07.101899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-ServerRescueNegativeTestJSON-1880496931-project Oct 28 20:35:07.101899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:35:07.101899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:35:07.101899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: ce7f52b7f96c400fb7d5fb0453c94362 Oct 28 20:35:07.101899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1880496931-project Oct 28 20:35:07.101899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:35:07.101899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance 0e147ba2-cd15-490e-aac0-236beaf41e8d could not be found. Oct 28 20:35:07.101899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': '0e147ba2-cd15-490e-aac0-236beaf41e8d'} Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e147ba2-cd15-490e-aac0-236beaf41e8d could not be found. Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:35:07.102719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e147ba2-cd15-490e-aac0-236beaf41e8d could not be found. Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e147ba2-cd15-490e-aac0-236beaf41e8d could not be found. Oct 28 20:35:07.103792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:35:07.105828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e7f90585-3f65-47e9-98d4-9ec3cb4e81d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Returning 404 to user: Instance 0e147ba2-cd15-490e-aac0-236beaf41e8d could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:35:07.105828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e7f90585-3f65-47e9-98d4-9ec3cb4e81d3 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d" status: 404 len: 111 microversion: 2.1 time: 0.037243 Oct 28 20:35:07.105828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1584/3163] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:07 2022] GET /compute/v2.1/servers/0e147ba2-cd15-490e-aac0-236beaf41e8d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:35:07.113878 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bbf023a3-ef68-4c67-ac73-7d5e4a452d85 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:07.114389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bbf023a3-ef68-4c67-ac73-7d5e4a452d85 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:07.121458 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbf023a3-ef68-4c67-ac73-7d5e4a452d85 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:07.122514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbf023a3-ef68-4c67-ac73-7d5e4a452d85 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:07.125529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbf023a3-ef68-4c67-ac73-7d5e4a452d85 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:07.125529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbf023a3-ef68-4c67-ac73-7d5e4a452d85 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:07.125529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbf023a3-ef68-4c67-ac73-7d5e4a452d85 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:07.125529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbf023a3-ef68-4c67-ac73-7d5e4a452d85 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:07.152309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bbf023a3-ef68-4c67-ac73-7d5e4a452d85 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:35:07.248492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-81670393", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6255763f-9ff1-4793-9cc5-629a698a3207"}], "security_groups": [{"name": "tempest-securitygroup--2050371826"}], "key_name": "tempest-keypair-1664650839", "user_data": "}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:35:07.354731 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] validate_networks() for [('6255763f-9ff1-4793-9cc5-629a698a3207', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:35:07.451659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bbf023a3-ef68-4c67-ac73-7d5e4a452d85 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 204 len: 0 microversion: 2.1 time: 0.342255 Oct 28 20:35:07.452282 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1580/3164] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:35:07 2022] DELETE /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:35:07.460357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-566c548b-6b83-4cf6-919d-8f73361a94d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:07.461123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-566c548b-6b83-4cf6-919d-8f73361a94d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:07.467424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-566c548b-6b83-4cf6-919d-8f73361a94d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:07.467919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-566c548b-6b83-4cf6-919d-8f73361a94d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:07.468367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-566c548b-6b83-4cf6-919d-8f73361a94d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:07.469050 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-566c548b-6b83-4cf6-919d-8f73361a94d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:07.469546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-566c548b-6b83-4cf6-919d-8f73361a94d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:07.469975 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-566c548b-6b83-4cf6-919d-8f73361a94d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:07.636324 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-566c548b-6b83-4cf6-919d-8f73361a94d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:07.644556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-566c548b-6b83-4cf6-919d-8f73361a94d1 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1521 microversion: 2.1 time: 0.188171 Oct 28 20:35:07.645242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1581/3165] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:07 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:35:07.875192 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:35:07.875621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:35:07.876099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:35:07.876513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:35:07.876928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:35:07.885798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:07.886282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:07.886718 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:07.888038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:07.888500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:07.888931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:07.906554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Getting quotas for project 8b163bdfc7544a3d833bd69dc027c7d6. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:35:07.910573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Getting quotas for user 15db5106efbd434f99a4d102810cc7a6 and project 8b163bdfc7544a3d833bd69dc027c7d6. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:35:07.922433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:35:07.924749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:35:08.093020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-783d67d4-f894-48bc-9d63-a8e0797e1d04 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.849412 Oct 28 20:35:08.094338 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1585/3166] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:35:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 20:35:08.107436 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1579b0ab-b656-49a6-a84a-632362bfcab1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:08.107853 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1579b0ab-b656-49a6-a84a-632362bfcab1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:08.187628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1579b0ab-b656-49a6-a84a-632362bfcab1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:08.195365 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1579b0ab-b656-49a6-a84a-632362bfcab1 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 200 len: 1236 microversion: 2.1 time: 0.093468 Oct 28 20:35:08.205937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1582/3167] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:08 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 1236 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:08.538881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ed13932e-e795-4080-8e3e-9e10b7a91cc4 req-12df783f-f814-4ee0-bea7-c4801b790899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e927409-017d-4d1b-9028-4b1ad64d9744", "name": "network-vif-deleted", "tag": "82ea1ef3-ed28-48ca-8041-9192ffe5d711"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:35:08.550950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ed13932e-e795-4080-8e3e-9e10b7a91cc4 req-12df783f-f814-4ee0-bea7-c4801b790899 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:08.551637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ed13932e-e795-4080-8e3e-9e10b7a91cc4 req-12df783f-f814-4ee0-bea7-c4801b790899 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:08.552227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ed13932e-e795-4080-8e3e-9e10b7a91cc4 req-12df783f-f814-4ee0-bea7-c4801b790899 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:08.565632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ed13932e-e795-4080-8e3e-9e10b7a91cc4 req-12df783f-f814-4ee0-bea7-c4801b790899 service nova] Creating event network-vif-deleted:82ea1ef3-ed28-48ca-8041-9192ffe5d711 for instance 1e927409-017d-4d1b-9028-4b1ad64d9744 on hv-cinder-86236 Oct 28 20:35:08.570909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ed13932e-e795-4080-8e3e-9e10b7a91cc4 req-12df783f-f814-4ee0-bea7-c4801b790899 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035796 Oct 28 20:35:08.572209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1586/3168] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:35:08.667927 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ae6fddbe-2d8d-473d-ad1f-265a791acd89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:08.668467 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ae6fddbe-2d8d-473d-ad1f-265a791acd89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:08.678593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae6fddbe-2d8d-473d-ad1f-265a791acd89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:08.679084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae6fddbe-2d8d-473d-ad1f-265a791acd89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:08.684858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae6fddbe-2d8d-473d-ad1f-265a791acd89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:08.684858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae6fddbe-2d8d-473d-ad1f-265a791acd89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:08.684858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae6fddbe-2d8d-473d-ad1f-265a791acd89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:08.684858 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae6fddbe-2d8d-473d-ad1f-265a791acd89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:08.746971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ae6fddbe-2d8d-473d-ad1f-265a791acd89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7f52b7f96c400fb7d5fb0453c94362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab907bf956554681beae45b8973db6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:08.755492 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ae6fddbe-2d8d-473d-ad1f-265a791acd89 tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 200 len: 1307 microversion: 2.1 time: 0.091498 Oct 28 20:35:08.756285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1583/3169] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:08 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:09.220101 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-458f6cc4-c77d-463e-a07d-1ed9cff37c4c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:09.220808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-458f6cc4-c77d-463e-a07d-1ed9cff37c4c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:09.227613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-458f6cc4-c77d-463e-a07d-1ed9cff37c4c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:09.228098 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-458f6cc4-c77d-463e-a07d-1ed9cff37c4c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:09.228538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-458f6cc4-c77d-463e-a07d-1ed9cff37c4c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:09.229233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-458f6cc4-c77d-463e-a07d-1ed9cff37c4c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:09.229716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-458f6cc4-c77d-463e-a07d-1ed9cff37c4c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:09.239428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-458f6cc4-c77d-463e-a07d-1ed9cff37c4c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:09.239428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:09.294640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-458f6cc4-c77d-463e-a07d-1ed9cff37c4c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:09.302787 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-458f6cc4-c77d-463e-a07d-1ed9cff37c4c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 200 len: 1240 microversion: 2.1 time: 0.087389 Oct 28 20:35:09.303356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1587/3170] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:09 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:09.779333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b2dbb743-075e-4b2a-9472-9e7168af3e4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:09.779958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b2dbb743-075e-4b2a-9472-9e7168af3e4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] [instance: 1e927409-017d-4d1b-9028-4b1ad64d9744] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:09.786375 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2dbb743-075e-4b2a-9472-9e7168af3e4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:09.786861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2dbb743-075e-4b2a-9472-9e7168af3e4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:09.787356 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2dbb743-075e-4b2a-9472-9e7168af3e4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:09.788054 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2dbb743-075e-4b2a-9472-9e7168af3e4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:09.788519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2dbb743-075e-4b2a-9472-9e7168af3e4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:09.788951 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2dbb743-075e-4b2a-9472-9e7168af3e4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:09.802947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-b2dbb743-075e-4b2a-9472-9e7168af3e4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] HTTP exception thrown: Instance 1e927409-017d-4d1b-9028-4b1ad64d9744 could not be found. Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b2dbb743-075e-4b2a-9472-9e7168af3e4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Request method failure captured: Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 HTTP/1.1 Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDYVUSBBagLPNomxBBxHq3ECVaXkAjtcHj9JcVNYMaxZVPvZeFF2LWhPgX8h0QTtA_g0RNm0uMh_rJGZJiYwnK43exvmZqU6ooe06pRY35HWRYRkiTryZNEJfiI_TmdWen5RbyVIKZtJPJnUeqzCW__uExFDyZXfsIgrO0yv6wQJTu0 Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: ab907bf956554681beae45b8973db6e5 Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1880496931 Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:35:09.804616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:35:09.811290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ab907bf956554681beae45b8973db6e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ab907bf956554681beae45b8973db6e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ab907bf956554681beae45b8973db6e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ab907bf956554681beae45b8973db6e5", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:35:09.811290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1880496931 Oct 28 20:35:09.811290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: ab907bf956554681beae45b8973db6e5 Oct 28 20:35:09.811290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1880496931 Oct 28 20:35:09.811290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-ServerRescueNegativeTestJSON-1880496931-project Oct 28 20:35:09.811290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:35:09.811290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:35:09.811290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: ce7f52b7f96c400fb7d5fb0453c94362 Oct 28 20:35:09.811290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1880496931-project Oct 28 20:35:09.811290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:35:09.811290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Instance 1e927409-017d-4d1b-9028-4b1ad64d9744 could not be found. Oct 28 20:35:09.811290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': '1e927409-017d-4d1b-9028-4b1ad64d9744'} Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e927409-017d-4d1b-9028-4b1ad64d9744 could not be found. Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:35:09.812836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e927409-017d-4d1b-9028-4b1ad64d9744 could not be found. Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e927409-017d-4d1b-9028-4b1ad64d9744 could not be found. Oct 28 20:35:09.814146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:35:09.815015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b2dbb743-075e-4b2a-9472-9e7168af3e4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] Returning 404 to user: Instance 1e927409-017d-4d1b-9028-4b1ad64d9744 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:35:09.815015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b2dbb743-075e-4b2a-9472-9e7168af3e4c tempest-ServerRescueNegativeTestJSON-1880496931 tempest-ServerRescueNegativeTestJSON-1880496931-project] 10.222.0.66 "GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744" status: 404 len: 111 microversion: 2.1 time: 0.031405 Oct 28 20:35:09.815015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1584/3171] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:09 2022] GET /compute/v2.1/servers/1e927409-017d-4d1b-9028-4b1ad64d9744 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:35:10.327580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1801c71f-4bff-4ff9-9f73-e0212defd195 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:10.328875 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1801c71f-4bff-4ff9-9f73-e0212defd195 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:10.337309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1801c71f-4bff-4ff9-9f73-e0212defd195 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:10.338158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1801c71f-4bff-4ff9-9f73-e0212defd195 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:10.338787 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1801c71f-4bff-4ff9-9f73-e0212defd195 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:10.339670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1801c71f-4bff-4ff9-9f73-e0212defd195 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:10.340313 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1801c71f-4bff-4ff9-9f73-e0212defd195 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:10.341483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1801c71f-4bff-4ff9-9f73-e0212defd195 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:10.428036 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1801c71f-4bff-4ff9-9f73-e0212defd195 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:10.436196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1801c71f-4bff-4ff9-9f73-e0212defd195 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 200 len: 1296 microversion: 2.1 time: 0.113654 Oct 28 20:35:10.436775 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1588/3172] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:10 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 1296 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:11.459808 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-276053e6-4a8b-41af-8831-65babbbe6592 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:11.461025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-276053e6-4a8b-41af-8831-65babbbe6592 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:11.463804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:11.469372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-276053e6-4a8b-41af-8831-65babbbe6592 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:11.470072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-276053e6-4a8b-41af-8831-65babbbe6592 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:11.470682 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-276053e6-4a8b-41af-8831-65babbbe6592 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:11.471562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-276053e6-4a8b-41af-8831-65babbbe6592 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:11.472192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-276053e6-4a8b-41af-8831-65babbbe6592 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:11.472788 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-276053e6-4a8b-41af-8831-65babbbe6592 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:11.495162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:11.662638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-276053e6-4a8b-41af-8831-65babbbe6592 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:11.671835 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-276053e6-4a8b-41af-8831-65babbbe6592 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 200 len: 1362 microversion: 2.1 time: 0.215616 Oct 28 20:35:11.672722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1585/3173] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:11 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:12.683777 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-93dd154b-943b-4659-8536-1e448c602f8e req-c606ada2-e0d6-4ead-9184-404b294305fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e959dc1-0e16-44f8-ab63-2a3671ea5987", "tag": "a29e70d0-63ae-4085-9d28-457c8be6d963"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:35:12.691720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:12.700632 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ba1e09ed-96eb-4419-904c-4973d2f3b15c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:12.702308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ba1e09ed-96eb-4419-904c-4973d2f3b15c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:12.708734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-93dd154b-943b-4659-8536-1e448c602f8e req-c606ada2-e0d6-4ead-9184-404b294305fa service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:12.709610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-93dd154b-943b-4659-8536-1e448c602f8e req-c606ada2-e0d6-4ead-9184-404b294305fa service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:12.710373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-93dd154b-943b-4659-8536-1e448c602f8e req-c606ada2-e0d6-4ead-9184-404b294305fa service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:12.724045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba1e09ed-96eb-4419-904c-4973d2f3b15c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:12.724738 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba1e09ed-96eb-4419-904c-4973d2f3b15c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:12.725312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba1e09ed-96eb-4419-904c-4973d2f3b15c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:12.726208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba1e09ed-96eb-4419-904c-4973d2f3b15c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:12.726825 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba1e09ed-96eb-4419-904c-4973d2f3b15c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:12.727435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba1e09ed-96eb-4419-904c-4973d2f3b15c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:12.743618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-93dd154b-943b-4659-8536-1e448c602f8e req-c606ada2-e0d6-4ead-9184-404b294305fa service nova] Creating event network-changed:a29e70d0-63ae-4085-9d28-457c8be6d963 for instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 on hv-cinder-86236 Oct 28 20:35:12.755326 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-93dd154b-943b-4659-8536-1e448c602f8e req-c606ada2-e0d6-4ead-9184-404b294305fa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076319 Oct 28 20:35:12.756102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1589/3174] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:35:12.980122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ba1e09ed-96eb-4419-904c-4973d2f3b15c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:13.004367 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ba1e09ed-96eb-4419-904c-4973d2f3b15c tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 200 len: 1362 microversion: 2.1 time: 0.307276 Oct 28 20:35:13.006398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1586/3175] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:12 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:35:14.030543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8ddd7773-8894-4fb6-90ff-342ad65e0578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:14.031912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8ddd7773-8894-4fb6-90ff-342ad65e0578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:14.040881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ddd7773-8894-4fb6-90ff-342ad65e0578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:14.041391 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ddd7773-8894-4fb6-90ff-342ad65e0578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:14.041834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ddd7773-8894-4fb6-90ff-342ad65e0578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:14.042536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ddd7773-8894-4fb6-90ff-342ad65e0578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:14.042990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ddd7773-8894-4fb6-90ff-342ad65e0578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:14.043412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ddd7773-8894-4fb6-90ff-342ad65e0578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:14.256137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8ddd7773-8894-4fb6-90ff-342ad65e0578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:14.264434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8ddd7773-8894-4fb6-90ff-342ad65e0578 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 200 len: 1362 microversion: 2.1 time: 0.238644 Oct 28 20:35:14.265010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1590/3176] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:14 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:15.287915 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b6cd8664-2ff1-4ff3-827c-f39c23578dd4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:15.288625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b6cd8664-2ff1-4ff3-827c-f39c23578dd4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:15.295642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6cd8664-2ff1-4ff3-827c-f39c23578dd4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:15.296126 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6cd8664-2ff1-4ff3-827c-f39c23578dd4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:15.296567 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6cd8664-2ff1-4ff3-827c-f39c23578dd4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:15.297257 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6cd8664-2ff1-4ff3-827c-f39c23578dd4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:15.297750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6cd8664-2ff1-4ff3-827c-f39c23578dd4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:15.298168 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6cd8664-2ff1-4ff3-827c-f39c23578dd4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:15.336673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d92419a5-28e3-40db-88b9-a3f31e198749 tempest-VolumesGetTestJSON-297858759 tempest-VolumesGetTestJSON-297858759-project] Action: 'create', calling method: .version_select at 0x7f1f4db9de50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1828411440", "metadata": {"Type": "work"}}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:35:15.426883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b6cd8664-2ff1-4ff3-827c-f39c23578dd4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:15.434449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b6cd8664-2ff1-4ff3-827c-f39c23578dd4 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 200 len: 1362 microversion: 2.1 time: 0.150353 Oct 28 20:35:15.435019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1591/3177] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:15 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:35:16.456997 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-502df33d-9d62-4f0d-85a3-560469561166 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:16.457674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-502df33d-9d62-4f0d-85a3-560469561166 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:16.463758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-502df33d-9d62-4f0d-85a3-560469561166 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:16.464245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-502df33d-9d62-4f0d-85a3-560469561166 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:16.464682 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-502df33d-9d62-4f0d-85a3-560469561166 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:16.466024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-502df33d-9d62-4f0d-85a3-560469561166 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:16.466536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-502df33d-9d62-4f0d-85a3-560469561166 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:16.466964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-502df33d-9d62-4f0d-85a3-560469561166 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:16.599412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-502df33d-9d62-4f0d-85a3-560469561166 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:16.608459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-502df33d-9d62-4f0d-85a3-560469561166 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 200 len: 1362 microversion: 2.1 time: 0.155397 Oct 28 20:35:16.609029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1592/3178] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:16 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:35:17.631281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-97bbf007-505f-4fb3-8e52-df72f657c841 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:17.632053 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-97bbf007-505f-4fb3-8e52-df72f657c841 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:17.638585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97bbf007-505f-4fb3-8e52-df72f657c841 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:17.639060 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97bbf007-505f-4fb3-8e52-df72f657c841 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:17.639519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97bbf007-505f-4fb3-8e52-df72f657c841 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:17.640222 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97bbf007-505f-4fb3-8e52-df72f657c841 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:17.640668 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97bbf007-505f-4fb3-8e52-df72f657c841 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:17.641086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97bbf007-505f-4fb3-8e52-df72f657c841 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:17.771132 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-97bbf007-505f-4fb3-8e52-df72f657c841 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:17.778804 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-97bbf007-505f-4fb3-8e52-df72f657c841 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 200 len: 1362 microversion: 2.1 time: 0.151385 Oct 28 20:35:17.779360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1593/3179] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:17 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:35:18.194934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:18.413368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:18.414174 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:18.472943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-42f427a3-e8f6-4809-b8e2-d4ad4b8efdf5 req-2a41f067-f0f5-42bd-9058-53a27b5c93a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e959dc1-0e16-44f8-ab63-2a3671ea5987", "name": "network-vif-plugged", "status": "completed", "tag": "a29e70d0-63ae-4085-9d28-457c8be6d963"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:35:18.482905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-42f427a3-e8f6-4809-b8e2-d4ad4b8efdf5 req-2a41f067-f0f5-42bd-9058-53a27b5c93a2 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:18.483403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-42f427a3-e8f6-4809-b8e2-d4ad4b8efdf5 req-2a41f067-f0f5-42bd-9058-53a27b5c93a2 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:18.483832 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-42f427a3-e8f6-4809-b8e2-d4ad4b8efdf5 req-2a41f067-f0f5-42bd-9058-53a27b5c93a2 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:18.495611 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-42f427a3-e8f6-4809-b8e2-d4ad4b8efdf5 req-2a41f067-f0f5-42bd-9058-53a27b5c93a2 service nova] Creating event network-vif-plugged:a29e70d0-63ae-4085-9d28-457c8be6d963 for instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 on hv-cinder-86236 Oct 28 20:35:18.500780 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-42f427a3-e8f6-4809-b8e2-d4ad4b8efdf5 req-2a41f067-f0f5-42bd-9058-53a27b5c93a2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092098 Oct 28 20:35:18.501373 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1594/3180] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:35:18.802996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-63575418-3815-46d7-b1ae-8a27d440f486 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:18.803528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-63575418-3815-46d7-b1ae-8a27d440f486 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:18.812586 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63575418-3815-46d7-b1ae-8a27d440f486 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:18.818360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63575418-3815-46d7-b1ae-8a27d440f486 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:18.818360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63575418-3815-46d7-b1ae-8a27d440f486 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:18.818360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63575418-3815-46d7-b1ae-8a27d440f486 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:18.818360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63575418-3815-46d7-b1ae-8a27d440f486 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:18.819065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63575418-3815-46d7-b1ae-8a27d440f486 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:18.951285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-63575418-3815-46d7-b1ae-8a27d440f486 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:18.959093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-63575418-3815-46d7-b1ae-8a27d440f486 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 200 len: 1362 microversion: 2.1 time: 0.160552 Oct 28 20:35:18.959650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1595/3181] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:18 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:35:19.982553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cfa90662-d715-4469-a002-7783316211e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:19.983194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cfa90662-d715-4469-a002-7783316211e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:19.989620 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfa90662-d715-4469-a002-7783316211e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:19.990099 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfa90662-d715-4469-a002-7783316211e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:19.990532 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfa90662-d715-4469-a002-7783316211e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:19.991214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfa90662-d715-4469-a002-7783316211e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:19.991663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfa90662-d715-4469-a002-7783316211e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:19.992086 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfa90662-d715-4469-a002-7783316211e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:20.117893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cfa90662-d715-4469-a002-7783316211e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:20.125816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cfa90662-d715-4469-a002-7783316211e7 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 200 len: 1362 microversion: 2.1 time: 0.147480 Oct 28 20:35:20.126377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1596/3182] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:19 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:35:21.149279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f22bb6c0-851a-4b4f-9aa7-7aabb6ae42bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:21.149961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f22bb6c0-851a-4b4f-9aa7-7aabb6ae42bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:21.156365 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f22bb6c0-851a-4b4f-9aa7-7aabb6ae42bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:21.156855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f22bb6c0-851a-4b4f-9aa7-7aabb6ae42bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:21.157297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f22bb6c0-851a-4b4f-9aa7-7aabb6ae42bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:21.158011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f22bb6c0-851a-4b4f-9aa7-7aabb6ae42bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:21.158469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f22bb6c0-851a-4b4f-9aa7-7aabb6ae42bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:21.158893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f22bb6c0-851a-4b4f-9aa7-7aabb6ae42bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:21.290897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f22bb6c0-851a-4b4f-9aa7-7aabb6ae42bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:21.298884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f22bb6c0-851a-4b4f-9aa7-7aabb6ae42bb tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 200 len: 1548 microversion: 2.1 time: 0.153631 Oct 28 20:35:21.299447 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1597/3183] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:21 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:35:21.320641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-783ad089-1bfa-4c78-bfb8-d8e379e8cc18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:21.321114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-783ad089-1bfa-4c78-bfb8-d8e379e8cc18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:21.327580 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783ad089-1bfa-4c78-bfb8-d8e379e8cc18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:21.328061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783ad089-1bfa-4c78-bfb8-d8e379e8cc18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:21.328500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783ad089-1bfa-4c78-bfb8-d8e379e8cc18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:21.329187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783ad089-1bfa-4c78-bfb8-d8e379e8cc18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:21.329671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783ad089-1bfa-4c78-bfb8-d8e379e8cc18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:21.330100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783ad089-1bfa-4c78-bfb8-d8e379e8cc18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:21.406140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-783ad089-1bfa-4c78-bfb8-d8e379e8cc18 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088968 Oct 28 20:35:21.406736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1598/3184] 10.222.0.66 () {58 vars in 1275 bytes} [Fri Oct 28 20:35:21 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:35:22.380200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-2a86422a-b368-4b7a-af3d-c88bd73a5b73 req-1c5817bc-546a-413b-936d-7b55b657d898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e959dc1-0e16-44f8-ab63-2a3671ea5987", "tag": "a29e70d0-63ae-4085-9d28-457c8be6d963"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:35:22.390587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2a86422a-b368-4b7a-af3d-c88bd73a5b73 req-1c5817bc-546a-413b-936d-7b55b657d898 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:22.391062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2a86422a-b368-4b7a-af3d-c88bd73a5b73 req-1c5817bc-546a-413b-936d-7b55b657d898 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:22.391491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2a86422a-b368-4b7a-af3d-c88bd73a5b73 req-1c5817bc-546a-413b-936d-7b55b657d898 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:22.404960 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-2a86422a-b368-4b7a-af3d-c88bd73a5b73 req-1c5817bc-546a-413b-936d-7b55b657d898 service nova] Creating event network-changed:a29e70d0-63ae-4085-9d28-457c8be6d963 for instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 on hv-cinder-86236 Oct 28 20:35:22.410063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-2a86422a-b368-4b7a-af3d-c88bd73a5b73 req-1c5817bc-546a-413b-936d-7b55b657d898 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034087 Oct 28 20:35:22.410692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1599/3185] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:35:22.929380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:22.987462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=9 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:56.560939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=21 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:56.561722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=63 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:56.566109 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3e4de0b1-11c6-400e-8297-49a846519554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:56.566690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3e4de0b1-11c6-400e-8297-49a846519554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:56.572715 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e4de0b1-11c6-400e-8297-49a846519554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:56.573198 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e4de0b1-11c6-400e-8297-49a846519554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:56.573671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e4de0b1-11c6-400e-8297-49a846519554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:56.574359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e4de0b1-11c6-400e-8297-49a846519554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:56.574818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e4de0b1-11c6-400e-8297-49a846519554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:56.575241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e4de0b1-11c6-400e-8297-49a846519554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:56.599165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3e4de0b1-11c6-400e-8297-49a846519554 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987/ips" status: 200 len: 145 microversion: 2.1 time: 0.040012 Oct 28 20:35:56.599734 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1600/3186] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Oct 28 20:35:56 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:36:56.677499 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-919296c2-b00e-4aa3-886f-c897734f7927 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:36:56.678129 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-919296c2-b00e-4aa3-886f-c897734f7927 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:36:56.684270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-919296c2-b00e-4aa3-886f-c897734f7927 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:36:56.684743 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-919296c2-b00e-4aa3-886f-c897734f7927 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:36:56.685172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-919296c2-b00e-4aa3-886f-c897734f7927 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:36:56.685870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-919296c2-b00e-4aa3-886f-c897734f7927 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:36:56.686319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-919296c2-b00e-4aa3-886f-c897734f7927 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:36:56.686737 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-919296c2-b00e-4aa3-886f-c897734f7927 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:36:56.712275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-919296c2-b00e-4aa3-886f-c897734f7927 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:36:56.990828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-919296c2-b00e-4aa3-886f-c897734f7927 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 204 len: 0 microversion: 2.1 time: 0.319481 Oct 28 20:36:56.991423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1601/3187] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:36:56 2022] DELETE /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 20:36:56.999949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40954573-4b5f-43ca-990a-ebc85fc82af5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:36:57.000649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40954573-4b5f-43ca-990a-ebc85fc82af5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:36:57.006951 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40954573-4b5f-43ca-990a-ebc85fc82af5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:36:57.010965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40954573-4b5f-43ca-990a-ebc85fc82af5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:36:57.010965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40954573-4b5f-43ca-990a-ebc85fc82af5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:36:57.010965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40954573-4b5f-43ca-990a-ebc85fc82af5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:36:57.010965 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40954573-4b5f-43ca-990a-ebc85fc82af5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:36:57.011420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40954573-4b5f-43ca-990a-ebc85fc82af5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:36:57.306844 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-40954573-4b5f-43ca-990a-ebc85fc82af5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:36:57.314395 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40954573-4b5f-43ca-990a-ebc85fc82af5 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 200 len: 1672 microversion: 2.1 time: 0.318458 Oct 28 20:36:57.314956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1602/3188] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:36:56 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 1672 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:36:58.337994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1d91fdd3-135c-48b6-a3d8-61310327dd1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:36:58.338637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1d91fdd3-135c-48b6-a3d8-61310327dd1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:36:58.344881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d91fdd3-135c-48b6-a3d8-61310327dd1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:36:58.345382 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d91fdd3-135c-48b6-a3d8-61310327dd1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:36:58.345818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d91fdd3-135c-48b6-a3d8-61310327dd1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:36:58.346545 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d91fdd3-135c-48b6-a3d8-61310327dd1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:36:58.346990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d91fdd3-135c-48b6-a3d8-61310327dd1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:36:58.347402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d91fdd3-135c-48b6-a3d8-61310327dd1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:36:58.557439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1d91fdd3-135c-48b6-a3d8-61310327dd1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:36:58.565028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1d91fdd3-135c-48b6-a3d8-61310327dd1a tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 200 len: 1672 microversion: 2.1 time: 0.230853 Oct 28 20:36:58.566829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1603/3189] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:36:58 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 1672 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:36:59.340477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ae6a688d-da88-48a9-9eb1-85281ce1dd74 req-56fa9e32-c2d9-4f8f-82cb-2a594c82fcdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e959dc1-0e16-44f8-ab63-2a3671ea5987", "name": "network-vif-deleted", "tag": "a29e70d0-63ae-4085-9d28-457c8be6d963"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:36:59.352076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ae6a688d-da88-48a9-9eb1-85281ce1dd74 req-56fa9e32-c2d9-4f8f-82cb-2a594c82fcdf service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:36:59.352554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ae6a688d-da88-48a9-9eb1-85281ce1dd74 req-56fa9e32-c2d9-4f8f-82cb-2a594c82fcdf service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:36:59.353010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ae6a688d-da88-48a9-9eb1-85281ce1dd74 req-56fa9e32-c2d9-4f8f-82cb-2a594c82fcdf service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:36:59.366581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ae6a688d-da88-48a9-9eb1-85281ce1dd74 req-56fa9e32-c2d9-4f8f-82cb-2a594c82fcdf service nova] Creating event network-vif-deleted:a29e70d0-63ae-4085-9d28-457c8be6d963 for instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 on hv-cinder-86236 Oct 28 20:36:59.372143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ae6a688d-da88-48a9-9eb1-85281ce1dd74 req-56fa9e32-c2d9-4f8f-82cb-2a594c82fcdf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036066 Oct 28 20:36:59.372744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1604/3190] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:36:59.590678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e993578-0735-49b9-ba4e-188155217433 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:36:59.591384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4e993578-0735-49b9-ba4e-188155217433 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:36:59.598964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e993578-0735-49b9-ba4e-188155217433 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:36:59.599452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e993578-0735-49b9-ba4e-188155217433 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:36:59.600094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e993578-0735-49b9-ba4e-188155217433 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:36:59.600801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e993578-0735-49b9-ba4e-188155217433 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:36:59.601260 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e993578-0735-49b9-ba4e-188155217433 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:36:59.601749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e993578-0735-49b9-ba4e-188155217433 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:36:59.683805 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e993578-0735-49b9-ba4e-188155217433 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15db5106efbd434f99a4d102810cc7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b163bdfc7544a3d833bd69dc027c7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:36:59.692753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4e993578-0735-49b9-ba4e-188155217433 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 200 len: 1321 microversion: 2.1 time: 0.106484 Oct 28 20:36:59.693843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1605/3191] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:36:59 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 1321 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:00.837144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4ccaba1-1146-4084-90a6-e2f73086af99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:00.837782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d4ccaba1-1146-4084-90a6-e2f73086af99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:00.843710 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ccaba1-1146-4084-90a6-e2f73086af99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:00.844183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ccaba1-1146-4084-90a6-e2f73086af99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:00.844610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ccaba1-1146-4084-90a6-e2f73086af99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:00.845278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ccaba1-1146-4084-90a6-e2f73086af99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:00.845746 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ccaba1-1146-4084-90a6-e2f73086af99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:00.846160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ccaba1-1146-4084-90a6-e2f73086af99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:00.859359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-d4ccaba1-1146-4084-90a6-e2f73086af99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] HTTP exception thrown: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4ccaba1-1146-4084-90a6-e2f73086af99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Request method failure captured: Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 HTTP/1.1 Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYQ8xIP36w8D6cczE8W9KvY4BLBpdUmPKJO1ioUT3uqwgpfatEPgwAHvUc5SOoZGWs-Zq2VghnaalMc9FMYU4vqRug0rAxlDQPRhjDPPiHdupPmqow6lirdrIPRLWknwIqWkuJ4oyV7nsQ2qY2p8J7NRUFIQXLiWW86wx-MXiPCRgE Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 8b163bdfc7544a3d833bd69dc027c7d6 Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeTestJSON-1697363972 Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:37:00.860961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:37:00.863044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b163bdfc7544a3d833bd69dc027c7d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b163bdfc7544a3d833bd69dc027c7d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8b163bdfc7544a3d833bd69dc027c7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8b163bdfc7544a3d833bd69dc027c7d6", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:37:00.863044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeTestJSON-1697363972 Oct 28 20:37:00.863044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 8b163bdfc7544a3d833bd69dc027c7d6 Oct 28 20:37:00.863044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1697363972 Oct 28 20:37:00.863044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-AttachVolumeTestJSON-1697363972-project Oct 28 20:37:00.863044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:37:00.863044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:37:00.863044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: 15db5106efbd434f99a4d102810cc7a6 Oct 28 20:37:00.863044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeTestJSON-1697363972-project Oct 28 20:37:00.863044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:37:00.863044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. Oct 28 20:37:00.863044 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': '0e959dc1-0e16-44f8-ab63-2a3671ea5987'} Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:37:00.863943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. Oct 28 20:37:00.865353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:00.866628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4ccaba1-1146-4084-90a6-e2f73086af99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Returning 404 to user: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:37:00.866628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d4ccaba1-1146-4084-90a6-e2f73086af99 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 404 len: 111 microversion: 2.1 time: 0.150419 Oct 28 20:37:00.866628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1606/3192] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:00 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 20:37:00.871329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf1fbf7b-cf91-4dc5-8820-7cd2b87bea84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '.version_select at 0x7f1f4dc6dc10>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:00.984609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cf1fbf7b-cf91-4dc5-8820-7cd2b87bea84 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664650839" status: 202 len: 0 microversion: 2.1 time: 0.116156 Oct 28 20:37:00.985542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1607/3193] 10.222.0.66 () {58 vars in 1221 bytes} [Fri Oct 28 20:37:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664650839 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 20:37:01.757270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b463362e-9ccc-49f8-b5e4-39e91ae99626 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:01.757801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b463362e-9ccc-49f8-b5e4-39e91ae99626 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:01.764389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b463362e-9ccc-49f8-b5e4-39e91ae99626 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:01.765435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b463362e-9ccc-49f8-b5e4-39e91ae99626 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:01.765435 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b463362e-9ccc-49f8-b5e4-39e91ae99626 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:01.765977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b463362e-9ccc-49f8-b5e4-39e91ae99626 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:01.766423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b463362e-9ccc-49f8-b5e4-39e91ae99626 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:01.766840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b463362e-9ccc-49f8-b5e4-39e91ae99626 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:01.779816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-b463362e-9ccc-49f8-b5e4-39e91ae99626 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] HTTP exception thrown: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b463362e-9ccc-49f8-b5e4-39e91ae99626 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Request method failure captured: Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 HTTP/1.1 Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYQ8xIP36w8D6cczE8W9KvY4BLBpdUmPKJO1ioUT3uqwgpfatEPgwAHvUc5SOoZGWs-Zq2VghnaalMc9FMYU4vqRug0rAxlDQPRhjDPPiHdupPmqow6lirdrIPRLWknwIqWkuJ4oyV7nsQ2qY2p8J7NRUFIQXLiWW86wx-MXiPCRgE Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 8b163bdfc7544a3d833bd69dc027c7d6 Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeTestJSON-1697363972 Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:37:01.781356 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:37:01.782673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b163bdfc7544a3d833bd69dc027c7d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b163bdfc7544a3d833bd69dc027c7d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8b163bdfc7544a3d833bd69dc027c7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8b163bdfc7544a3d833bd69dc027c7d6", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:37:01.782673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeTestJSON-1697363972 Oct 28 20:37:01.782673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 8b163bdfc7544a3d833bd69dc027c7d6 Oct 28 20:37:01.782673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1697363972 Oct 28 20:37:01.782673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-AttachVolumeTestJSON-1697363972-project Oct 28 20:37:01.782673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:37:01.782673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:37:01.782673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: 15db5106efbd434f99a4d102810cc7a6 Oct 28 20:37:01.782673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeTestJSON-1697363972-project Oct 28 20:37:01.782673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:37:01.782673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. Oct 28 20:37:01.782673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': '0e959dc1-0e16-44f8-ab63-2a3671ea5987'} Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:37:01.783543 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. Oct 28 20:37:01.785409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:01.786994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b463362e-9ccc-49f8-b5e4-39e91ae99626 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Returning 404 to user: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:37:01.786994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b463362e-9ccc-49f8-b5e4-39e91ae99626 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 404 len: 111 microversion: 2.1 time: 0.030457 Oct 28 20:37:01.786994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1608/3194] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:37:01 2022] DELETE /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 20:37:01.791209 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4ce7018-afab-417e-a40e-b36a244e9620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:01.791812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d4ce7018-afab-417e-a40e-b36a244e9620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 0e959dc1-0e16-44f8-ab63-2a3671ea5987] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:01.797465 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ce7018-afab-417e-a40e-b36a244e9620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:01.800341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ce7018-afab-417e-a40e-b36a244e9620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:01.800341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ce7018-afab-417e-a40e-b36a244e9620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:01.800341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ce7018-afab-417e-a40e-b36a244e9620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:01.800341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ce7018-afab-417e-a40e-b36a244e9620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:01.800664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ce7018-afab-417e-a40e-b36a244e9620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:01.813516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-d4ce7018-afab-417e-a40e-b36a244e9620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] HTTP exception thrown: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4ce7018-afab-417e-a40e-b36a244e9620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Request method failure captured: Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 HTTP/1.1 Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYQ8xIP36w8D6cczE8W9KvY4BLBpdUmPKJO1ioUT3uqwgpfatEPgwAHvUc5SOoZGWs-Zq2VghnaalMc9FMYU4vqRug0rAxlDQPRhjDPPiHdupPmqow6lirdrIPRLWknwIqWkuJ4oyV7nsQ2qY2p8J7NRUFIQXLiWW86wx-MXiPCRgE Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 8b163bdfc7544a3d833bd69dc027c7d6 Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeTestJSON-1697363972 Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:37:01.815006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:37:01.816330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b163bdfc7544a3d833bd69dc027c7d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b163bdfc7544a3d833bd69dc027c7d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8b163bdfc7544a3d833bd69dc027c7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8b163bdfc7544a3d833bd69dc027c7d6", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:37:01.816330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeTestJSON-1697363972 Oct 28 20:37:01.816330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 8b163bdfc7544a3d833bd69dc027c7d6 Oct 28 20:37:01.816330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1697363972 Oct 28 20:37:01.816330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-AttachVolumeTestJSON-1697363972-project Oct 28 20:37:01.816330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:37:01.816330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:37:01.816330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: 15db5106efbd434f99a4d102810cc7a6 Oct 28 20:37:01.816330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeTestJSON-1697363972-project Oct 28 20:37:01.816330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:37:01.816330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. Oct 28 20:37:01.816330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': '0e959dc1-0e16-44f8-ab63-2a3671ea5987'} Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:37:01.817105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. Oct 28 20:37:01.818535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:01.819630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4ce7018-afab-417e-a40e-b36a244e9620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Returning 404 to user: Instance 0e959dc1-0e16-44f8-ab63-2a3671ea5987 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:37:01.819630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d4ce7018-afab-417e-a40e-b36a244e9620 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987" status: 404 len: 111 microversion: 2.1 time: 0.028847 Oct 28 20:37:01.819630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1609/3195] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:01 2022] GET /compute/v2.1/servers/0e959dc1-0e16-44f8-ab63-2a3671ea5987 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:37:04.773047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2e6061b3-93f5-42e0-80f1-56e1c8f0b104 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:04.773047 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2e6061b3-93f5-42e0-80f1-56e1c8f0b104 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:04.778821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e6061b3-93f5-42e0-80f1-56e1c8f0b104 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:04.779314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e6061b3-93f5-42e0-80f1-56e1c8f0b104 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:04.779757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e6061b3-93f5-42e0-80f1-56e1c8f0b104 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:04.780449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e6061b3-93f5-42e0-80f1-56e1c8f0b104 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:04.780988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e6061b3-93f5-42e0-80f1-56e1c8f0b104 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:04.781452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e6061b3-93f5-42e0-80f1-56e1c8f0b104 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:04.823648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2e6061b3-93f5-42e0-80f1-56e1c8f0b104 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:37:05.039127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2e6061b3-93f5-42e0-80f1-56e1c8f0b104 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 204 len: 0 microversion: 2.1 time: 0.271069 Oct 28 20:37:05.039905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1610/3196] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:37:04 2022] DELETE /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 20:37:05.046791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d26c752b-525c-4d57-8525-6016c4d6366f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:05.047935 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d26c752b-525c-4d57-8525-6016c4d6366f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:05.055689 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d26c752b-525c-4d57-8525-6016c4d6366f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:05.056590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d26c752b-525c-4d57-8525-6016c4d6366f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:05.057137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d26c752b-525c-4d57-8525-6016c4d6366f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:05.058012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d26c752b-525c-4d57-8525-6016c4d6366f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:05.058474 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d26c752b-525c-4d57-8525-6016c4d6366f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:05.058912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d26c752b-525c-4d57-8525-6016c4d6366f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:05.073483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-d26c752b-525c-4d57-8525-6016c4d6366f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] HTTP exception thrown: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d26c752b-525c-4d57-8525-6016c4d6366f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Request method failure captured: Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 HTTP/1.1 Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYUV_YNM0XXwBBLx-WTdB2tjq5FfUSX5VRsT-xAlZ_e2f17iFR5KGzRqSyIT82YsBG3tEufG_S544gzvHRmKEDqErboY4PRO_Jp3hTpg8bXzg1fr4ePkhDzlMYdYf0HRuRZe5iaTEAu5mcOB7RsQRVC4HQxwtLzgZrAvWmiG9LEcj0 Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 34d30fbe6fa645bd9ea3d88ea5f68449 Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:37:05.075279 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:37:05.079818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34d30fbe6fa645bd9ea3d88ea5f68449", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:37:05.079818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:37:05.079818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 34d30fbe6fa645bd9ea3d88ea5f68449 Oct 28 20:37:05.079818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:37:05.079818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-AttachVolumeShelveTestJSON-1907610215-project Oct 28 20:37:05.079818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:37:05.079818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:37:05.079818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: e0ba6bf2459d4a98a3a1f5684bdad2b2 Oct 28 20:37:05.079818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1907610215-project Oct 28 20:37:05.079818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:37:05.079818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. Oct 28 20:37:05.079818 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': '7582188f-bfab-4218-9104-9fb384141c57'} Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:37:05.080858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. Oct 28 20:37:05.082757 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:05.084791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d26c752b-525c-4d57-8525-6016c4d6366f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Returning 404 to user: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:37:05.084791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d26c752b-525c-4d57-8525-6016c4d6366f tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 404 len: 111 microversion: 2.20 time: 0.034998 Oct 28 20:37:05.084791 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1611/3197] 10.222.0.66 () {60 vars in 1280 bytes} [Fri Oct 28 20:37:05 2022] DELETE /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 20:37:05.085763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f94ca337-155c-49cf-be08-2ec63cb433b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:05.085763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f94ca337-155c-49cf-be08-2ec63cb433b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:05.091661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f94ca337-155c-49cf-be08-2ec63cb433b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:05.092154 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f94ca337-155c-49cf-be08-2ec63cb433b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:05.092607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f94ca337-155c-49cf-be08-2ec63cb433b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:05.093286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f94ca337-155c-49cf-be08-2ec63cb433b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:05.093768 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f94ca337-155c-49cf-be08-2ec63cb433b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:05.094196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f94ca337-155c-49cf-be08-2ec63cb433b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:05.232204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f94ca337-155c-49cf-be08-2ec63cb433b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:05.240931 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f94ca337-155c-49cf-be08-2ec63cb433b4 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 200 len: 1681 microversion: 2.1 time: 0.162751 Oct 28 20:37:05.241528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1612/3198] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:05 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:05.246119 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-44c44f0d-68d3-4739-8372-a63dc1517978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:05.249888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-44c44f0d-68d3-4739-8372-a63dc1517978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] [instance: 7582188f-bfab-4218-9104-9fb384141c57] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:05.252399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44c44f0d-68d3-4739-8372-a63dc1517978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:05.252882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44c44f0d-68d3-4739-8372-a63dc1517978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:05.253347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44c44f0d-68d3-4739-8372-a63dc1517978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:05.254052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44c44f0d-68d3-4739-8372-a63dc1517978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:05.255432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44c44f0d-68d3-4739-8372-a63dc1517978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:05.255618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44c44f0d-68d3-4739-8372-a63dc1517978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:05.274832 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-44c44f0d-68d3-4739-8372-a63dc1517978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] HTTP exception thrown: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-44c44f0d-68d3-4739-8372-a63dc1517978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Request method failure captured: Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 HTTP/1.1 Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYUV_YNM0XXwBBLx-WTdB2tjq5FfUSX5VRsT-xAlZ_e2f17iFR5KGzRqSyIT82YsBG3tEufG_S544gzvHRmKEDqErboY4PRO_Jp3hTpg8bXzg1fr4ePkhDzlMYdYf0HRuRZe5iaTEAu5mcOB7RsQRVC4HQxwtLzgZrAvWmiG9LEcj0 Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 34d30fbe6fa645bd9ea3d88ea5f68449 Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:37:05.276389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:37:05.277704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34d30fbe6fa645bd9ea3d88ea5f68449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34d30fbe6fa645bd9ea3d88ea5f68449", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:37:05.277704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:37:05.277704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 34d30fbe6fa645bd9ea3d88ea5f68449 Oct 28 20:37:05.277704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1907610215 Oct 28 20:37:05.277704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-AttachVolumeShelveTestJSON-1907610215-project Oct 28 20:37:05.277704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:37:05.277704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:37:05.277704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: e0ba6bf2459d4a98a3a1f5684bdad2b2 Oct 28 20:37:05.277704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1907610215-project Oct 28 20:37:05.277704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:37:05.277704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. Oct 28 20:37:05.277704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': '7582188f-bfab-4218-9104-9fb384141c57'} Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:37:05.278370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. Oct 28 20:37:05.279523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:37:05.280653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-44c44f0d-68d3-4739-8372-a63dc1517978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] Returning 404 to user: Instance 7582188f-bfab-4218-9104-9fb384141c57 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:37:05.280653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-44c44f0d-68d3-4739-8372-a63dc1517978 tempest-AttachVolumeShelveTestJSON-1907610215 tempest-AttachVolumeShelveTestJSON-1907610215-project] 10.222.0.66 "GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57" status: 404 len: 111 microversion: 2.20 time: 0.035344 Oct 28 20:37:05.280653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1613/3199] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Oct 28 20:37:05 2022] GET /compute/v2.1/servers/7582188f-bfab-4218-9104-9fb384141c57 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 20:37:05.500466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d92419a5-28e3-40db-88b9-a3f31e198749 tempest-VolumesGetTestJSON-297858759 tempest-VolumesGetTestJSON-297858759-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 110.281292 Oct 28 20:37:05.501654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1587/3200] 10.222.0.66 () {60 vars in 1156 bytes} [Fri Oct 28 20:35:15 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 110283 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 20:37:06.266100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b43eae75-e3ef-4dff-9917-aa98174abaa2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:06.266729 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b43eae75-e3ef-4dff-9917-aa98174abaa2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:06.274095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b43eae75-e3ef-4dff-9917-aa98174abaa2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:06.274574 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b43eae75-e3ef-4dff-9917-aa98174abaa2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:06.275024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b43eae75-e3ef-4dff-9917-aa98174abaa2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:06.275721 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b43eae75-e3ef-4dff-9917-aa98174abaa2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:06.276178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b43eae75-e3ef-4dff-9917-aa98174abaa2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:06.276599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b43eae75-e3ef-4dff-9917-aa98174abaa2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:06.381714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b43eae75-e3ef-4dff-9917-aa98174abaa2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:06.397414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b43eae75-e3ef-4dff-9917-aa98174abaa2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 200 len: 1614 microversion: 2.1 time: 0.135058 Oct 28 20:37:06.399410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1614/3201] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:06 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 1614 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:06.604897 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1bb6399c-bc70-434f-8fd6-a282f4e24dd7 req-8799976a-b8c5-459a-9c13-6606ce034a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fca705e-f209-4a12-8462-5cb6a76b8976", "name": "network-vif-deleted", "tag": "409a1018-b50b-4b3c-8392-24957ee7c660"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:37:06.615693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1bb6399c-bc70-434f-8fd6-a282f4e24dd7 req-8799976a-b8c5-459a-9c13-6606ce034a4c service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:06.616173 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1bb6399c-bc70-434f-8fd6-a282f4e24dd7 req-8799976a-b8c5-459a-9c13-6606ce034a4c service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:06.616782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1bb6399c-bc70-434f-8fd6-a282f4e24dd7 req-8799976a-b8c5-459a-9c13-6606ce034a4c service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:06.630296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1bb6399c-bc70-434f-8fd6-a282f4e24dd7 req-8799976a-b8c5-459a-9c13-6606ce034a4c service nova] Creating event network-vif-deleted:409a1018-b50b-4b3c-8392-24957ee7c660 for instance 7fca705e-f209-4a12-8462-5cb6a76b8976 on hv-cinder-86236 Oct 28 20:37:06.636241 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-1bb6399c-bc70-434f-8fd6-a282f4e24dd7 req-8799976a-b8c5-459a-9c13-6606ce034a4c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037131 Oct 28 20:37:06.641308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1588/3202] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:37:07.420221 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed09fe66-ab27-45cf-ab57-bb2c36ccfb5d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:07.421265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ed09fe66-ab27-45cf-ab57-bb2c36ccfb5d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:07.432120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed09fe66-ab27-45cf-ab57-bb2c36ccfb5d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:07.436667 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed09fe66-ab27-45cf-ab57-bb2c36ccfb5d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:07.437421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed09fe66-ab27-45cf-ab57-bb2c36ccfb5d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:07.438350 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed09fe66-ab27-45cf-ab57-bb2c36ccfb5d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:07.439000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed09fe66-ab27-45cf-ab57-bb2c36ccfb5d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:07.439652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed09fe66-ab27-45cf-ab57-bb2c36ccfb5d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:07.479742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed09fe66-ab27-45cf-ab57-bb2c36ccfb5d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:07.480228 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed09fe66-ab27-45cf-ab57-bb2c36ccfb5d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:07.480840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed09fe66-ab27-45cf-ab57-bb2c36ccfb5d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:07.481513 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-ed09fe66-ab27-45cf-ab57-bb2c36ccfb5d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lazy-loading 'fault' on Instance uuid 7fca705e-f209-4a12-8462-5cb6a76b8976 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:37:07.539883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ed09fe66-ab27-45cf-ab57-bb2c36ccfb5d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:07.550130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ed09fe66-ab27-45cf-ab57-bb2c36ccfb5d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 200 len: 1331 microversion: 2.1 time: 0.133698 Oct 28 20:37:07.552273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1615/3203] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:07 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 1331 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:08.590821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88f1ca0f-113a-4cd0-bc68-a44bf3406527 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:08.591532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-88f1ca0f-113a-4cd0-bc68-a44bf3406527 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:08.598926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88f1ca0f-113a-4cd0-bc68-a44bf3406527 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:08.599776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88f1ca0f-113a-4cd0-bc68-a44bf3406527 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:08.600229 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88f1ca0f-113a-4cd0-bc68-a44bf3406527 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:08.600942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88f1ca0f-113a-4cd0-bc68-a44bf3406527 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:08.601424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88f1ca0f-113a-4cd0-bc68-a44bf3406527 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:08.601859 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88f1ca0f-113a-4cd0-bc68-a44bf3406527 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:08.627022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-88f1ca0f-113a-4cd0-bc68-a44bf3406527 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] HTTP exception thrown: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88f1ca0f-113a-4cd0-bc68-a44bf3406527 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Request method failure captured: Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 HTTP/1.1 Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDYMvyQboftNRryWd3Rs40sLFlwhGaFtwYfaIeJnxRaNivrbjxkcoU7hik0GmB2LCAF23QhzK0jde7TY6jjLMWtp3be2qb3ioW4B_DmUzK25G3ialtqsuYDsquFjDhl4JMbgP7SnsYrOor-VBrDZUeFYQ9rlIGxqZsR02x8jWolIc1k Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:37:08.631545 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:37:08.632608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_940ce72c42534c5196dfb909cc2a8d54", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:37:08.632608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:37:08.632608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:37:08.632608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:37:08.632608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:37:08.632608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:37:08.632608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:37:08.632608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: 724baaa4aa834e609fe4f513f9fc0b4b Oct 28 20:37:08.632608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:37:08.632608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:37:08.632608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. Oct 28 20:37:08.632608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': '7fca705e-f209-4a12-8462-5cb6a76b8976'} Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:37:08.633542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. Oct 28 20:37:08.634539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:37:08.635540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88f1ca0f-113a-4cd0-bc68-a44bf3406527 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Returning 404 to user: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:37:08.635540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-88f1ca0f-113a-4cd0-bc68-a44bf3406527 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 404 len: 111 microversion: 2.1 time: 0.048102 Oct 28 20:37:08.635540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1589/3204] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:08 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:37:08.643702 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-76446ea8-ca94-4752-930d-4cd531328a4b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '.version_select at 0x7f1f4cdb7550>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:08.761197 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-76446ea8-ca94-4752-930d-4cd531328a4b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-884029290" status: 202 len: 0 microversion: 2.1 time: 0.122411 Oct 28 20:37:08.762992 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1616/3205] 10.222.0.66 () {58 vars in 1218 bytes} [Fri Oct 28 20:37:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-884029290 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:37:09.761416 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5487abe0-82f1-4fb3-9cea-52a483aeb984 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Action: 'create', calling method: .version_select at 0x7f1f4d003790>, body: {"keypair": {"name": "tempest-keypair-1132515341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiK2+NXD9NNl/AURyH82EtBr3CxmUJmykSPzPgyx0QRgZadw2nruklyX7T2OpMfGqkxpbM24v2gIWgFMUbul4QMYWGp+KRGf/53EQMuL34Hnvxt70dYSW02oUdWRZKyiA=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:37:09.776994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-5487abe0-82f1-4fb3-9cea-52a483aeb984 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Getting quotas for project 940ce72c42534c5196dfb909cc2a8d54. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:37:09.780908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-5487abe0-82f1-4fb3-9cea-52a483aeb984 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Getting quotas for user 724baaa4aa834e609fe4f513f9fc0b4b and project 940ce72c42534c5196dfb909cc2a8d54. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:37:09.792934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5487abe0-82f1-4fb3-9cea-52a483aeb984 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [ee96e2f6-c0ce-4b29-8443-7abafe8e4708] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:37:10.800127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [None req-5487abe0-82f1-4fb3-9cea-52a483aeb984 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [ee96e2f6-c0ce-4b29-8443-7abafe8e4708] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 57784. Oct 28 20:37:10.876345 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5487abe0-82f1-4fb3-9cea-52a483aeb984 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.118858 Oct 28 20:37:10.877151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1590/3206] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Oct 28 20:37:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:37:12.994159 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-607518140", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9279e057-17ab-422f-8ee0-b121068c9ee3"}], "security_groups": [{"name": "tempest-securitygroup--299350230"}], "key_name": "tempest-keypair-1132515341", "user_data": "}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:37:13.097336 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] validate_networks() for [('9279e057-17ab-422f-8ee0-b121068c9ee3', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:37:13.462628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:37:13.463050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:37:13.463540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:37:13.463950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:37:13.464360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:37:13.474059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:13.474538 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:13.475533 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:13.475726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:13.476178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:13.476602 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:13.493585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Getting quotas for project 940ce72c42534c5196dfb909cc2a8d54. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:37:13.497670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Getting quotas for user 724baaa4aa834e609fe4f513f9fc0b4b and project 940ce72c42534c5196dfb909cc2a8d54. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:37:13.508759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:37:13.511995 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:37:13.640691 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d09834cf-0e7e-4057-9b7e-df0826129a5c tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.650875 Oct 28 20:37:13.641304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1617/3207] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:37:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:37:13.652811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-de4c3283-9bc9-4b34-8387-a1eabe5f50fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:13.653458 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-de4c3283-9bc9-4b34-8387-a1eabe5f50fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:13.713174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-de4c3283-9bc9-4b34-8387-a1eabe5f50fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:13.720040 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-de4c3283-9bc9-4b34-8387-a1eabe5f50fa tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1241 microversion: 2.1 time: 0.071081 Oct 28 20:37:13.720599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1591/3208] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:13 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:14.744328 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b7ebed7b-3479-41dd-b97e-ef21e8204fb1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:14.745016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b7ebed7b-3479-41dd-b97e-ef21e8204fb1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:14.798523 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b7ebed7b-3479-41dd-b97e-ef21e8204fb1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:14.806820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b7ebed7b-3479-41dd-b97e-ef21e8204fb1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1241 microversion: 2.1 time: 0.066926 Oct 28 20:37:14.807384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1618/3209] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:14 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:15.829877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6fc45a57-f53c-4db9-9ef0-fe6e30e6044d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:15.830495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6fc45a57-f53c-4db9-9ef0-fe6e30e6044d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:15.883910 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6fc45a57-f53c-4db9-9ef0-fe6e30e6044d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:15.891385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6fc45a57-f53c-4db9-9ef0-fe6e30e6044d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1241 microversion: 2.1 time: 0.065295 Oct 28 20:37:15.891930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1592/3210] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:15 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:16.914917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b15d2455-435e-4739-b4d9-8f8c57e8a8df tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:16.915537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b15d2455-435e-4739-b4d9-8f8c57e8a8df tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:16.966771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b15d2455-435e-4739-b4d9-8f8c57e8a8df tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:16.974460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b15d2455-435e-4739-b4d9-8f8c57e8a8df tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1241 microversion: 2.1 time: 0.064211 Oct 28 20:37:16.975005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1619/3211] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:16 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:17.998190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b963feff-d638-41c7-bc8a-98758fd2fcf8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:17.998807 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b963feff-d638-41c7-bc8a-98758fd2fcf8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:18.006360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b963feff-d638-41c7-bc8a-98758fd2fcf8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:18.006863 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b963feff-d638-41c7-bc8a-98758fd2fcf8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:18.007308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b963feff-d638-41c7-bc8a-98758fd2fcf8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:18.008009 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b963feff-d638-41c7-bc8a-98758fd2fcf8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:18.008471 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b963feff-d638-41c7-bc8a-98758fd2fcf8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:18.008903 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b963feff-d638-41c7-bc8a-98758fd2fcf8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:18.074929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b963feff-d638-41c7-bc8a-98758fd2fcf8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:18.082446 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b963feff-d638-41c7-bc8a-98758fd2fcf8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1245 microversion: 2.1 time: 0.088217 Oct 28 20:37:18.083000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1593/3212] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:17 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:19.106368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aabfb7d4-308a-4abe-a42f-95ea9e0fec52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:19.106904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aabfb7d4-308a-4abe-a42f-95ea9e0fec52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:19.114847 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aabfb7d4-308a-4abe-a42f-95ea9e0fec52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:19.115335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aabfb7d4-308a-4abe-a42f-95ea9e0fec52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:19.115820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aabfb7d4-308a-4abe-a42f-95ea9e0fec52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:19.116898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aabfb7d4-308a-4abe-a42f-95ea9e0fec52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:19.117507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aabfb7d4-308a-4abe-a42f-95ea9e0fec52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:19.117944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aabfb7d4-308a-4abe-a42f-95ea9e0fec52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:19.180322 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-aabfb7d4-308a-4abe-a42f-95ea9e0fec52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:19.188032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aabfb7d4-308a-4abe-a42f-95ea9e0fec52 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1293 microversion: 2.1 time: 0.086444 Oct 28 20:37:19.188592 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1620/3213] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:19 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:20.212207 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d7dfbd61-0ae6-4367-b109-d65d731f7cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:20.212861 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d7dfbd61-0ae6-4367-b109-d65d731f7cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:20.219312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7dfbd61-0ae6-4367-b109-d65d731f7cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:20.220153 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7dfbd61-0ae6-4367-b109-d65d731f7cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:20.220278 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7dfbd61-0ae6-4367-b109-d65d731f7cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:20.220918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7dfbd61-0ae6-4367-b109-d65d731f7cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:20.221399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7dfbd61-0ae6-4367-b109-d65d731f7cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:20.221837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7dfbd61-0ae6-4367-b109-d65d731f7cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:20.286554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d7dfbd61-0ae6-4367-b109-d65d731f7cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:20.295081 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d7dfbd61-0ae6-4367-b109-d65d731f7cd7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1299 microversion: 2.1 time: 0.086922 Oct 28 20:37:20.295822 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1594/3214] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:20 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:21.318913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-52dc413a-eda9-4e8d-a1f3-8a2ea14d8410 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:21.319710 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-52dc413a-eda9-4e8d-a1f3-8a2ea14d8410 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:21.326009 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52dc413a-eda9-4e8d-a1f3-8a2ea14d8410 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:21.326497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52dc413a-eda9-4e8d-a1f3-8a2ea14d8410 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:21.326933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52dc413a-eda9-4e8d-a1f3-8a2ea14d8410 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:21.327659 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52dc413a-eda9-4e8d-a1f3-8a2ea14d8410 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:21.328110 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52dc413a-eda9-4e8d-a1f3-8a2ea14d8410 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:21.328532 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52dc413a-eda9-4e8d-a1f3-8a2ea14d8410 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:21.442535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7e4d69b2-5d88-46d3-a9c1-5cbc2066e808 req-11473828-b3c8-4182-8eab-5fdb6041484c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b7c7944-da30-4c0c-9837-956bac2ea772", "tag": "33b63293-71d7-4cd3-830f-34d61d0fdec5"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:37:21.454168 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7e4d69b2-5d88-46d3-a9c1-5cbc2066e808 req-11473828-b3c8-4182-8eab-5fdb6041484c service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:21.457522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7e4d69b2-5d88-46d3-a9c1-5cbc2066e808 req-11473828-b3c8-4182-8eab-5fdb6041484c service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:21.457522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7e4d69b2-5d88-46d3-a9c1-5cbc2066e808 req-11473828-b3c8-4182-8eab-5fdb6041484c service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:21.459917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-52dc413a-eda9-4e8d-a1f3-8a2ea14d8410 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:21.463579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:37:21.468437 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-52dc413a-eda9-4e8d-a1f3-8a2ea14d8410 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1366 microversion: 2.1 time: 0.153586 Oct 28 20:37:21.469063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1621/3215] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:21 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:21.477461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7e4d69b2-5d88-46d3-a9c1-5cbc2066e808 req-11473828-b3c8-4182-8eab-5fdb6041484c service nova] Creating event network-changed:33b63293-71d7-4cd3-830f-34d61d0fdec5 for instance 8b7c7944-da30-4c0c-9837-956bac2ea772 on hv-cinder-86236 Oct 28 20:37:21.483664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7e4d69b2-5d88-46d3-a9c1-5cbc2066e808 req-11473828-b3c8-4182-8eab-5fdb6041484c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045050 Oct 28 20:37:21.484694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1595/3216] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:37:22.494528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-22acb1f8-3162-4040-8949-3fbfdf18d6d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:22.495138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22acb1f8-3162-4040-8949-3fbfdf18d6d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:22.501736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22acb1f8-3162-4040-8949-3fbfdf18d6d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:22.502210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22acb1f8-3162-4040-8949-3fbfdf18d6d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:22.502639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22acb1f8-3162-4040-8949-3fbfdf18d6d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:22.503312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22acb1f8-3162-4040-8949-3fbfdf18d6d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:22.503758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22acb1f8-3162-4040-8949-3fbfdf18d6d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:22.504169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22acb1f8-3162-4040-8949-3fbfdf18d6d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:22.635272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-22acb1f8-3162-4040-8949-3fbfdf18d6d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:22.643088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-22acb1f8-3162-4040-8949-3fbfdf18d6d8 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1366 microversion: 2.1 time: 0.153548 Oct 28 20:37:22.643651 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1622/3217] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:22 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:23.668287 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0155ef51-1202-4e11-bee4-94913367cf23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:23.668984 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0155ef51-1202-4e11-bee4-94913367cf23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:23.675103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0155ef51-1202-4e11-bee4-94913367cf23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:23.675594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0155ef51-1202-4e11-bee4-94913367cf23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:23.676034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0155ef51-1202-4e11-bee4-94913367cf23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:23.676722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0155ef51-1202-4e11-bee4-94913367cf23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:23.677180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0155ef51-1202-4e11-bee4-94913367cf23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:23.677649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0155ef51-1202-4e11-bee4-94913367cf23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:23.817071 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0155ef51-1202-4e11-bee4-94913367cf23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:23.826100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0155ef51-1202-4e11-bee4-94913367cf23 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1366 microversion: 2.1 time: 0.162637 Oct 28 20:37:23.826674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1596/3218] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:23 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:24.850772 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fdd1a121-c207-4e35-9a7d-b2ef42806ecc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:24.851664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fdd1a121-c207-4e35-9a7d-b2ef42806ecc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:24.853663 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:37:24.859292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdd1a121-c207-4e35-9a7d-b2ef42806ecc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:24.859769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdd1a121-c207-4e35-9a7d-b2ef42806ecc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:24.860245 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdd1a121-c207-4e35-9a7d-b2ef42806ecc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:24.860916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdd1a121-c207-4e35-9a7d-b2ef42806ecc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:24.861389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdd1a121-c207-4e35-9a7d-b2ef42806ecc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:24.861813 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdd1a121-c207-4e35-9a7d-b2ef42806ecc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:24.996472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fdd1a121-c207-4e35-9a7d-b2ef42806ecc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:25.004062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fdd1a121-c207-4e35-9a7d-b2ef42806ecc tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1366 microversion: 2.1 time: 0.157879 Oct 28 20:37:25.004622 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1623/3219] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:24 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:26.027650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-44a613c9-3d53-4d6f-b573-cd90919907a7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:26.028265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-44a613c9-3d53-4d6f-b573-cd90919907a7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:26.030684 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:37:26.035533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44a613c9-3d53-4d6f-b573-cd90919907a7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:26.035963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44a613c9-3d53-4d6f-b573-cd90919907a7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:26.036402 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44a613c9-3d53-4d6f-b573-cd90919907a7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:26.037093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44a613c9-3d53-4d6f-b573-cd90919907a7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:26.038083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44a613c9-3d53-4d6f-b573-cd90919907a7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:26.044407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44a613c9-3d53-4d6f-b573-cd90919907a7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:26.170781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-44a613c9-3d53-4d6f-b573-cd90919907a7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:26.175739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-44a613c9-3d53-4d6f-b573-cd90919907a7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1366 microversion: 2.1 time: 0.151989 Oct 28 20:37:26.176296 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1597/3220] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:26 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:27.031814 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-f34eccd9-03f4-4397-8008-7c1422cffcfa req-a08ff451-10af-4e94-bfab-aae9b81319f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7c7944-da30-4c0c-9837-956bac2ea772", "name": "network-vif-plugged", "status": "completed", "tag": "33b63293-71d7-4cd3-830f-34d61d0fdec5"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:37:27.039998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=10 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:37:27.040675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:37:27.045700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f34eccd9-03f4-4397-8008-7c1422cffcfa req-a08ff451-10af-4e94-bfab-aae9b81319f4 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:27.046172 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f34eccd9-03f4-4397-8008-7c1422cffcfa req-a08ff451-10af-4e94-bfab-aae9b81319f4 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:27.046600 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f34eccd9-03f4-4397-8008-7c1422cffcfa req-a08ff451-10af-4e94-bfab-aae9b81319f4 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:27.057985 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-f34eccd9-03f4-4397-8008-7c1422cffcfa req-a08ff451-10af-4e94-bfab-aae9b81319f4 service nova] Creating event network-vif-plugged:33b63293-71d7-4cd3-830f-34d61d0fdec5 for instance 8b7c7944-da30-4c0c-9837-956bac2ea772 on hv-cinder-86236 Oct 28 20:37:27.062968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-f34eccd9-03f4-4397-8008-7c1422cffcfa req-a08ff451-10af-4e94-bfab-aae9b81319f4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034908 Oct 28 20:37:27.063531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1624/3221] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:37:27.199317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-10bf3f63-5a3e-4736-9c31-1cea2880a664 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:27.199963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-10bf3f63-5a3e-4736-9c31-1cea2880a664 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:27.206340 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10bf3f63-5a3e-4736-9c31-1cea2880a664 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:27.206821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10bf3f63-5a3e-4736-9c31-1cea2880a664 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:27.207251 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10bf3f63-5a3e-4736-9c31-1cea2880a664 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:27.207931 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10bf3f63-5a3e-4736-9c31-1cea2880a664 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:27.208385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10bf3f63-5a3e-4736-9c31-1cea2880a664 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:27.208868 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10bf3f63-5a3e-4736-9c31-1cea2880a664 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:27.341414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-10bf3f63-5a3e-4736-9c31-1cea2880a664 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:27.349043 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-10bf3f63-5a3e-4736-9c31-1cea2880a664 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1366 microversion: 2.1 time: 0.153599 Oct 28 20:37:27.349640 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1598/3222] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:27 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:28.374452 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b7bd9bf3-7cf7-4396-af2c-a0b884478232 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:28.375145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b7bd9bf3-7cf7-4396-af2c-a0b884478232 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:28.382585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7bd9bf3-7cf7-4396-af2c-a0b884478232 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:28.383061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7bd9bf3-7cf7-4396-af2c-a0b884478232 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:28.383492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7bd9bf3-7cf7-4396-af2c-a0b884478232 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:28.384170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7bd9bf3-7cf7-4396-af2c-a0b884478232 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:28.384621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7bd9bf3-7cf7-4396-af2c-a0b884478232 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:28.385059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7bd9bf3-7cf7-4396-af2c-a0b884478232 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:28.518294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b7bd9bf3-7cf7-4396-af2c-a0b884478232 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:28.527438 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b7bd9bf3-7cf7-4396-af2c-a0b884478232 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1366 microversion: 2.1 time: 0.157708 Oct 28 20:37:28.528038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1625/3223] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:28 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:29.550210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b42e5f37-92a0-47ce-b77c-ad908d878a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:29.550746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b42e5f37-92a0-47ce-b77c-ad908d878a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:29.557177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b42e5f37-92a0-47ce-b77c-ad908d878a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:29.557685 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b42e5f37-92a0-47ce-b77c-ad908d878a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:29.558115 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b42e5f37-92a0-47ce-b77c-ad908d878a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:29.558786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b42e5f37-92a0-47ce-b77c-ad908d878a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:29.559230 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b42e5f37-92a0-47ce-b77c-ad908d878a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:29.559644 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b42e5f37-92a0-47ce-b77c-ad908d878a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:29.689477 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b42e5f37-92a0-47ce-b77c-ad908d878a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:29.697170 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b42e5f37-92a0-47ce-b77c-ad908d878a70 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1557 microversion: 2.1 time: 0.150835 Oct 28 20:37:29.697765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1599/3224] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:29 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:29.720007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4b4f43c9-90aa-480f-a372-4dc182a246cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:29.720526 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4b4f43c9-90aa-480f-a372-4dc182a246cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:29.727800 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b4f43c9-90aa-480f-a372-4dc182a246cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:29.728472 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b4f43c9-90aa-480f-a372-4dc182a246cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:29.729244 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b4f43c9-90aa-480f-a372-4dc182a246cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:29.730288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b4f43c9-90aa-480f-a372-4dc182a246cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:29.731111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b4f43c9-90aa-480f-a372-4dc182a246cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:29.731866 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b4f43c9-90aa-480f-a372-4dc182a246cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:29.815573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4b4f43c9-90aa-480f-a372-4dc182a246cf tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099733 Oct 28 20:37:29.816161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1626/3225] 10.222.0.66 () {58 vars in 1275 bytes} [Fri Oct 28 20:37:29 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:37:30.817920 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-72cc2241-dd37-46de-b566-ce96cd4d9250 req-d72e44c3-ebc2-405e-862d-87e35d98b21f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b7c7944-da30-4c0c-9837-956bac2ea772", "tag": "33b63293-71d7-4cd3-830f-34d61d0fdec5"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:37:30.827820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-72cc2241-dd37-46de-b566-ce96cd4d9250 req-d72e44c3-ebc2-405e-862d-87e35d98b21f service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:30.828297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-72cc2241-dd37-46de-b566-ce96cd4d9250 req-d72e44c3-ebc2-405e-862d-87e35d98b21f service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:30.828727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-72cc2241-dd37-46de-b566-ce96cd4d9250 req-d72e44c3-ebc2-405e-862d-87e35d98b21f service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:30.843067 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-72cc2241-dd37-46de-b566-ce96cd4d9250 req-d72e44c3-ebc2-405e-862d-87e35d98b21f service nova] Creating event network-changed:33b63293-71d7-4cd3-830f-34d61d0fdec5 for instance 8b7c7944-da30-4c0c-9837-956bac2ea772 on hv-cinder-86236 Oct 28 20:37:30.844723 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-72cc2241-dd37-46de-b566-ce96cd4d9250 req-d72e44c3-ebc2-405e-862d-87e35d98b21f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030410 Oct 28 20:37:30.845562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1600/3226] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:38:04.754593 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=5 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:38:04.755349 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=24 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:38:04.759289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a9a16025-e2d7-40aa-987f-c4a773fd48b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:38:04.759775 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a9a16025-e2d7-40aa-987f-c4a773fd48b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:38:04.765696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9a16025-e2d7-40aa-987f-c4a773fd48b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:38:04.768733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9a16025-e2d7-40aa-987f-c4a773fd48b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:38:04.768733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9a16025-e2d7-40aa-987f-c4a773fd48b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:38:04.768733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9a16025-e2d7-40aa-987f-c4a773fd48b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:38:04.768733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9a16025-e2d7-40aa-987f-c4a773fd48b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:38:04.769153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9a16025-e2d7-40aa-987f-c4a773fd48b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:38:04.790863 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a9a16025-e2d7-40aa-987f-c4a773fd48b2 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772/ips" status: 200 len: 151 microversion: 2.1 time: 0.038030 Oct 28 20:38:04.791413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1627/3227] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Oct 28 20:38:04 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:38:59.812949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:38:59.817203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=44 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:38:59.817203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:38:59.817203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:38:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.66) !!! Oct 28 20:38:59.822337 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-202885152", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452", "networks": [{"uuid": "4aa73c8c-7fa2-44b6-a0dd-79957dc820ff"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:38:59.884149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] validate_networks() for [('4aa73c8c-7fa2-44b6-a0dd-79957dc820ff', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:39:00.432813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:39:00.433299 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:39:00.433795 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:39:00.434423 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:39:00.434995 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:39:00.446621 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:00.447616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:00.448238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:00.449437 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:00.450260 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:00.450889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:00.470546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Getting quotas for project 62f0f20404ba41d3aa380a9d10eeab81. Resources: {'instances', 'ram', 'cores'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:39:00.475030 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Getting quotas for user 14729da7649a4ab785ff87981968d342 and project 62f0f20404ba41d3aa380a9d10eeab81. Resources: {'instances', 'ram', 'cores'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:39:00.486408 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:39:00.494652 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:39:00.657713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-62f14c82-6a79-43fb-bbd5-0f4f377b4b3e tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.846542 Oct 28 20:39:00.658565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1601/3228] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:38:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:39:00.669828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5b8f2e30-42ae-4edc-bcc6-7552598ce833 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:00.671021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5b8f2e30-42ae-4edc-bcc6-7552598ce833 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:00.767012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5b8f2e30-42ae-4edc-bcc6-7552598ce833 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:00.774031 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5b8f2e30-42ae-4edc-bcc6-7552598ce833 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1218 microversion: 2.1 time: 0.107963 Oct 28 20:39:00.774594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1628/3229] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:00 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:01.206232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-cab95eae-55d1-49b6-8f00-0f745e8a3867 req-2c696a74-b90a-402b-9c39-fd54cab36783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a", "name": "network-vif-deleted", "tag": "16352761-cd2a-451f-bb6b-e0cbbe3cba15"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:39:01.219734 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cab95eae-55d1-49b6-8f00-0f745e8a3867 req-2c696a74-b90a-402b-9c39-fd54cab36783 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:01.220216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cab95eae-55d1-49b6-8f00-0f745e8a3867 req-2c696a74-b90a-402b-9c39-fd54cab36783 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:01.220686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cab95eae-55d1-49b6-8f00-0f745e8a3867 req-2c696a74-b90a-402b-9c39-fd54cab36783 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:01.231884 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-cab95eae-55d1-49b6-8f00-0f745e8a3867 req-2c696a74-b90a-402b-9c39-fd54cab36783 service nova] Creating event network-vif-deleted:16352761-cd2a-451f-bb6b-e0cbbe3cba15 for instance 6ec9b19e-c4b1-49c3-9dbc-98b7e1d79a4a on hv-cinder-86236 Oct 28 20:39:01.237053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-cab95eae-55d1-49b6-8f00-0f745e8a3867 req-2c696a74-b90a-402b-9c39-fd54cab36783 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034966 Oct 28 20:39:01.237752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1602/3230] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:39:01.475739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-12fdb67d-ddeb-4bd4-8f95-315e11a713b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8121fa46-6853-42ca-921c-799cd8e0a7f5"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:39:01.478246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-12fdb67d-ddeb-4bd4-8f95-315e11a713b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:01.484149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12fdb67d-ddeb-4bd4-8f95-315e11a713b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:01.484563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12fdb67d-ddeb-4bd4-8f95-315e11a713b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:01.484990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12fdb67d-ddeb-4bd4-8f95-315e11a713b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:01.485795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12fdb67d-ddeb-4bd4-8f95-315e11a713b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:01.486150 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12fdb67d-ddeb-4bd4-8f95-315e11a713b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:01.486833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12fdb67d-ddeb-4bd4-8f95-315e11a713b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:01.797941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-42d2d07d-4ef3-4de4-95d0-6c1b82f2ecf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:01.798636 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42d2d07d-4ef3-4de4-95d0-6c1b82f2ecf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:01.805419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42d2d07d-4ef3-4de4-95d0-6c1b82f2ecf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:01.805949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42d2d07d-4ef3-4de4-95d0-6c1b82f2ecf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:01.806386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42d2d07d-4ef3-4de4-95d0-6c1b82f2ecf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:01.807068 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42d2d07d-4ef3-4de4-95d0-6c1b82f2ecf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:01.807518 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42d2d07d-4ef3-4de4-95d0-6c1b82f2ecf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:01.807943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42d2d07d-4ef3-4de4-95d0-6c1b82f2ecf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:01.870494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-42d2d07d-4ef3-4de4-95d0-6c1b82f2ecf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:01.877947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-42d2d07d-4ef3-4de4-95d0-6c1b82f2ecf2 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1222 microversion: 2.1 time: 0.084105 Oct 28 20:39:01.879159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1603/3231] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:01 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:39:02.900698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-53917ea5-32c8-4361-a52d-69eadc14d4b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:02.901309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-53917ea5-32c8-4361-a52d-69eadc14d4b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:02.907632 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53917ea5-32c8-4361-a52d-69eadc14d4b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:02.908111 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53917ea5-32c8-4361-a52d-69eadc14d4b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:02.908543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53917ea5-32c8-4361-a52d-69eadc14d4b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:02.909214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53917ea5-32c8-4361-a52d-69eadc14d4b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:02.910295 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53917ea5-32c8-4361-a52d-69eadc14d4b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:02.910728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53917ea5-32c8-4361-a52d-69eadc14d4b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:02.973177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-53917ea5-32c8-4361-a52d-69eadc14d4b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:02.980584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-53917ea5-32c8-4361-a52d-69eadc14d4b6 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1222 microversion: 2.1 time: 0.083702 Oct 28 20:39:02.981138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1604/3232] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:02 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:39:04.010818 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6fe7bc92-e3e3-438b-85f2-961842d99189 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:04.011514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6fe7bc92-e3e3-438b-85f2-961842d99189 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:04.018307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fe7bc92-e3e3-438b-85f2-961842d99189 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:04.019374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fe7bc92-e3e3-438b-85f2-961842d99189 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:04.020272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fe7bc92-e3e3-438b-85f2-961842d99189 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:04.020449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fe7bc92-e3e3-438b-85f2-961842d99189 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:04.020904 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fe7bc92-e3e3-438b-85f2-961842d99189 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:04.021358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fe7bc92-e3e3-438b-85f2-961842d99189 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:04.084826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6fe7bc92-e3e3-438b-85f2-961842d99189 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:04.092508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6fe7bc92-e3e3-438b-85f2-961842d99189 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1222 microversion: 2.1 time: 0.092053 Oct 28 20:39:04.093072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1605/3233] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:03 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:39:04.664041 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-12fdb67d-ddeb-4bd4-8f95-315e11a713b1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "POST /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.192291 Oct 28 20:39:04.664638 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1629/3234] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Oct 28 20:39:01 2022] POST /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772/os-volume_attachments => generated 194 bytes in 3194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:39:05.116556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-355016bc-f8bb-4515-b083-2689b0830c1d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:05.117204 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-355016bc-f8bb-4515-b083-2689b0830c1d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:05.123701 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-355016bc-f8bb-4515-b083-2689b0830c1d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:05.124232 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-355016bc-f8bb-4515-b083-2689b0830c1d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:05.124719 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-355016bc-f8bb-4515-b083-2689b0830c1d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:05.125426 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-355016bc-f8bb-4515-b083-2689b0830c1d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:05.125886 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-355016bc-f8bb-4515-b083-2689b0830c1d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:05.126312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-355016bc-f8bb-4515-b083-2689b0830c1d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:05.187320 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-355016bc-f8bb-4515-b083-2689b0830c1d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:05.194863 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-355016bc-f8bb-4515-b083-2689b0830c1d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1270 microversion: 2.1 time: 0.083344 Oct 28 20:39:05.195423 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1606/3235] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:05 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:06.218833 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4df4d8d4-e545-402a-b23e-44038757c3f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:06.220275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4df4d8d4-e545-402a-b23e-44038757c3f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:06.229391 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4df4d8d4-e545-402a-b23e-44038757c3f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:06.230427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4df4d8d4-e545-402a-b23e-44038757c3f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:06.231096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4df4d8d4-e545-402a-b23e-44038757c3f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:06.232034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4df4d8d4-e545-402a-b23e-44038757c3f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:06.232569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4df4d8d4-e545-402a-b23e-44038757c3f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:06.233069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4df4d8d4-e545-402a-b23e-44038757c3f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:06.374318 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-4df4d8d4-e545-402a-b23e-44038757c3f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:06.382559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4df4d8d4-e545-402a-b23e-44038757c3f5 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1318 microversion: 2.1 time: 0.168499 Oct 28 20:39:06.383065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1630/3236] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:06 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:39:07.406085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e9c18be7-53c1-41f5-8872-3d04b4744ca0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:07.410277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e9c18be7-53c1-41f5-8872-3d04b4744ca0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:07.414959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c18be7-53c1-41f5-8872-3d04b4744ca0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:07.415443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c18be7-53c1-41f5-8872-3d04b4744ca0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:07.415874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c18be7-53c1-41f5-8872-3d04b4744ca0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:07.416565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c18be7-53c1-41f5-8872-3d04b4744ca0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:07.417065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c18be7-53c1-41f5-8872-3d04b4744ca0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:07.417512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9c18be7-53c1-41f5-8872-3d04b4744ca0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:07.581767 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e9c18be7-53c1-41f5-8872-3d04b4744ca0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:07.589282 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e9c18be7-53c1-41f5-8872-3d04b4744ca0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1318 microversion: 2.1 time: 0.187174 Oct 28 20:39:07.589854 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1607/3237] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:07 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:08.506515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-e3005c02-82eb-4b5e-9433-e1bcb337b937 req-3c67cd02-1504-484d-be30-65bdfa2591b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05253d01-e40f-46b4-8f11-b102dae97e69", "tag": "7e683046-7446-4d00-9377-3e53c367a104"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:39:08.517910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e3005c02-82eb-4b5e-9433-e1bcb337b937 req-3c67cd02-1504-484d-be30-65bdfa2591b7 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:08.518510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e3005c02-82eb-4b5e-9433-e1bcb337b937 req-3c67cd02-1504-484d-be30-65bdfa2591b7 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:08.519629 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e3005c02-82eb-4b5e-9433-e1bcb337b937 req-3c67cd02-1504-484d-be30-65bdfa2591b7 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:08.532208 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-e3005c02-82eb-4b5e-9433-e1bcb337b937 req-3c67cd02-1504-484d-be30-65bdfa2591b7 service nova] Creating event network-changed:7e683046-7446-4d00-9377-3e53c367a104 for instance 05253d01-e40f-46b4-8f11-b102dae97e69 on hv-cinder-86236 Oct 28 20:39:08.543215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-e3005c02-82eb-4b5e-9433-e1bcb337b937 req-3c67cd02-1504-484d-be30-65bdfa2591b7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037519 Oct 28 20:39:08.543215 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1631/3238] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:39:08.618289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-56f29320-330e-4d55-9fd7-4b44c29e0447 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:08.619151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-56f29320-330e-4d55-9fd7-4b44c29e0447 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:08.628817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56f29320-330e-4d55-9fd7-4b44c29e0447 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:08.628817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56f29320-330e-4d55-9fd7-4b44c29e0447 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:08.628817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56f29320-330e-4d55-9fd7-4b44c29e0447 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:08.629836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56f29320-330e-4d55-9fd7-4b44c29e0447 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:08.629836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56f29320-330e-4d55-9fd7-4b44c29e0447 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:08.630027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56f29320-330e-4d55-9fd7-4b44c29e0447 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:08.812879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-56f29320-330e-4d55-9fd7-4b44c29e0447 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:08.829008 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-56f29320-330e-4d55-9fd7-4b44c29e0447 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1318 microversion: 2.1 time: 0.217993 Oct 28 20:39:08.829826 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1608/3239] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:08 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:09.854600 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-680da0d3-381f-4ace-a177-a541cb273836 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:09.855388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-680da0d3-381f-4ace-a177-a541cb273836 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:09.861982 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-680da0d3-381f-4ace-a177-a541cb273836 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:09.862600 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-680da0d3-381f-4ace-a177-a541cb273836 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:09.863052 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-680da0d3-381f-4ace-a177-a541cb273836 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:09.863749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-680da0d3-381f-4ace-a177-a541cb273836 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:09.864204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-680da0d3-381f-4ace-a177-a541cb273836 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:09.868219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-680da0d3-381f-4ace-a177-a541cb273836 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:10.004442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-680da0d3-381f-4ace-a177-a541cb273836 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:10.012061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-680da0d3-381f-4ace-a177-a541cb273836 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1318 microversion: 2.1 time: 0.162195 Oct 28 20:39:10.012640 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1632/3240] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:09 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:11.036323 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0798de99-9a52-45d7-b413-405850a59207 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:11.036946 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0798de99-9a52-45d7-b413-405850a59207 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:11.039380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:11.040154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:11.044837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0798de99-9a52-45d7-b413-405850a59207 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:11.045343 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0798de99-9a52-45d7-b413-405850a59207 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:11.045860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0798de99-9a52-45d7-b413-405850a59207 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:11.046550 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0798de99-9a52-45d7-b413-405850a59207 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:11.047011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0798de99-9a52-45d7-b413-405850a59207 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:11.047448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0798de99-9a52-45d7-b413-405850a59207 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:11.207843 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0798de99-9a52-45d7-b413-405850a59207 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:11.215409 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0798de99-9a52-45d7-b413-405850a59207 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1318 microversion: 2.1 time: 0.183745 Oct 28 20:39:11.215973 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1609/3241] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:11 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:12.239027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b6527812-7b9d-40a7-aff2-a2626aec158d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:12.239650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b6527812-7b9d-40a7-aff2-a2626aec158d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:12.241687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:12.246977 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6527812-7b9d-40a7-aff2-a2626aec158d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:12.247469 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6527812-7b9d-40a7-aff2-a2626aec158d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:12.247911 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6527812-7b9d-40a7-aff2-a2626aec158d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:12.250769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6527812-7b9d-40a7-aff2-a2626aec158d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:12.250769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6527812-7b9d-40a7-aff2-a2626aec158d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:12.250769 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6527812-7b9d-40a7-aff2-a2626aec158d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:12.380226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b6527812-7b9d-40a7-aff2-a2626aec158d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:12.388194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b6527812-7b9d-40a7-aff2-a2626aec158d tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1318 microversion: 2.1 time: 0.153345 Oct 28 20:39:12.388750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1633/3242] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:12 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:13.412292 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-52ccf776-b1dc-45f7-bb73-ebec8e298560 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:13.412987 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-52ccf776-b1dc-45f7-bb73-ebec8e298560 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:13.419494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52ccf776-b1dc-45f7-bb73-ebec8e298560 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:13.420061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52ccf776-b1dc-45f7-bb73-ebec8e298560 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:13.420574 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52ccf776-b1dc-45f7-bb73-ebec8e298560 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:13.421268 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52ccf776-b1dc-45f7-bb73-ebec8e298560 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:13.421811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52ccf776-b1dc-45f7-bb73-ebec8e298560 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:13.422237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52ccf776-b1dc-45f7-bb73-ebec8e298560 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:13.424113 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b0042466-80c7-4e22-836f-5b2994e22076 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:13.424609 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b0042466-80c7-4e22-836f-5b2994e22076 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:13.431214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0042466-80c7-4e22-836f-5b2994e22076 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:13.435690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0042466-80c7-4e22-836f-5b2994e22076 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:13.435690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0042466-80c7-4e22-836f-5b2994e22076 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:13.435690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0042466-80c7-4e22-836f-5b2994e22076 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:13.435690 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0042466-80c7-4e22-836f-5b2994e22076 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:13.436006 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0042466-80c7-4e22-836f-5b2994e22076 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:13.519278 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-b0042466-80c7-4e22-836f-5b2994e22076 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lazy-loading 'services' on Instance uuid 8b7c7944-da30-4c0c-9837-956bac2ea772 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:39:13.557133 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-52ccf776-b1dc-45f7-bb73-ebec8e298560 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:13.564887 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-52ccf776-b1dc-45f7-bb73-ebec8e298560 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1318 microversion: 2.1 time: 0.156274 Oct 28 20:39:13.565351 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1610/3243] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:13 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:13.748871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b0042466-80c7-4e22-836f-5b2994e22076 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772/os-volume_attachments/8121fa46-6853-42ca-921c-799cd8e0a7f5" status: 202 len: 0 microversion: 2.1 time: 0.328104 Oct 28 20:39:13.749735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1634/3244] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Oct 28 20:39:13 2022] DELETE /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772/os-volume_attachments/8121fa46-6853-42ca-921c-799cd8e0a7f5 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 20:39:13.759105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c51b9199-5067-45a1-88b0-056bab12649f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:13.761849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c51b9199-5067-45a1-88b0-056bab12649f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:13.769587 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c51b9199-5067-45a1-88b0-056bab12649f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:13.770084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c51b9199-5067-45a1-88b0-056bab12649f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:13.770524 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c51b9199-5067-45a1-88b0-056bab12649f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:13.771918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c51b9199-5067-45a1-88b0-056bab12649f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:13.772344 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c51b9199-5067-45a1-88b0-056bab12649f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:13.773014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c51b9199-5067-45a1-88b0-056bab12649f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:13.803708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c51b9199-5067-45a1-88b0-056bab12649f tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048926 Oct 28 20:39:13.804275 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1611/3245] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:39:13 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:39:14.589362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a47ea1bc-cc06-48a5-9855-a8fe8e226857 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:14.590067 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a47ea1bc-cc06-48a5-9855-a8fe8e226857 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:14.596214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a47ea1bc-cc06-48a5-9855-a8fe8e226857 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:14.597360 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a47ea1bc-cc06-48a5-9855-a8fe8e226857 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:14.597862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a47ea1bc-cc06-48a5-9855-a8fe8e226857 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:14.598581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a47ea1bc-cc06-48a5-9855-a8fe8e226857 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:14.599037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a47ea1bc-cc06-48a5-9855-a8fe8e226857 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:14.599464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a47ea1bc-cc06-48a5-9855-a8fe8e226857 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:14.733447 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a47ea1bc-cc06-48a5-9855-a8fe8e226857 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:14.744249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a47ea1bc-cc06-48a5-9855-a8fe8e226857 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1318 microversion: 2.1 time: 0.159607 Oct 28 20:39:14.750218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1635/3246] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:14 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:14.816365 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7ea1db53-60e1-4588-8745-124cee636655 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:14.818597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7ea1db53-60e1-4588-8745-124cee636655 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:14.824985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ea1db53-60e1-4588-8745-124cee636655 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:14.825508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ea1db53-60e1-4588-8745-124cee636655 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:14.825954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ea1db53-60e1-4588-8745-124cee636655 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:14.826649 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ea1db53-60e1-4588-8745-124cee636655 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:14.827108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ea1db53-60e1-4588-8745-124cee636655 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:14.827536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ea1db53-60e1-4588-8745-124cee636655 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:14.858599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7ea1db53-60e1-4588-8745-124cee636655 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046425 Oct 28 20:39:14.859167 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1612/3247] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:39:14 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:39:15.772204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b1d513b4-3cc7-4957-b9cf-c7c4deb715bd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:15.772961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b1d513b4-3cc7-4957-b9cf-c7c4deb715bd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:15.779270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1d513b4-3cc7-4957-b9cf-c7c4deb715bd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:15.779850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1d513b4-3cc7-4957-b9cf-c7c4deb715bd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:15.780297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1d513b4-3cc7-4957-b9cf-c7c4deb715bd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:15.780988 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1d513b4-3cc7-4957-b9cf-c7c4deb715bd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:15.781467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1d513b4-3cc7-4957-b9cf-c7c4deb715bd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:15.781894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1d513b4-3cc7-4957-b9cf-c7c4deb715bd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:15.875507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a5889635-cbda-4855-ac69-b2bde3f3d8e3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:15.877726 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a5889635-cbda-4855-ac69-b2bde3f3d8e3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:15.885942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5889635-cbda-4855-ac69-b2bde3f3d8e3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:15.886624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5889635-cbda-4855-ac69-b2bde3f3d8e3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:15.887225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5889635-cbda-4855-ac69-b2bde3f3d8e3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:15.888210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5889635-cbda-4855-ac69-b2bde3f3d8e3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:15.888823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5889635-cbda-4855-ac69-b2bde3f3d8e3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:15.889440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5889635-cbda-4855-ac69-b2bde3f3d8e3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:15.921616 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a5889635-cbda-4855-ac69-b2bde3f3d8e3 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053341 Oct 28 20:39:15.922187 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1613/3248] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:39:15 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 20:39:15.928450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b1d513b4-3cc7-4957-b9cf-c7c4deb715bd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:15.936288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b1d513b4-3cc7-4957-b9cf-c7c4deb715bd tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1318 microversion: 2.1 time: 0.167843 Oct 28 20:39:15.936887 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1636/3249] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:15 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:16.073032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-180b8acd-8d86-471a-9700-45d177118221 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:16.073585 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-180b8acd-8d86-471a-9700-45d177118221 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:16.079774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-180b8acd-8d86-471a-9700-45d177118221 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:16.080258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-180b8acd-8d86-471a-9700-45d177118221 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:16.080688 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-180b8acd-8d86-471a-9700-45d177118221 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:16.081656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-180b8acd-8d86-471a-9700-45d177118221 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:16.082654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-180b8acd-8d86-471a-9700-45d177118221 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:16.083301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-180b8acd-8d86-471a-9700-45d177118221 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:16.114218 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-180b8acd-8d86-471a-9700-45d177118221 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:39:16.391016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-180b8acd-8d86-471a-9700-45d177118221 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 204 len: 0 microversion: 2.1 time: 0.321672 Oct 28 20:39:16.391522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1614/3250] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:39:16 2022] DELETE /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:16.399939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f7c8c03c-db00-4a8d-b780-62f3bf0ead17 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:16.400566 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f7c8c03c-db00-4a8d-b780-62f3bf0ead17 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:16.406635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c8c03c-db00-4a8d-b780-62f3bf0ead17 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:16.407115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c8c03c-db00-4a8d-b780-62f3bf0ead17 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:16.407556 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c8c03c-db00-4a8d-b780-62f3bf0ead17 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:16.408236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c8c03c-db00-4a8d-b780-62f3bf0ead17 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:16.408698 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c8c03c-db00-4a8d-b780-62f3bf0ead17 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:16.409116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c8c03c-db00-4a8d-b780-62f3bf0ead17 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:16.542951 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f7c8c03c-db00-4a8d-b780-62f3bf0ead17 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:16.550556 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f7c8c03c-db00-4a8d-b780-62f3bf0ead17 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1682 microversion: 2.1 time: 0.154454 Oct 28 20:39:16.551821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1637/3251] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:16 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:16.959297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1b78a8fe-7866-4621-b869-7047e6df9624 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:16.960045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1b78a8fe-7866-4621-b869-7047e6df9624 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:16.966448 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b78a8fe-7866-4621-b869-7047e6df9624 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:16.966934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b78a8fe-7866-4621-b869-7047e6df9624 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:16.967372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b78a8fe-7866-4621-b869-7047e6df9624 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:16.968058 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b78a8fe-7866-4621-b869-7047e6df9624 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:16.968515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b78a8fe-7866-4621-b869-7047e6df9624 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:16.968939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b78a8fe-7866-4621-b869-7047e6df9624 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:17.109189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1b78a8fe-7866-4621-b869-7047e6df9624 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:17.118056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1b78a8fe-7866-4621-b869-7047e6df9624 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1318 microversion: 2.1 time: 0.163656 Oct 28 20:39:17.118752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1615/3252] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:16 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:17.144448 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-9b090440-1d8a-4fa0-a53e-228935bf0872 req-743cdce0-2ae8-421d-b8b8-8ffe349e30b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05253d01-e40f-46b4-8f11-b102dae97e69", "name": "network-vif-plugged", "status": "completed", "tag": "7e683046-7446-4d00-9377-3e53c367a104"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:39:17.155116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9b090440-1d8a-4fa0-a53e-228935bf0872 req-743cdce0-2ae8-421d-b8b8-8ffe349e30b3 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:17.155641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9b090440-1d8a-4fa0-a53e-228935bf0872 req-743cdce0-2ae8-421d-b8b8-8ffe349e30b3 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:17.156088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9b090440-1d8a-4fa0-a53e-228935bf0872 req-743cdce0-2ae8-421d-b8b8-8ffe349e30b3 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:17.170232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-9b090440-1d8a-4fa0-a53e-228935bf0872 req-743cdce0-2ae8-421d-b8b8-8ffe349e30b3 service nova] Creating event network-vif-plugged:7e683046-7446-4d00-9377-3e53c367a104 for instance 05253d01-e40f-46b4-8f11-b102dae97e69 on hv-cinder-86236 Oct 28 20:39:17.175400 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-9b090440-1d8a-4fa0-a53e-228935bf0872 req-743cdce0-2ae8-421d-b8b8-8ffe349e30b3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034508 Oct 28 20:39:17.176383 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1638/3253] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:39:17.574056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-778719cb-5d1d-4961-a7fe-bd54f604359e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:17.574728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-778719cb-5d1d-4961-a7fe-bd54f604359e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:17.580542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-778719cb-5d1d-4961-a7fe-bd54f604359e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:17.581023 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-778719cb-5d1d-4961-a7fe-bd54f604359e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:17.581498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-778719cb-5d1d-4961-a7fe-bd54f604359e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:17.582698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-778719cb-5d1d-4961-a7fe-bd54f604359e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:17.583159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-778719cb-5d1d-4961-a7fe-bd54f604359e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:17.583573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-778719cb-5d1d-4961-a7fe-bd54f604359e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:17.722651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-778719cb-5d1d-4961-a7fe-bd54f604359e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:17.730407 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-778719cb-5d1d-4961-a7fe-bd54f604359e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1682 microversion: 2.1 time: 0.160171 Oct 28 20:39:17.730965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1616/3254] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:17 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:18.142897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aeb488e4-08ed-4552-8c58-8ef062c0ff32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:18.143921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aeb488e4-08ed-4552-8c58-8ef062c0ff32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:18.151200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aeb488e4-08ed-4552-8c58-8ef062c0ff32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:18.151852 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aeb488e4-08ed-4552-8c58-8ef062c0ff32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:18.152114 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aeb488e4-08ed-4552-8c58-8ef062c0ff32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:18.152820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aeb488e4-08ed-4552-8c58-8ef062c0ff32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:18.153272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aeb488e4-08ed-4552-8c58-8ef062c0ff32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:18.153719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aeb488e4-08ed-4552-8c58-8ef062c0ff32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:18.561200 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-aeb488e4-08ed-4552-8c58-8ef062c0ff32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:18.569276 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aeb488e4-08ed-4552-8c58-8ef062c0ff32 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1318 microversion: 2.1 time: 0.430641 Oct 28 20:39:18.569885 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1639/3255] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:18 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:18.754343 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2cf78a81-cf9c-46f4-bbaa-aa727ded52c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:18.754876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2cf78a81-cf9c-46f4-bbaa-aa727ded52c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:18.761093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cf78a81-cf9c-46f4-bbaa-aa727ded52c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:18.761611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cf78a81-cf9c-46f4-bbaa-aa727ded52c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:18.762053 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cf78a81-cf9c-46f4-bbaa-aa727ded52c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:18.762742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cf78a81-cf9c-46f4-bbaa-aa727ded52c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:18.763197 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cf78a81-cf9c-46f4-bbaa-aa727ded52c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:18.763620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cf78a81-cf9c-46f4-bbaa-aa727ded52c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:18.768665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:18.902504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2cf78a81-cf9c-46f4-bbaa-aa727ded52c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:18.915290 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2cf78a81-cf9c-46f4-bbaa-aa727ded52c7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1682 microversion: 2.1 time: 0.164990 Oct 28 20:39:18.916076 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1617/3256] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:18 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:19.222653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-187b08db-7698-4b86-8719-7889cfe3f968 req-131f0c03-174e-4c4a-a7f7-a6473d568a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7c7944-da30-4c0c-9837-956bac2ea772", "name": "network-vif-deleted", "tag": "33b63293-71d7-4cd3-830f-34d61d0fdec5"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:39:19.233590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-187b08db-7698-4b86-8719-7889cfe3f968 req-131f0c03-174e-4c4a-a7f7-a6473d568a2f service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:19.234147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-187b08db-7698-4b86-8719-7889cfe3f968 req-131f0c03-174e-4c4a-a7f7-a6473d568a2f service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:19.234655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-187b08db-7698-4b86-8719-7889cfe3f968 req-131f0c03-174e-4c4a-a7f7-a6473d568a2f service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:19.246153 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-187b08db-7698-4b86-8719-7889cfe3f968 req-131f0c03-174e-4c4a-a7f7-a6473d568a2f service nova] Creating event network-vif-deleted:33b63293-71d7-4cd3-830f-34d61d0fdec5 for instance 8b7c7944-da30-4c0c-9837-956bac2ea772 on hv-cinder-86236 Oct 28 20:39:19.250943 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-187b08db-7698-4b86-8719-7889cfe3f968 req-131f0c03-174e-4c4a-a7f7-a6473d568a2f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032063 Oct 28 20:39:19.251857 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1640/3257] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:39:19.592004 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2f3d46c5-abd8-473a-9f1a-08f0d5c1a8f8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:19.592532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2f3d46c5-abd8-473a-9f1a-08f0d5c1a8f8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:19.599642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d46c5-abd8-473a-9f1a-08f0d5c1a8f8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:19.600124 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d46c5-abd8-473a-9f1a-08f0d5c1a8f8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:19.600558 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d46c5-abd8-473a-9f1a-08f0d5c1a8f8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:19.601237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d46c5-abd8-473a-9f1a-08f0d5c1a8f8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:19.601712 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d46c5-abd8-473a-9f1a-08f0d5c1a8f8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:19.602133 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d46c5-abd8-473a-9f1a-08f0d5c1a8f8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:19.736501 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2f3d46c5-abd8-473a-9f1a-08f0d5c1a8f8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:19.745165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2f3d46c5-abd8-473a-9f1a-08f0d5c1a8f8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1318 microversion: 2.1 time: 0.157062 Oct 28 20:39:19.745837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1618/3258] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:19 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:19.943340 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c1c7fa53-77fe-46c7-a081-224a12e488c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:19.944726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c1c7fa53-77fe-46c7-a081-224a12e488c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:19.953249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c7fa53-77fe-46c7-a081-224a12e488c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:19.954242 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c7fa53-77fe-46c7-a081-224a12e488c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:19.954776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c7fa53-77fe-46c7-a081-224a12e488c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:19.955502 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c7fa53-77fe-46c7-a081-224a12e488c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:19.955961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c7fa53-77fe-46c7-a081-224a12e488c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:19.956393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c7fa53-77fe-46c7-a081-224a12e488c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:20.025680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c1c7fa53-77fe-46c7-a081-224a12e488c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:20.034211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c1c7fa53-77fe-46c7-a081-224a12e488c0 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1615 microversion: 2.1 time: 0.098891 Oct 28 20:39:20.034869 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1641/3259] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:19 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1615 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:20.768562 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6cb7d3d6-b342-4699-acc7-2453021b88f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:20.769179 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6cb7d3d6-b342-4699-acc7-2453021b88f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:20.776259 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cb7d3d6-b342-4699-acc7-2453021b88f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:20.776747 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cb7d3d6-b342-4699-acc7-2453021b88f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:20.777189 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cb7d3d6-b342-4699-acc7-2453021b88f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:20.777915 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cb7d3d6-b342-4699-acc7-2453021b88f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:20.778376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cb7d3d6-b342-4699-acc7-2453021b88f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:20.778803 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cb7d3d6-b342-4699-acc7-2453021b88f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:20.905665 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6cb7d3d6-b342-4699-acc7-2453021b88f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:20.914020 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6cb7d3d6-b342-4699-acc7-2453021b88f0 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1318 microversion: 2.1 time: 0.149395 Oct 28 20:39:20.914590 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1619/3260] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:20 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:21.059621 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c3569925-81cd-47de-bbd5-dca556fac964 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:21.060235 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c3569925-81cd-47de-bbd5-dca556fac964 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:21.067235 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3569925-81cd-47de-bbd5-dca556fac964 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:21.067767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3569925-81cd-47de-bbd5-dca556fac964 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:21.068269 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3569925-81cd-47de-bbd5-dca556fac964 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:21.069236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3569925-81cd-47de-bbd5-dca556fac964 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:21.069944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3569925-81cd-47de-bbd5-dca556fac964 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:21.070547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3569925-81cd-47de-bbd5-dca556fac964 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:21.134470 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c3569925-81cd-47de-bbd5-dca556fac964 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:21.142089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c3569925-81cd-47de-bbd5-dca556fac964 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1615 microversion: 2.1 time: 0.086384 Oct 28 20:39:21.142650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1642/3261] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:21 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1615 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:21.937455 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-469ef443-fc96-469a-ad60-d8ceb1e73c14 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:21.938060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-469ef443-fc96-469a-ad60-d8ceb1e73c14 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:21.946419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469ef443-fc96-469a-ad60-d8ceb1e73c14 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:21.946918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469ef443-fc96-469a-ad60-d8ceb1e73c14 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:21.947357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469ef443-fc96-469a-ad60-d8ceb1e73c14 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:21.948056 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469ef443-fc96-469a-ad60-d8ceb1e73c14 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:21.948517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469ef443-fc96-469a-ad60-d8ceb1e73c14 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:21.949002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469ef443-fc96-469a-ad60-d8ceb1e73c14 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:22.088502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-469ef443-fc96-469a-ad60-d8ceb1e73c14 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:22.096266 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-469ef443-fc96-469a-ad60-d8ceb1e73c14 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1318 microversion: 2.1 time: 0.162782 Oct 28 20:39:22.096836 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1620/3262] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:21 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:22.165190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2f6ff53c-99dd-48ab-9e0a-66ae54551ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:22.165961 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2f6ff53c-99dd-48ab-9e0a-66ae54551ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:22.175771 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f6ff53c-99dd-48ab-9e0a-66ae54551ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:22.177061 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f6ff53c-99dd-48ab-9e0a-66ae54551ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:22.177650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f6ff53c-99dd-48ab-9e0a-66ae54551ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:22.179844 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f6ff53c-99dd-48ab-9e0a-66ae54551ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:22.180512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f6ff53c-99dd-48ab-9e0a-66ae54551ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:22.181046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f6ff53c-99dd-48ab-9e0a-66ae54551ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:22.227643 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f6ff53c-99dd-48ab-9e0a-66ae54551ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:22.236944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f6ff53c-99dd-48ab-9e0a-66ae54551ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:22.236944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f6ff53c-99dd-48ab-9e0a-66ae54551ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:22.236944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-2f6ff53c-99dd-48ab-9e0a-66ae54551ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lazy-loading 'fault' on Instance uuid 8b7c7944-da30-4c0c-9837-956bac2ea772 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:39:22.272558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2f6ff53c-99dd-48ab-9e0a-66ae54551ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724baaa4aa834e609fe4f513f9fc0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940ce72c42534c5196dfb909cc2a8d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:22.280587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2f6ff53c-99dd-48ab-9e0a-66ae54551ba7 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 200 len: 1331 microversion: 2.1 time: 0.119476 Oct 28 20:39:22.281169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1643/3263] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:22 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 1331 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:23.119380 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ced4df5b-ee30-41c2-9178-69e3f8d147ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:23.120165 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ced4df5b-ee30-41c2-9178-69e3f8d147ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:23.126671 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ced4df5b-ee30-41c2-9178-69e3f8d147ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:23.127151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ced4df5b-ee30-41c2-9178-69e3f8d147ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:23.127590 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ced4df5b-ee30-41c2-9178-69e3f8d147ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:23.128281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ced4df5b-ee30-41c2-9178-69e3f8d147ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:23.128737 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ced4df5b-ee30-41c2-9178-69e3f8d147ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:23.129755 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ced4df5b-ee30-41c2-9178-69e3f8d147ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:23.259743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ced4df5b-ee30-41c2-9178-69e3f8d147ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:23.267457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ced4df5b-ee30-41c2-9178-69e3f8d147ec tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1506 microversion: 2.1 time: 0.152156 Oct 28 20:39:23.268022 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1621/3264] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:23 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:23.291650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6e05d689-1342-45a4-9c05-762b7547b296 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d42345c-c59f-4039-9d3e-40fb77ce1401", "device": "/dev/sdb"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:39:23.293982 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6e05d689-1342-45a4-9c05-762b7547b296 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:23.300403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e05d689-1342-45a4-9c05-762b7547b296 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:23.301132 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e05d689-1342-45a4-9c05-762b7547b296 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:23.301597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e05d689-1342-45a4-9c05-762b7547b296 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:23.302289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e05d689-1342-45a4-9c05-762b7547b296 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:23.302822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e05d689-1342-45a4-9c05-762b7547b296 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:23.303252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e05d689-1342-45a4-9c05-762b7547b296 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:23.304010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01442546-86f8-45d6-acee-4e752e7cdfbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:23.304647 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-01442546-86f8-45d6-acee-4e752e7cdfbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:23.310692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01442546-86f8-45d6-acee-4e752e7cdfbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:23.311176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01442546-86f8-45d6-acee-4e752e7cdfbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:23.313536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01442546-86f8-45d6-acee-4e752e7cdfbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:23.313536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01442546-86f8-45d6-acee-4e752e7cdfbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:23.313536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01442546-86f8-45d6-acee-4e752e7cdfbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:23.313536 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01442546-86f8-45d6-acee-4e752e7cdfbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:23.322446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:23.326963 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-01442546-86f8-45d6-acee-4e752e7cdfbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] HTTP exception thrown: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01442546-86f8-45d6-acee-4e752e7cdfbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Request method failure captured: Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 HTTP/1.1 Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDYMvyQboftNRryWd3Rs40sLFlwhGaFtwYfaIeJnxRaNivrbjxkcoU7hik0GmB2LCAF23QhzK0jde7TY6jjLMWtp3be2qb3ioW4B_DmUzK25G3ialtqsuYDsquFjDhl4JMbgP7SnsYrOor-VBrDZUeFYQ9rlIGxqZsR02x8jWolIc1k Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:39:23.328609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:39:23.330117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_940ce72c42534c5196dfb909cc2a8d54", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:39:23.330117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:23.330117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:39:23.330117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:23.330117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:39:23.330117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:39:23.330117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:39:23.330117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: 724baaa4aa834e609fe4f513f9fc0b4b Oct 28 20:39:23.330117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:39:23.330117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:39:23.330117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. Oct 28 20:39:23.330117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': '8b7c7944-da30-4c0c-9837-956bac2ea772'} Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:39:23.331065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. Oct 28 20:39:23.332731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:23.333982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01442546-86f8-45d6-acee-4e752e7cdfbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Returning 404 to user: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:39:23.333982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-01442546-86f8-45d6-acee-4e752e7cdfbe tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 404 len: 111 microversion: 2.1 time: 0.030054 Oct 28 20:39:23.333982 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1622/3265] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:23 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:39:23.339749 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dbbdcf43-c419-451f-923b-57a1165a491d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '.version_select at 0x7f1f4d121e50>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:23.456360 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dbbdcf43-c419-451f-923b-57a1165a491d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132515341" status: 202 len: 0 microversion: 2.1 time: 0.120230 Oct 28 20:39:23.457169 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1623/3266] 10.222.0.66 () {58 vars in 1221 bytes} [Fri Oct 28 20:39:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132515341 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:39:24.402577 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6e05d689-1342-45a4-9c05-762b7547b296 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "POST /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.114672 Oct 28 20:39:24.403141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1644/3267] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Oct 28 20:39:23 2022] POST /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69/os-volume_attachments => generated 194 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:39:28.756877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ff136718-cc7b-4771-a03f-10b8d3f34f9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:28.757554 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ff136718-cc7b-4771-a03f-10b8d3f34f9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:28.763725 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff136718-cc7b-4771-a03f-10b8d3f34f9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:28.765381 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff136718-cc7b-4771-a03f-10b8d3f34f9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:28.765381 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff136718-cc7b-4771-a03f-10b8d3f34f9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:28.765381 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff136718-cc7b-4771-a03f-10b8d3f34f9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:28.765812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff136718-cc7b-4771-a03f-10b8d3f34f9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:28.766243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff136718-cc7b-4771-a03f-10b8d3f34f9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:28.780776 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-ff136718-cc7b-4771-a03f-10b8d3f34f9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] HTTP exception thrown: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ff136718-cc7b-4771-a03f-10b8d3f34f9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Request method failure captured: Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 HTTP/1.1 Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDYMvyQboftNRryWd3Rs40sLFlwhGaFtwYfaIeJnxRaNivrbjxkcoU7hik0GmB2LCAF23QhzK0jde7TY6jjLMWtp3be2qb3ioW4B_DmUzK25G3ialtqsuYDsquFjDhl4JMbgP7SnsYrOor-VBrDZUeFYQ9rlIGxqZsR02x8jWolIc1k Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:39:28.782374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:39:28.783746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_940ce72c42534c5196dfb909cc2a8d54", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:39:28.783746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:28.783746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:39:28.783746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:28.783746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:39:28.783746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:39:28.783746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:39:28.783746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: 724baaa4aa834e609fe4f513f9fc0b4b Oct 28 20:39:28.783746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:39:28.783746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:39:28.783746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. Oct 28 20:39:28.783746 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': '8b7c7944-da30-4c0c-9837-956bac2ea772'} Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:39:28.784542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. Oct 28 20:39:28.785885 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:28.787130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ff136718-cc7b-4771-a03f-10b8d3f34f9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Returning 404 to user: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:39:28.787130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ff136718-cc7b-4771-a03f-10b8d3f34f9e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 404 len: 111 microversion: 2.1 time: 0.031717 Oct 28 20:39:28.787130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1624/3268] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:39:28 2022] DELETE /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:39:28.794007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3dcfc1cf-bdd4-4ea0-894c-296f8dee5c1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:28.794705 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3dcfc1cf-bdd4-4ea0-894c-296f8dee5c1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 8b7c7944-da30-4c0c-9837-956bac2ea772] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:28.800849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dcfc1cf-bdd4-4ea0-894c-296f8dee5c1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:28.801352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dcfc1cf-bdd4-4ea0-894c-296f8dee5c1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:28.801793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dcfc1cf-bdd4-4ea0-894c-296f8dee5c1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:28.802475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dcfc1cf-bdd4-4ea0-894c-296f8dee5c1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:28.802927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dcfc1cf-bdd4-4ea0-894c-296f8dee5c1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:28.803399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dcfc1cf-bdd4-4ea0-894c-296f8dee5c1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:28.816623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-3dcfc1cf-bdd4-4ea0-894c-296f8dee5c1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] HTTP exception thrown: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3dcfc1cf-bdd4-4ea0-894c-296f8dee5c1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Request method failure captured: Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 HTTP/1.1 Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYMvyQboftNRryWd3Rs40sLFlwhGaFtwYfaIeJnxRaNivrbjxkcoU7hik0GmB2LCAF23QhzK0jde7TY6jjLMWtp3be2qb3ioW4B_DmUzK25G3ialtqsuYDsquFjDhl4JMbgP7SnsYrOor-VBrDZUeFYQ9rlIGxqZsR02x8jWolIc1k Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:39:28.818292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:39:28.824147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_940ce72c42534c5196dfb909cc2a8d54", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:39:28.824147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:28.824147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:39:28.824147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:28.824147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:39:28.824147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:39:28.824147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:39:28.824147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: 724baaa4aa834e609fe4f513f9fc0b4b Oct 28 20:39:28.824147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:39:28.824147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:39:28.824147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. Oct 28 20:39:28.824147 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': '8b7c7944-da30-4c0c-9837-956bac2ea772'} Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:39:28.824996 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. Oct 28 20:39:28.826418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:39:28.827598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3dcfc1cf-bdd4-4ea0-894c-296f8dee5c1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Returning 404 to user: Instance 8b7c7944-da30-4c0c-9837-956bac2ea772 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:39:28.827598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3dcfc1cf-bdd4-4ea0-894c-296f8dee5c1e tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772" status: 404 len: 111 microversion: 2.1 time: 0.030459 Oct 28 20:39:28.827598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1645/3269] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:28 2022] GET /compute/v2.1/servers/8b7c7944-da30-4c0c-9837-956bac2ea772 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:39:30.142338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6bf4c807-e801-427e-b2f4-8976025ffe4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:30.142848 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6bf4c807-e801-427e-b2f4-8976025ffe4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:30.145280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:30.150971 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bf4c807-e801-427e-b2f4-8976025ffe4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:30.151464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bf4c807-e801-427e-b2f4-8976025ffe4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:30.151908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bf4c807-e801-427e-b2f4-8976025ffe4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:30.152614 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bf4c807-e801-427e-b2f4-8976025ffe4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:30.153072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bf4c807-e801-427e-b2f4-8976025ffe4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:30.153638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bf4c807-e801-427e-b2f4-8976025ffe4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:30.168889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6bf4c807-e801-427e-b2f4-8976025ffe4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] HTTP exception thrown: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6bf4c807-e801-427e-b2f4-8976025ffe4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Request method failure captured: Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 HTTP/1.1 Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDYMvyQboftNRryWd3Rs40sLFlwhGaFtwYfaIeJnxRaNivrbjxkcoU7hik0GmB2LCAF23QhzK0jde7TY6jjLMWtp3be2qb3ioW4B_DmUzK25G3ialtqsuYDsquFjDhl4JMbgP7SnsYrOor-VBrDZUeFYQ9rlIGxqZsR02x8jWolIc1k Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:39:30.170618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:39:30.172096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_940ce72c42534c5196dfb909cc2a8d54", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:39:30.172096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:30.172096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:39:30.172096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:30.172096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:39:30.172096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:39:30.172096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:39:30.172096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: 724baaa4aa834e609fe4f513f9fc0b4b Oct 28 20:39:30.172096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:39:30.172096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:39:30.172096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. Oct 28 20:39:30.172096 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': '7fca705e-f209-4a12-8462-5cb6a76b8976'} Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:39:30.173018 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. Oct 28 20:39:30.174511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.176132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6bf4c807-e801-427e-b2f4-8976025ffe4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Returning 404 to user: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:39:30.176132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6bf4c807-e801-427e-b2f4-8976025ffe4d tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 404 len: 111 microversion: 2.1 time: 0.037774 Oct 28 20:39:30.181876 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e8c582d-84cd-43ad-a202-aeb811aceaa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:30.183178 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4e8c582d-84cd-43ad-a202-aeb811aceaa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 7fca705e-f209-4a12-8462-5cb6a76b8976] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:30.186799 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1625/3270] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:39:30 2022] DELETE /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:39:30.191537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8c582d-84cd-43ad-a202-aeb811aceaa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:30.192325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8c582d-84cd-43ad-a202-aeb811aceaa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:30.192970 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8c582d-84cd-43ad-a202-aeb811aceaa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:30.193865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8c582d-84cd-43ad-a202-aeb811aceaa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:30.195032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8c582d-84cd-43ad-a202-aeb811aceaa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:30.195629 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8c582d-84cd-43ad-a202-aeb811aceaa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:30.209537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-4e8c582d-84cd-43ad-a202-aeb811aceaa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] HTTP exception thrown: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e8c582d-84cd-43ad-a202-aeb811aceaa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Request method failure captured: Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 HTTP/1.1 Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYMvyQboftNRryWd3Rs40sLFlwhGaFtwYfaIeJnxRaNivrbjxkcoU7hik0GmB2LCAF23QhzK0jde7TY6jjLMWtp3be2qb3ioW4B_DmUzK25G3ialtqsuYDsquFjDhl4JMbgP7SnsYrOor-VBrDZUeFYQ9rlIGxqZsR02x8jWolIc1k Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:39:30.211362 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:39:30.215933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_940ce72c42534c5196dfb909cc2a8d54", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:39:30.215933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:30.215933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:39:30.215933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:30.215933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:39:30.215933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:39:30.215933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:39:30.215933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: 724baaa4aa834e609fe4f513f9fc0b4b Oct 28 20:39:30.215933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:39:30.215933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:39:30.215933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. Oct 28 20:39:30.215933 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': '7fca705e-f209-4a12-8462-5cb6a76b8976'} Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:39:30.216680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. Oct 28 20:39:30.217980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.219152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e8c582d-84cd-43ad-a202-aeb811aceaa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Returning 404 to user: Instance 7fca705e-f209-4a12-8462-5cb6a76b8976 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:39:30.219152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4e8c582d-84cd-43ad-a202-aeb811aceaa9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976" status: 404 len: 111 microversion: 2.1 time: 0.036118 Oct 28 20:39:30.219152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1646/3271] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:30 2022] GET /compute/v2.1/servers/7fca705e-f209-4a12-8462-5cb6a76b8976 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:39:30.222624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4cd74af4-2ed4-4059-a2e6-04a05504750b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:30.223175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4cd74af4-2ed4-4059-a2e6-04a05504750b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:30.229888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cd74af4-2ed4-4059-a2e6-04a05504750b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:30.230376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cd74af4-2ed4-4059-a2e6-04a05504750b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:30.230814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cd74af4-2ed4-4059-a2e6-04a05504750b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:30.231511 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cd74af4-2ed4-4059-a2e6-04a05504750b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:30.231970 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cd74af4-2ed4-4059-a2e6-04a05504750b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:30.232399 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cd74af4-2ed4-4059-a2e6-04a05504750b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:30.249937 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-4cd74af4-2ed4-4059-a2e6-04a05504750b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] HTTP exception thrown: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4cd74af4-2ed4-4059-a2e6-04a05504750b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Request method failure captured: Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 HTTP/1.1 Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDYMvyQboftNRryWd3Rs40sLFlwhGaFtwYfaIeJnxRaNivrbjxkcoU7hik0GmB2LCAF23QhzK0jde7TY6jjLMWtp3be2qb3ioW4B_DmUzK25G3ialtqsuYDsquFjDhl4JMbgP7SnsYrOor-VBrDZUeFYQ9rlIGxqZsR02x8jWolIc1k Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:39:30.251519 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:39:30.252921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_940ce72c42534c5196dfb909cc2a8d54", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:39:30.252921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:30.252921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:39:30.252921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:30.252921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:39:30.252921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:39:30.252921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:39:30.252921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: 724baaa4aa834e609fe4f513f9fc0b4b Oct 28 20:39:30.252921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:39:30.252921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:39:30.252921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. Oct 28 20:39:30.252921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': 'b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2'} Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:39:30.254264 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. Oct 28 20:39:30.255412 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.257400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4cd74af4-2ed4-4059-a2e6-04a05504750b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Returning 404 to user: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:39:30.257400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4cd74af4-2ed4-4059-a2e6-04a05504750b tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 404 len: 111 microversion: 2.1 time: 0.034902 Oct 28 20:39:30.257400 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1626/3272] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:39:30 2022] DELETE /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:39:30.262090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-16b078cc-8c66-41e4-9622-8f207fd034ab tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:30.262704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-16b078cc-8c66-41e4-9622-8f207fd034ab tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:30.269443 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16b078cc-8c66-41e4-9622-8f207fd034ab tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:30.269927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16b078cc-8c66-41e4-9622-8f207fd034ab tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:30.272898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16b078cc-8c66-41e4-9622-8f207fd034ab tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:30.272898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16b078cc-8c66-41e4-9622-8f207fd034ab tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:30.272898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16b078cc-8c66-41e4-9622-8f207fd034ab tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:30.272898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16b078cc-8c66-41e4-9622-8f207fd034ab tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:30.287331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-16b078cc-8c66-41e4-9622-8f207fd034ab tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] HTTP exception thrown: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-16b078cc-8c66-41e4-9622-8f207fd034ab tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Request method failure captured: Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 HTTP/1.1 Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYMvyQboftNRryWd3Rs40sLFlwhGaFtwYfaIeJnxRaNivrbjxkcoU7hik0GmB2LCAF23QhzK0jde7TY6jjLMWtp3be2qb3ioW4B_DmUzK25G3ialtqsuYDsquFjDhl4JMbgP7SnsYrOor-VBrDZUeFYQ9rlIGxqZsR02x8jWolIc1k Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:39:30.289585 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:39:30.290984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_940ce72c42534c5196dfb909cc2a8d54", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:39:30.290984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:30.290984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:39:30.290984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:39:30.290984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:39:30.290984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:39:30.290984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:39:30.290984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: 724baaa4aa834e609fe4f513f9fc0b4b Oct 28 20:39:30.290984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:39:30.290984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:39:30.290984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. Oct 28 20:39:30.290984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': 'b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2'} Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:39:30.292272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. Oct 28 20:39:30.293785 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:39:30.294925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-16b078cc-8c66-41e4-9622-8f207fd034ab tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Returning 404 to user: Instance b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:39:30.294925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-16b078cc-8c66-41e4-9622-8f207fd034ab tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2" status: 404 len: 111 microversion: 2.1 time: 0.032749 Oct 28 20:39:30.294925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1647/3273] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:30 2022] GET /compute/v2.1/servers/b38d4f9b-33f8-435c-bc5f-c29f40f2cbb2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:39:47.814940 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cad9cfe5-a8d6-42aa-bd37-eea9d50de63b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:47.815689 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cad9cfe5-a8d6-42aa-bd37-eea9d50de63b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:47.818225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=36 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:47.824317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cad9cfe5-a8d6-42aa-bd37-eea9d50de63b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:47.824875 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cad9cfe5-a8d6-42aa-bd37-eea9d50de63b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:47.825458 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cad9cfe5-a8d6-42aa-bd37-eea9d50de63b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:47.826160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cad9cfe5-a8d6-42aa-bd37-eea9d50de63b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:47.826613 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cad9cfe5-a8d6-42aa-bd37-eea9d50de63b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:47.827038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cad9cfe5-a8d6-42aa-bd37-eea9d50de63b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:47.967155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-cad9cfe5-a8d6-42aa-bd37-eea9d50de63b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lazy-loading 'services' on Instance uuid 05253d01-e40f-46b4-8f11-b102dae97e69 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:39:48.237379 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cad9cfe5-a8d6-42aa-bd37-eea9d50de63b tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "DELETE /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69/os-volume_attachments/4d42345c-c59f-4039-9d3e-40fb77ce1401" status: 202 len: 0 microversion: 2.1 time: 0.426433 Oct 28 20:39:48.238237 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1627/3274] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Oct 28 20:39:47 2022] DELETE /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69/os-volume_attachments/4d42345c-c59f-4039-9d3e-40fb77ce1401 => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:39:49.364012 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d24534a9-76d9-45a0-ae1c-56dd8a0af0e4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:49.364524 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d24534a9-76d9-45a0-ae1c-56dd8a0af0e4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:49.367105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=46 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:49.367764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:49.372782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d24534a9-76d9-45a0-ae1c-56dd8a0af0e4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:49.373266 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d24534a9-76d9-45a0-ae1c-56dd8a0af0e4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:49.373735 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d24534a9-76d9-45a0-ae1c-56dd8a0af0e4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:49.374427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d24534a9-76d9-45a0-ae1c-56dd8a0af0e4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:49.374884 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d24534a9-76d9-45a0-ae1c-56dd8a0af0e4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:49.375311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d24534a9-76d9-45a0-ae1c-56dd8a0af0e4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:49.401779 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d24534a9-76d9-45a0-ae1c-56dd8a0af0e4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:39:49.767333 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d24534a9-76d9-45a0-ae1c-56dd8a0af0e4 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "DELETE /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 204 len: 0 microversion: 2.1 time: 0.406907 Oct 28 20:39:49.767916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1648/3275] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:39:49 2022] DELETE /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:49.786330 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ebfac28b-2628-4078-80c6-f03d94959329 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:49.787044 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ebfac28b-2628-4078-80c6-f03d94959329 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:49.794136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebfac28b-2628-4078-80c6-f03d94959329 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:49.794634 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebfac28b-2628-4078-80c6-f03d94959329 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:49.796565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebfac28b-2628-4078-80c6-f03d94959329 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:49.796565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebfac28b-2628-4078-80c6-f03d94959329 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:49.796565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebfac28b-2628-4078-80c6-f03d94959329 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:49.796893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebfac28b-2628-4078-80c6-f03d94959329 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:49.979625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ebfac28b-2628-4078-80c6-f03d94959329 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:49.995273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ebfac28b-2628-4078-80c6-f03d94959329 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1512 microversion: 2.1 time: 0.213565 Oct 28 20:39:49.995870 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1628/3276] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:49 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:51.021950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85713bfc-13eb-4912-b81e-f530c4f7e5de tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:51.022793 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-85713bfc-13eb-4912-b81e-f530c4f7e5de tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:51.032490 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85713bfc-13eb-4912-b81e-f530c4f7e5de tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:51.033062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85713bfc-13eb-4912-b81e-f530c4f7e5de tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:51.033765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85713bfc-13eb-4912-b81e-f530c4f7e5de tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:51.035802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85713bfc-13eb-4912-b81e-f530c4f7e5de tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:51.036563 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85713bfc-13eb-4912-b81e-f530c4f7e5de tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:51.037397 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85713bfc-13eb-4912-b81e-f530c4f7e5de tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:51.219510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-85713bfc-13eb-4912-b81e-f530c4f7e5de tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:51.227568 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-85713bfc-13eb-4912-b81e-f530c4f7e5de tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1512 microversion: 2.1 time: 0.210267 Oct 28 20:39:51.228141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1649/3277] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:51 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1512 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:51.915505 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-cf74750c-acb8-419d-882f-c19f537fab2d req-dd281c85-2e22-4aa6-9cae-fa2d67973cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05253d01-e40f-46b4-8f11-b102dae97e69", "name": "network-vif-deleted", "tag": "7e683046-7446-4d00-9377-3e53c367a104"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:39:51.926504 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cf74750c-acb8-419d-882f-c19f537fab2d req-dd281c85-2e22-4aa6-9cae-fa2d67973cce service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:51.926999 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cf74750c-acb8-419d-882f-c19f537fab2d req-dd281c85-2e22-4aa6-9cae-fa2d67973cce service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:51.927440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cf74750c-acb8-419d-882f-c19f537fab2d req-dd281c85-2e22-4aa6-9cae-fa2d67973cce service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:51.939418 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-cf74750c-acb8-419d-882f-c19f537fab2d req-dd281c85-2e22-4aa6-9cae-fa2d67973cce service nova] Creating event network-vif-deleted:7e683046-7446-4d00-9377-3e53c367a104 for instance 05253d01-e40f-46b4-8f11-b102dae97e69 on hv-cinder-86236 Oct 28 20:39:51.944469 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-cf74750c-acb8-419d-882f-c19f537fab2d req-dd281c85-2e22-4aa6-9cae-fa2d67973cce service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032855 Oct 28 20:39:51.945710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1629/3278] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:39:52.250625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2c7ddca-4a45-416b-8c8d-2eadce4a56a8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:52.252001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2c7ddca-4a45-416b-8c8d-2eadce4a56a8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:52.260646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2c7ddca-4a45-416b-8c8d-2eadce4a56a8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:52.262223 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2c7ddca-4a45-416b-8c8d-2eadce4a56a8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:52.263000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2c7ddca-4a45-416b-8c8d-2eadce4a56a8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:52.263875 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2c7ddca-4a45-416b-8c8d-2eadce4a56a8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:52.264587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2c7ddca-4a45-416b-8c8d-2eadce4a56a8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:52.265164 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2c7ddca-4a45-416b-8c8d-2eadce4a56a8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:52.302767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2c7ddca-4a45-416b-8c8d-2eadce4a56a8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:52.303249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2c7ddca-4a45-416b-8c8d-2eadce4a56a8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:52.303868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2c7ddca-4a45-416b-8c8d-2eadce4a56a8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:52.304387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-a2c7ddca-4a45-416b-8c8d-2eadce4a56a8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lazy-loading 'fault' on Instance uuid 05253d01-e40f-46b4-8f11-b102dae97e69 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:39:52.347423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2c7ddca-4a45-416b-8c8d-2eadce4a56a8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14729da7649a4ab785ff87981968d342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f0f20404ba41d3aa380a9d10eeab81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:52.356436 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2c7ddca-4a45-416b-8c8d-2eadce4a56a8 tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 200 len: 1308 microversion: 2.1 time: 0.109658 Oct 28 20:39:52.357169 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1650/3279] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:52 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:53.381054 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a1064a32-4007-421d-892b-43596b07191a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:53.381791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a1064a32-4007-421d-892b-43596b07191a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] [instance: 05253d01-e40f-46b4-8f11-b102dae97e69] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:53.389209 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a1064a32-4007-421d-892b-43596b07191a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:53.389390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a1064a32-4007-421d-892b-43596b07191a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:53.389778 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a1064a32-4007-421d-892b-43596b07191a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:53.390454 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a1064a32-4007-421d-892b-43596b07191a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:53.390889 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a1064a32-4007-421d-892b-43596b07191a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:53.391317 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a1064a32-4007-421d-892b-43596b07191a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:53.406945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-a1064a32-4007-421d-892b-43596b07191a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] HTTP exception thrown: Instance 05253d01-e40f-46b4-8f11-b102dae97e69 could not be found. Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a1064a32-4007-421d-892b-43596b07191a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Request method failure captured: Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 HTTP/1.1 Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDZapm8oj0wUgkP6m1CVh0n-qSN-CP7NZYo3ZizagpKh6eW5F6KhFu_BCcKwu1UlPz47na49ZyLT4MjznwFXCk7znAUVPyoRNarCVvoXadDyZInOCPmefEZjGwMfvD_LF7NxGi5TExanL2DSafwSTayjWiqgIaYbWf1ftWDSNWWendM Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 62f0f20404ba41d3aa380a9d10eeab81 Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1435535380 Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:39:53.408801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:39:53.410373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/62f0f20404ba41d3aa380a9d10eeab81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/62f0f20404ba41d3aa380a9d10eeab81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/62f0f20404ba41d3aa380a9d10eeab81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_62f0f20404ba41d3aa380a9d10eeab81", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:39:53.410373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-VolumesSnapshotTestJSON-1435535380 Oct 28 20:39:53.410373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 62f0f20404ba41d3aa380a9d10eeab81 Oct 28 20:39:53.410373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1435535380 Oct 28 20:39:53.410373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-VolumesSnapshotTestJSON-1435535380-project Oct 28 20:39:53.410373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:39:53.410373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:39:53.410373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: 14729da7649a4ab785ff87981968d342 Oct 28 20:39:53.410373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-VolumesSnapshotTestJSON-1435535380-project Oct 28 20:39:53.410373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:39:53.410373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Instance 05253d01-e40f-46b4-8f11-b102dae97e69 could not be found. Oct 28 20:39:53.410373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': '05253d01-e40f-46b4-8f11-b102dae97e69'} Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05253d01-e40f-46b4-8f11-b102dae97e69 could not be found. Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:39:53.415106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05253d01-e40f-46b4-8f11-b102dae97e69 could not be found. Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05253d01-e40f-46b4-8f11-b102dae97e69 could not be found. Oct 28 20:39:53.416620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:39:53.417797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a1064a32-4007-421d-892b-43596b07191a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] Returning 404 to user: Instance 05253d01-e40f-46b4-8f11-b102dae97e69 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:39:53.417797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a1064a32-4007-421d-892b-43596b07191a tempest-VolumesSnapshotTestJSON-1435535380 tempest-VolumesSnapshotTestJSON-1435535380-project] 10.222.0.66 "GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69" status: 404 len: 111 microversion: 2.1 time: 0.033978 Oct 28 20:39:53.417797 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1630/3280] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:53 2022] GET /compute/v2.1/servers/05253d01-e40f-46b4-8f11-b102dae97e69 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:40:19.016253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1326814041", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452", "networks": [{"uuid": "31980f3b-0a02-40ab-a9c8-4a8698e26fb9"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:40:19.025680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:40:19.026334 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:40:19.072162 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] validate_networks() for [('31980f3b-0a02-40ab-a9c8-4a8698e26fb9', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:40:19.571454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:40:19.571454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:40:19.571758 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:40:19.572213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:40:19.572748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:40:19.583542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:19.593207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:19.593207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:19.593207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:19.593207 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:19.593907 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:19.605259 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Getting quotas for project 40b9acd32a1f4bbcb3bf71ac93bae1f5. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:40:19.609987 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Getting quotas for user fef6a70cbb564a55917ae1d9ae2f71e1 and project 40b9acd32a1f4bbcb3bf71ac93bae1f5. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:40:19.623064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:40:19.633709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:40:19.768283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [a6c6203f-d0f7-40a4-a08a-1f004f6679f9] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:40:20.777021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [a6c6203f-d0f7-40a4-a08a-1f004f6679f9] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 59738. Oct 28 20:40:20.780720 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-68aabbb0-66b8-4d38-a423-0cc28b875b2e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.768973 Oct 28 20:40:20.784962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1651/3281] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:40:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:40:20.797806 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-61279f4a-6daf-4013-88fd-7b67cd6d9b9f tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:20.798424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-61279f4a-6daf-4013-88fd-7b67cd6d9b9f tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:20.800952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=11 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:40:20.801739 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:40:20.855744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-61279f4a-6daf-4013-88fd-7b67cd6d9b9f tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:20.864190 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-61279f4a-6daf-4013-88fd-7b67cd6d9b9f tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1214 microversion: 2.1 time: 0.070597 Oct 28 20:40:20.864754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1631/3282] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:20 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:40:21.887073 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed076db0-339d-42fa-a5a3-a85234a29b90 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:21.887618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ed076db0-339d-42fa-a5a3-a85234a29b90 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:21.940127 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ed076db0-339d-42fa-a5a3-a85234a29b90 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:21.947065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ed076db0-339d-42fa-a5a3-a85234a29b90 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1214 microversion: 2.1 time: 0.064547 Oct 28 20:40:21.947688 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1652/3283] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:21 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:40:22.970914 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b79f728-5139-4086-9112-fafecc44dbec tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:22.971549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7b79f728-5139-4086-9112-fafecc44dbec tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:22.979464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b79f728-5139-4086-9112-fafecc44dbec tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:22.979945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b79f728-5139-4086-9112-fafecc44dbec tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:22.980366 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b79f728-5139-4086-9112-fafecc44dbec tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:22.981041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b79f728-5139-4086-9112-fafecc44dbec tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:22.981521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b79f728-5139-4086-9112-fafecc44dbec tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:22.981941 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b79f728-5139-4086-9112-fafecc44dbec tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:23.046642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b79f728-5139-4086-9112-fafecc44dbec tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:23.054281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7b79f728-5139-4086-9112-fafecc44dbec tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1266 microversion: 2.1 time: 0.087856 Oct 28 20:40:23.054829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1632/3284] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:22 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:24.082552 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ea9a3c7d-ed7c-434d-b398-60ee544ca2aa tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:24.083195 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ea9a3c7d-ed7c-434d-b398-60ee544ca2aa tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:24.089727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea9a3c7d-ed7c-434d-b398-60ee544ca2aa tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:24.090249 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea9a3c7d-ed7c-434d-b398-60ee544ca2aa tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:24.090648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea9a3c7d-ed7c-434d-b398-60ee544ca2aa tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:24.091335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea9a3c7d-ed7c-434d-b398-60ee544ca2aa tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:24.091789 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea9a3c7d-ed7c-434d-b398-60ee544ca2aa tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:24.092213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea9a3c7d-ed7c-434d-b398-60ee544ca2aa tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:24.293165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ea9a3c7d-ed7c-434d-b398-60ee544ca2aa tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:24.300323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ea9a3c7d-ed7c-434d-b398-60ee544ca2aa tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1314 microversion: 2.1 time: 0.221768 Oct 28 20:40:24.300900 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1653/3285] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:24 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:40:25.171459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-dd262752-5988-4bb1-9dce-bfe45968162e req-517f4856-5341-4543-9d4b-56a9b9501776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "739ece31-49da-46bd-997f-b80ae719d864", "tag": "709f198c-5636-4c9a-8b81-2f74c7e2bbc7"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:40:25.180664 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dd262752-5988-4bb1-9dce-bfe45968162e req-517f4856-5341-4543-9d4b-56a9b9501776 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:25.181138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dd262752-5988-4bb1-9dce-bfe45968162e req-517f4856-5341-4543-9d4b-56a9b9501776 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:25.181590 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dd262752-5988-4bb1-9dce-bfe45968162e req-517f4856-5341-4543-9d4b-56a9b9501776 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:25.195692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-dd262752-5988-4bb1-9dce-bfe45968162e req-517f4856-5341-4543-9d4b-56a9b9501776 service nova] Creating event network-changed:709f198c-5636-4c9a-8b81-2f74c7e2bbc7 for instance 739ece31-49da-46bd-997f-b80ae719d864 on hv-cinder-86236 Oct 28 20:40:25.200895 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-dd262752-5988-4bb1-9dce-bfe45968162e req-517f4856-5341-4543-9d4b-56a9b9501776 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167462 Oct 28 20:40:25.201462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1633/3286] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:40:25.323829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1b8fcbca-9281-429e-8d9a-027ef751e1cd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:25.324573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1b8fcbca-9281-429e-8d9a-027ef751e1cd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:25.331217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8fcbca-9281-429e-8d9a-027ef751e1cd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:25.331766 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8fcbca-9281-429e-8d9a-027ef751e1cd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:25.336309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8fcbca-9281-429e-8d9a-027ef751e1cd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:25.336309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8fcbca-9281-429e-8d9a-027ef751e1cd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:25.336309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8fcbca-9281-429e-8d9a-027ef751e1cd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:25.336309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8fcbca-9281-429e-8d9a-027ef751e1cd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:25.818548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1b8fcbca-9281-429e-8d9a-027ef751e1cd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:25.819070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1b8fcbca-9281-429e-8d9a-027ef751e1cd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1314 microversion: 2.1 time: 0.499177 Oct 28 20:40:25.832258 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1654/3287] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:25 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:26.845939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-33b37a6d-dcd3-4d75-86e3-4cd890ab4bc6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:26.846641 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-33b37a6d-dcd3-4d75-86e3-4cd890ab4bc6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:26.852714 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b37a6d-dcd3-4d75-86e3-4cd890ab4bc6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:26.853201 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b37a6d-dcd3-4d75-86e3-4cd890ab4bc6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:26.853681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b37a6d-dcd3-4d75-86e3-4cd890ab4bc6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:26.854368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b37a6d-dcd3-4d75-86e3-4cd890ab4bc6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:26.854989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b37a6d-dcd3-4d75-86e3-4cd890ab4bc6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:26.855419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b37a6d-dcd3-4d75-86e3-4cd890ab4bc6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:27.074800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-33b37a6d-dcd3-4d75-86e3-4cd890ab4bc6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:27.088791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-33b37a6d-dcd3-4d75-86e3-4cd890ab4bc6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1314 microversion: 2.1 time: 0.248528 Oct 28 20:40:27.090045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1634/3288] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:26 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:28.112626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b80f33c-48c3-4da2-84e7-437aa5569591 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:28.113283 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0b80f33c-48c3-4da2-84e7-437aa5569591 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:28.121537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b80f33c-48c3-4da2-84e7-437aa5569591 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:28.122205 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b80f33c-48c3-4da2-84e7-437aa5569591 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:28.122795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b80f33c-48c3-4da2-84e7-437aa5569591 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:28.123487 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b80f33c-48c3-4da2-84e7-437aa5569591 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:28.124603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b80f33c-48c3-4da2-84e7-437aa5569591 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:28.125657 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b80f33c-48c3-4da2-84e7-437aa5569591 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:28.263899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0b80f33c-48c3-4da2-84e7-437aa5569591 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:28.272305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0b80f33c-48c3-4da2-84e7-437aa5569591 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1314 microversion: 2.1 time: 0.164251 Oct 28 20:40:28.273486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1655/3289] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:28 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:29.295548 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ffe304a2-7b66-4094-8ea2-f99a0163e648 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:29.296155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ffe304a2-7b66-4094-8ea2-f99a0163e648 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:29.303535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffe304a2-7b66-4094-8ea2-f99a0163e648 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:29.304021 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffe304a2-7b66-4094-8ea2-f99a0163e648 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:29.304465 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffe304a2-7b66-4094-8ea2-f99a0163e648 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:29.305150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffe304a2-7b66-4094-8ea2-f99a0163e648 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:29.305628 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffe304a2-7b66-4094-8ea2-f99a0163e648 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:29.306049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffe304a2-7b66-4094-8ea2-f99a0163e648 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:29.440893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ffe304a2-7b66-4094-8ea2-f99a0163e648 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:29.449419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ffe304a2-7b66-4094-8ea2-f99a0163e648 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1314 microversion: 2.1 time: 0.157641 Oct 28 20:40:29.449988 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1635/3290] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:29 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:30.472770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5d308f44-730c-4bb2-ad94-b874065267d7 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:30.473412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5d308f44-730c-4bb2-ad94-b874065267d7 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:30.475727 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:40:30.480448 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d308f44-730c-4bb2-ad94-b874065267d7 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:30.483404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d308f44-730c-4bb2-ad94-b874065267d7 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:30.483404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d308f44-730c-4bb2-ad94-b874065267d7 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:30.483404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d308f44-730c-4bb2-ad94-b874065267d7 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:30.483404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d308f44-730c-4bb2-ad94-b874065267d7 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:30.483748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d308f44-730c-4bb2-ad94-b874065267d7 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:30.613048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5d308f44-730c-4bb2-ad94-b874065267d7 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:30.620916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5d308f44-730c-4bb2-ad94-b874065267d7 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1314 microversion: 2.1 time: 0.152720 Oct 28 20:40:30.621692 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1656/3291] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:30 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:31.604879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:40:31.643590 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f001b932-8f00-46d1-84b7-ecdfca08e8e0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:31.644314 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f001b932-8f00-46d1-84b7-ecdfca08e8e0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:31.650554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f001b932-8f00-46d1-84b7-ecdfca08e8e0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:31.651032 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f001b932-8f00-46d1-84b7-ecdfca08e8e0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:31.651459 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f001b932-8f00-46d1-84b7-ecdfca08e8e0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:31.652311 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f001b932-8f00-46d1-84b7-ecdfca08e8e0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:31.652913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f001b932-8f00-46d1-84b7-ecdfca08e8e0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:31.653359 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f001b932-8f00-46d1-84b7-ecdfca08e8e0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:31.792403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f001b932-8f00-46d1-84b7-ecdfca08e8e0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:31.800635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f001b932-8f00-46d1-84b7-ecdfca08e8e0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1314 microversion: 2.1 time: 0.160882 Oct 28 20:40:31.801296 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1657/3292] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:31 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:31.816850 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7c7bc5fa-58f7-4c09-bde7-3ca3dcb464f8 req-1de0f924-de1b-48ee-9ec1-c6863d1afc40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739ece31-49da-46bd-997f-b80ae719d864", "name": "network-vif-plugged", "status": "completed", "tag": "709f198c-5636-4c9a-8b81-2f74c7e2bbc7"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:40:31.826223 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7c7bc5fa-58f7-4c09-bde7-3ca3dcb464f8 req-1de0f924-de1b-48ee-9ec1-c6863d1afc40 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:31.826699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7c7bc5fa-58f7-4c09-bde7-3ca3dcb464f8 req-1de0f924-de1b-48ee-9ec1-c6863d1afc40 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:31.827123 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7c7bc5fa-58f7-4c09-bde7-3ca3dcb464f8 req-1de0f924-de1b-48ee-9ec1-c6863d1afc40 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:31.838449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7c7bc5fa-58f7-4c09-bde7-3ca3dcb464f8 req-1de0f924-de1b-48ee-9ec1-c6863d1afc40 service nova] Creating event network-vif-plugged:709f198c-5636-4c9a-8b81-2f74c7e2bbc7 for instance 739ece31-49da-46bd-997f-b80ae719d864 on hv-cinder-86236 Oct 28 20:40:31.843405 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7c7bc5fa-58f7-4c09-bde7-3ca3dcb464f8 req-1de0f924-de1b-48ee-9ec1-c6863d1afc40 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243626 Oct 28 20:40:31.844642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1636/3293] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:40:32.827784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8db64ecb-ef62-411c-ae25-2277b02d0a5b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:32.828320 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8db64ecb-ef62-411c-ae25-2277b02d0a5b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:32.830282 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:40:32.835485 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8db64ecb-ef62-411c-ae25-2277b02d0a5b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:32.839369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8db64ecb-ef62-411c-ae25-2277b02d0a5b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:32.839369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8db64ecb-ef62-411c-ae25-2277b02d0a5b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:32.839369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8db64ecb-ef62-411c-ae25-2277b02d0a5b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:32.839369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8db64ecb-ef62-411c-ae25-2277b02d0a5b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:32.839751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8db64ecb-ef62-411c-ae25-2277b02d0a5b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:32.978344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8db64ecb-ef62-411c-ae25-2277b02d0a5b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:32.986158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8db64ecb-ef62-411c-ae25-2277b02d0a5b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1314 microversion: 2.1 time: 0.166032 Oct 28 20:40:32.986722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1658/3294] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:32 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:34.010847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2dc4a4af-99d8-482e-aeb4-8f1dce2a23f3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:34.017032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2dc4a4af-99d8-482e-aeb4-8f1dce2a23f3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:34.021566 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dc4a4af-99d8-482e-aeb4-8f1dce2a23f3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:34.022384 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dc4a4af-99d8-482e-aeb4-8f1dce2a23f3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:34.023027 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dc4a4af-99d8-482e-aeb4-8f1dce2a23f3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:34.023986 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dc4a4af-99d8-482e-aeb4-8f1dce2a23f3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:34.024529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dc4a4af-99d8-482e-aeb4-8f1dce2a23f3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:34.025130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dc4a4af-99d8-482e-aeb4-8f1dce2a23f3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:34.162974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2dc4a4af-99d8-482e-aeb4-8f1dce2a23f3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:34.170573 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2dc4a4af-99d8-482e-aeb4-8f1dce2a23f3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1498 microversion: 2.1 time: 0.164899 Oct 28 20:40:34.171134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1637/3295] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:34 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1498 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:35.019968 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3d2da49f-d321-4aaf-b5cc-228bffb31f12 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:35.020512 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3d2da49f-d321-4aaf-b5cc-228bffb31f12 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:35.027617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d2da49f-d321-4aaf-b5cc-228bffb31f12 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:35.033388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d2da49f-d321-4aaf-b5cc-228bffb31f12 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:35.033388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d2da49f-d321-4aaf-b5cc-228bffb31f12 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:35.033388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d2da49f-d321-4aaf-b5cc-228bffb31f12 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:35.033388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d2da49f-d321-4aaf-b5cc-228bffb31f12 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:35.034280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d2da49f-d321-4aaf-b5cc-228bffb31f12 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:35.055722 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3d2da49f-d321-4aaf-b5cc-228bffb31f12 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:40:35.310880 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3d2da49f-d321-4aaf-b5cc-228bffb31f12 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "DELETE /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 204 len: 0 microversion: 2.1 time: 0.298041 Oct 28 20:40:35.311498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1659/3296] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:40:35 2022] DELETE /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:40:35.320325 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-93ace3cc-9179-4eba-a510-aee7966e0be8 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:35.320943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-93ace3cc-9179-4eba-a510-aee7966e0be8 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:35.327673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93ace3cc-9179-4eba-a510-aee7966e0be8 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:35.328152 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93ace3cc-9179-4eba-a510-aee7966e0be8 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:35.328585 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93ace3cc-9179-4eba-a510-aee7966e0be8 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:35.329262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93ace3cc-9179-4eba-a510-aee7966e0be8 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:35.329738 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93ace3cc-9179-4eba-a510-aee7966e0be8 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:35.330157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93ace3cc-9179-4eba-a510-aee7966e0be8 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:35.464320 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-93ace3cc-9179-4eba-a510-aee7966e0be8 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:35.472097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-93ace3cc-9179-4eba-a510-aee7966e0be8 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1504 microversion: 2.1 time: 0.156192 Oct 28 20:40:35.473735 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1638/3297] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:35 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:36.495520 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9768dea7-4c67-4dde-8cac-1a900365a017 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:36.496208 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9768dea7-4c67-4dde-8cac-1a900365a017 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:36.502462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9768dea7-4c67-4dde-8cac-1a900365a017 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:36.502938 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9768dea7-4c67-4dde-8cac-1a900365a017 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:36.503366 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9768dea7-4c67-4dde-8cac-1a900365a017 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:36.504039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9768dea7-4c67-4dde-8cac-1a900365a017 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:36.504484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9768dea7-4c67-4dde-8cac-1a900365a017 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:36.505079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9768dea7-4c67-4dde-8cac-1a900365a017 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:36.635312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9768dea7-4c67-4dde-8cac-1a900365a017 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:36.642964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9768dea7-4c67-4dde-8cac-1a900365a017 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1504 microversion: 2.1 time: 0.151605 Oct 28 20:40:36.643522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1660/3298] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:36 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:37.196327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-568456db-a60e-4c40-835b-60d1c5e149f4 req-077aac86-66f8-4a8f-ad04-7baef406278e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739ece31-49da-46bd-997f-b80ae719d864", "name": "network-vif-deleted", "tag": "709f198c-5636-4c9a-8b81-2f74c7e2bbc7"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:40:37.206222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-568456db-a60e-4c40-835b-60d1c5e149f4 req-077aac86-66f8-4a8f-ad04-7baef406278e service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:37.206686 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-568456db-a60e-4c40-835b-60d1c5e149f4 req-077aac86-66f8-4a8f-ad04-7baef406278e service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:37.207115 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-568456db-a60e-4c40-835b-60d1c5e149f4 req-077aac86-66f8-4a8f-ad04-7baef406278e service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:37.218489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-568456db-a60e-4c40-835b-60d1c5e149f4 req-077aac86-66f8-4a8f-ad04-7baef406278e service nova] Creating event network-vif-deleted:709f198c-5636-4c9a-8b81-2f74c7e2bbc7 for instance 739ece31-49da-46bd-997f-b80ae719d864 on hv-cinder-86236 Oct 28 20:40:37.223398 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-568456db-a60e-4c40-835b-60d1c5e149f4 req-077aac86-66f8-4a8f-ad04-7baef406278e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030952 Oct 28 20:40:37.224704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1639/3299] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:40:37.667096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8cc7e967-0a5c-4035-915a-559f9b01f8b6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:37.667709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8cc7e967-0a5c-4035-915a-559f9b01f8b6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:37.674095 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cc7e967-0a5c-4035-915a-559f9b01f8b6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:37.674569 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cc7e967-0a5c-4035-915a-559f9b01f8b6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:37.675001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cc7e967-0a5c-4035-915a-559f9b01f8b6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:37.675670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cc7e967-0a5c-4035-915a-559f9b01f8b6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:37.676116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cc7e967-0a5c-4035-915a-559f9b01f8b6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:37.676532 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cc7e967-0a5c-4035-915a-559f9b01f8b6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:37.707115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cc7e967-0a5c-4035-915a-559f9b01f8b6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:37.707581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cc7e967-0a5c-4035-915a-559f9b01f8b6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:37.708675 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8cc7e967-0a5c-4035-915a-559f9b01f8b6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:37.709187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-8cc7e967-0a5c-4035-915a-559f9b01f8b6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lazy-loading 'fault' on Instance uuid 739ece31-49da-46bd-997f-b80ae719d864 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:40:37.749556 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8cc7e967-0a5c-4035-915a-559f9b01f8b6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:37.758361 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8cc7e967-0a5c-4035-915a-559f9b01f8b6 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1304 microversion: 2.1 time: 0.095275 Oct 28 20:40:37.758924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1661/3300] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:37 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:38.791417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bd2e0936-509d-4acf-b2b0-5d9eb525838e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:38.792222 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bd2e0936-509d-4acf-b2b0-5d9eb525838e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:38.798644 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd2e0936-509d-4acf-b2b0-5d9eb525838e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:38.799125 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd2e0936-509d-4acf-b2b0-5d9eb525838e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:38.799561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd2e0936-509d-4acf-b2b0-5d9eb525838e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:38.800249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd2e0936-509d-4acf-b2b0-5d9eb525838e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:38.800708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd2e0936-509d-4acf-b2b0-5d9eb525838e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:38.801134 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd2e0936-509d-4acf-b2b0-5d9eb525838e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:38.834750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd2e0936-509d-4acf-b2b0-5d9eb525838e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:38.835221 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd2e0936-509d-4acf-b2b0-5d9eb525838e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:38.835708 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd2e0936-509d-4acf-b2b0-5d9eb525838e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:38.836087 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-bd2e0936-509d-4acf-b2b0-5d9eb525838e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lazy-loading 'fault' on Instance uuid 739ece31-49da-46bd-997f-b80ae719d864 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:40:38.888143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bd2e0936-509d-4acf-b2b0-5d9eb525838e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:38.895892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bd2e0936-509d-4acf-b2b0-5d9eb525838e tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1304 microversion: 2.1 time: 0.109260 Oct 28 20:40:38.896522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1640/3301] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:38 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:39.918376 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58d24978-fb34-4bf3-a9c7-6f9133be23ab tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:39.918920 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-58d24978-fb34-4bf3-a9c7-6f9133be23ab tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:39.925571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58d24978-fb34-4bf3-a9c7-6f9133be23ab tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:39.926057 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58d24978-fb34-4bf3-a9c7-6f9133be23ab tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:39.926499 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58d24978-fb34-4bf3-a9c7-6f9133be23ab tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:39.927842 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58d24978-fb34-4bf3-a9c7-6f9133be23ab tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:39.928301 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58d24978-fb34-4bf3-a9c7-6f9133be23ab tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:39.928732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58d24978-fb34-4bf3-a9c7-6f9133be23ab tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:39.962976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58d24978-fb34-4bf3-a9c7-6f9133be23ab tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:39.963461 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58d24978-fb34-4bf3-a9c7-6f9133be23ab tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:39.963897 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58d24978-fb34-4bf3-a9c7-6f9133be23ab tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:39.964342 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-58d24978-fb34-4bf3-a9c7-6f9133be23ab tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lazy-loading 'fault' on Instance uuid 739ece31-49da-46bd-997f-b80ae719d864 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:40:40.007181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-58d24978-fb34-4bf3-a9c7-6f9133be23ab tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:40.014845 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-58d24978-fb34-4bf3-a9c7-6f9133be23ab tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 200 len: 1304 microversion: 2.1 time: 0.100413 Oct 28 20:40:40.015418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1662/3302] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:39 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:41.040450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b9dcf360-3c50-4d3d-abd0-655198d8f346 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:41.042388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b9dcf360-3c50-4d3d-abd0-655198d8f346 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 739ece31-49da-46bd-997f-b80ae719d864] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:41.048800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9dcf360-3c50-4d3d-abd0-655198d8f346 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:41.049348 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9dcf360-3c50-4d3d-abd0-655198d8f346 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:41.049841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9dcf360-3c50-4d3d-abd0-655198d8f346 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:41.050567 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9dcf360-3c50-4d3d-abd0-655198d8f346 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:41.051070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9dcf360-3c50-4d3d-abd0-655198d8f346 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:41.051530 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9dcf360-3c50-4d3d-abd0-655198d8f346 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:41.066500 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-b9dcf360-3c50-4d3d-abd0-655198d8f346 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] HTTP exception thrown: Instance 739ece31-49da-46bd-997f-b80ae719d864 could not be found. Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b9dcf360-3c50-4d3d-abd0-655198d8f346 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Request method failure captured: Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 HTTP/1.1 Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXD4xS4Dev-M3zKCke_FZC64CHMrMHzvH156vq5GxjG9ZRpQYQLYsKXO0wpniMoNMFWOko08pQSU-MXnhxL156_iGpyCM1aGKt_T-SuvQbH4LP1seQRZXm-d8Hn0y3wKfJC2_LV-V3SG6RXLM1CHfxxl6CyW6aLLN0jeXYNRRXdEkEiM Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 40b9acd32a1f4bbcb3bf71ac93bae1f5 Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesActionsTest-1858789419 Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:40:41.068417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:40:41.070078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/40b9acd32a1f4bbcb3bf71ac93bae1f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/40b9acd32a1f4bbcb3bf71ac93bae1f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/40b9acd32a1f4bbcb3bf71ac93bae1f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_40b9acd32a1f4bbcb3bf71ac93bae1f5", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:40:41.070078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-VolumesActionsTest-1858789419 Oct 28 20:40:41.070078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 40b9acd32a1f4bbcb3bf71ac93bae1f5 Oct 28 20:40:41.070078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesActionsTest-1858789419 Oct 28 20:40:41.070078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-VolumesActionsTest-1858789419-project Oct 28 20:40:41.070078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:40:41.070078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:40:41.070078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: fef6a70cbb564a55917ae1d9ae2f71e1 Oct 28 20:40:41.070078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-VolumesActionsTest-1858789419-project Oct 28 20:40:41.070078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:40:41.070078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Instance 739ece31-49da-46bd-997f-b80ae719d864 could not be found. Oct 28 20:40:41.070078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': '739ece31-49da-46bd-997f-b80ae719d864'} Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 739ece31-49da-46bd-997f-b80ae719d864 could not be found. Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:40:41.071293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 739ece31-49da-46bd-997f-b80ae719d864 could not be found. Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 739ece31-49da-46bd-997f-b80ae719d864 could not be found. Oct 28 20:40:41.073156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:40:41.075690 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b9dcf360-3c50-4d3d-abd0-655198d8f346 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Returning 404 to user: Instance 739ece31-49da-46bd-997f-b80ae719d864 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:40:41.075690 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b9dcf360-3c50-4d3d-abd0-655198d8f346 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864" status: 404 len: 111 microversion: 2.1 time: 0.035910 Oct 28 20:40:41.075690 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1641/3303] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:41 2022] GET /compute/v2.1/servers/739ece31-49da-46bd-997f-b80ae719d864 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:40:41.181981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1743414871", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452", "networks": [{"uuid": "31980f3b-0a02-40ab-a9c8-4a8698e26fb9"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:40:41.236121 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] validate_networks() for [('31980f3b-0a02-40ab-a9c8-4a8698e26fb9', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:40:41.590111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:40:41.590554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:40:41.591066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:40:41.591414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:40:41.591816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:40:41.600704 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:41.601175 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:41.601645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:41.602352 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:41.602797 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:41.603213 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:41.620537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Getting quotas for project 40b9acd32a1f4bbcb3bf71ac93bae1f5. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:40:41.624530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Getting quotas for user fef6a70cbb564a55917ae1d9ae2f71e1 and project 40b9acd32a1f4bbcb3bf71ac93bae1f5. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:40:41.636542 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:40:41.639671 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:40:41.811644 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8c29f500-a22d-4dfa-8a90-417bdb3e6444 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.633431 Oct 28 20:40:41.812353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1663/3304] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:40:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:40:41.824466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd134f56-9c43-4b8d-8a2e-85657993d446 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:41.825483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd134f56-9c43-4b8d-8a2e-85657993d446 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:41.891368 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-fd134f56-9c43-4b8d-8a2e-85657993d446 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:41.901228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd134f56-9c43-4b8d-8a2e-85657993d446 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e" status: 200 len: 1214 microversion: 2.1 time: 0.081576 Oct 28 20:40:41.904929 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1642/3305] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:41 2022] GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:42.925208 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bd349d9f-8de1-4bb8-8eaf-fee629654bb3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:42.925840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bd349d9f-8de1-4bb8-8eaf-fee629654bb3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:42.932280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd349d9f-8de1-4bb8-8eaf-fee629654bb3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:42.932874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd349d9f-8de1-4bb8-8eaf-fee629654bb3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:42.933396 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd349d9f-8de1-4bb8-8eaf-fee629654bb3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:42.934218 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd349d9f-8de1-4bb8-8eaf-fee629654bb3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:42.934672 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd349d9f-8de1-4bb8-8eaf-fee629654bb3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:42.935121 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd349d9f-8de1-4bb8-8eaf-fee629654bb3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:43.001787 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bd349d9f-8de1-4bb8-8eaf-fee629654bb3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:43.010601 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bd349d9f-8de1-4bb8-8eaf-fee629654bb3 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e" status: 200 len: 1218 microversion: 2.1 time: 0.089959 Oct 28 20:40:43.011163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1664/3306] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:42 2022] GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:44.035240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f7325883-1aa7-4a92-9958-16c276e2c48c tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:44.037657 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f7325883-1aa7-4a92-9958-16c276e2c48c tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:44.047592 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7325883-1aa7-4a92-9958-16c276e2c48c tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:44.048085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7325883-1aa7-4a92-9958-16c276e2c48c tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:44.048522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7325883-1aa7-4a92-9958-16c276e2c48c tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:44.049213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7325883-1aa7-4a92-9958-16c276e2c48c tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:44.056057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7325883-1aa7-4a92-9958-16c276e2c48c tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:44.056512 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7325883-1aa7-4a92-9958-16c276e2c48c tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:44.130485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f7325883-1aa7-4a92-9958-16c276e2c48c tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:44.139571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f7325883-1aa7-4a92-9958-16c276e2c48c tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e" status: 200 len: 1284 microversion: 2.1 time: 0.109066 Oct 28 20:40:44.140359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1643/3307] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:44 2022] GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e => generated 1284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:45.164648 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5a8f1511-9f49-4773-b6a1-6b73c2c59514 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:45.166859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5a8f1511-9f49-4773-b6a1-6b73c2c59514 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:45.173525 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a8f1511-9f49-4773-b6a1-6b73c2c59514 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:45.174255 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a8f1511-9f49-4773-b6a1-6b73c2c59514 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:45.174895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a8f1511-9f49-4773-b6a1-6b73c2c59514 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:45.175522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a8f1511-9f49-4773-b6a1-6b73c2c59514 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:45.175970 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a8f1511-9f49-4773-b6a1-6b73c2c59514 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:45.176449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a8f1511-9f49-4773-b6a1-6b73c2c59514 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:45.376111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-5a8f1511-9f49-4773-b6a1-6b73c2c59514 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:45.383887 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5a8f1511-9f49-4773-b6a1-6b73c2c59514 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e" status: 200 len: 1314 microversion: 2.1 time: 0.224097 Oct 28 20:40:45.384468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1665/3308] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:45 2022] GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:45.550923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-87fbdf88-204e-46ef-a9e2-0e5c9984aaa3 req-aead716a-a2a6-4717-b65c-750a6d2d000b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "525e6c6b-65b0-4690-b512-af46be389f3e", "tag": "e6cf3c75-8b18-40d7-bd20-64d2ee9cdb11"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:40:45.563308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-87fbdf88-204e-46ef-a9e2-0e5c9984aaa3 req-aead716a-a2a6-4717-b65c-750a6d2d000b service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:45.563864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-87fbdf88-204e-46ef-a9e2-0e5c9984aaa3 req-aead716a-a2a6-4717-b65c-750a6d2d000b service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:45.564304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-87fbdf88-204e-46ef-a9e2-0e5c9984aaa3 req-aead716a-a2a6-4717-b65c-750a6d2d000b service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:45.576055 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-87fbdf88-204e-46ef-a9e2-0e5c9984aaa3 req-aead716a-a2a6-4717-b65c-750a6d2d000b service nova] Creating event network-changed:e6cf3c75-8b18-40d7-bd20-64d2ee9cdb11 for instance 525e6c6b-65b0-4690-b512-af46be389f3e on hv-cinder-86236 Oct 28 20:40:45.581606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-87fbdf88-204e-46ef-a9e2-0e5c9984aaa3 req-aead716a-a2a6-4717-b65c-750a6d2d000b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035293 Oct 28 20:40:45.582506 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1644/3309] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:40:46.419564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1bc49909-8d8d-4091-8fb7-eb0401b6c451 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:46.420204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1bc49909-8d8d-4091-8fb7-eb0401b6c451 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:46.426102 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bc49909-8d8d-4091-8fb7-eb0401b6c451 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:46.427202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bc49909-8d8d-4091-8fb7-eb0401b6c451 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:46.427694 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bc49909-8d8d-4091-8fb7-eb0401b6c451 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:46.428413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bc49909-8d8d-4091-8fb7-eb0401b6c451 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:46.428829 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bc49909-8d8d-4091-8fb7-eb0401b6c451 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:46.429944 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bc49909-8d8d-4091-8fb7-eb0401b6c451 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:46.565879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1bc49909-8d8d-4091-8fb7-eb0401b6c451 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:46.574235 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1bc49909-8d8d-4091-8fb7-eb0401b6c451 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e" status: 200 len: 1314 microversion: 2.1 time: 0.158582 Oct 28 20:40:46.574736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1666/3310] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:46 2022] GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:47.598703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ba48f6ee-2e43-45cf-bfc7-cac0d23d6aee tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:47.599546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ba48f6ee-2e43-45cf-bfc7-cac0d23d6aee tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:47.605874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba48f6ee-2e43-45cf-bfc7-cac0d23d6aee tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:47.606357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba48f6ee-2e43-45cf-bfc7-cac0d23d6aee tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:47.606796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba48f6ee-2e43-45cf-bfc7-cac0d23d6aee tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:47.607476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba48f6ee-2e43-45cf-bfc7-cac0d23d6aee tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:47.607932 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba48f6ee-2e43-45cf-bfc7-cac0d23d6aee tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:47.608358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba48f6ee-2e43-45cf-bfc7-cac0d23d6aee tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:47.737849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ba48f6ee-2e43-45cf-bfc7-cac0d23d6aee tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:47.746406 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ba48f6ee-2e43-45cf-bfc7-cac0d23d6aee tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e" status: 200 len: 1314 microversion: 2.1 time: 0.152707 Oct 28 20:40:47.746974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1645/3311] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:47 2022] GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:48.770379 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a0ba20f-8661-4908-80f7-1a764f33fbbf tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:48.770942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2a0ba20f-8661-4908-80f7-1a764f33fbbf tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:48.777430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a0ba20f-8661-4908-80f7-1a764f33fbbf tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:48.777913 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a0ba20f-8661-4908-80f7-1a764f33fbbf tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:48.778347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a0ba20f-8661-4908-80f7-1a764f33fbbf tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:48.779035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a0ba20f-8661-4908-80f7-1a764f33fbbf tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:48.779526 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a0ba20f-8661-4908-80f7-1a764f33fbbf tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:48.779947 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a0ba20f-8661-4908-80f7-1a764f33fbbf tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:48.800233 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:40:49.173140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2a0ba20f-8661-4908-80f7-1a764f33fbbf tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:49.181370 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a0ba20f-8661-4908-80f7-1a764f33fbbf tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e" status: 200 len: 1314 microversion: 2.1 time: 0.414887 Oct 28 20:40:49.181929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1667/3312] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:48 2022] GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:50.203842 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-822f500b-8cc6-430c-b93a-f9fce47e7252 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:50.204498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-822f500b-8cc6-430c-b93a-f9fce47e7252 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:50.211594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-822f500b-8cc6-430c-b93a-f9fce47e7252 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:50.212084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-822f500b-8cc6-430c-b93a-f9fce47e7252 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:50.212526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-822f500b-8cc6-430c-b93a-f9fce47e7252 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:50.213212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-822f500b-8cc6-430c-b93a-f9fce47e7252 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:50.213699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-822f500b-8cc6-430c-b93a-f9fce47e7252 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:50.214130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-822f500b-8cc6-430c-b93a-f9fce47e7252 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:50.346304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-822f500b-8cc6-430c-b93a-f9fce47e7252 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:50.354355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-822f500b-8cc6-430c-b93a-f9fce47e7252 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e" status: 200 len: 1314 microversion: 2.1 time: 0.154293 Oct 28 20:40:50.354938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1646/3313] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:50 2022] GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:51.377584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-676891ef-a06b-4a83-b1b8-cecd60ee04cb tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:51.378281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-676891ef-a06b-4a83-b1b8-cecd60ee04cb tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:51.381344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:40:51.386273 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-676891ef-a06b-4a83-b1b8-cecd60ee04cb tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:51.386874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-676891ef-a06b-4a83-b1b8-cecd60ee04cb tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:51.387445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-676891ef-a06b-4a83-b1b8-cecd60ee04cb tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:51.388238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-676891ef-a06b-4a83-b1b8-cecd60ee04cb tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:51.388831 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-676891ef-a06b-4a83-b1b8-cecd60ee04cb tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:51.389342 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-676891ef-a06b-4a83-b1b8-cecd60ee04cb tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:51.528262 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-676891ef-a06b-4a83-b1b8-cecd60ee04cb tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:51.535983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-676891ef-a06b-4a83-b1b8-cecd60ee04cb tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e" status: 200 len: 1314 microversion: 2.1 time: 0.162304 Oct 28 20:40:51.536610 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1668/3314] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:51 2022] GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:51.688852 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1261183f-530d-45f1-841c-7e0571a17b05 req-c68a71d4-e5df-409a-88d2-2f8263850c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "525e6c6b-65b0-4690-b512-af46be389f3e", "name": "network-vif-plugged", "status": "completed", "tag": "e6cf3c75-8b18-40d7-bd20-64d2ee9cdb11"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:40:51.695039 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=39 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:40:51.700303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1261183f-530d-45f1-841c-7e0571a17b05 req-c68a71d4-e5df-409a-88d2-2f8263850c0f service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:51.700779 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1261183f-530d-45f1-841c-7e0571a17b05 req-c68a71d4-e5df-409a-88d2-2f8263850c0f service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:51.701212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1261183f-530d-45f1-841c-7e0571a17b05 req-c68a71d4-e5df-409a-88d2-2f8263850c0f service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:51.712269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1261183f-530d-45f1-841c-7e0571a17b05 req-c68a71d4-e5df-409a-88d2-2f8263850c0f service nova] Creating event network-vif-plugged:e6cf3c75-8b18-40d7-bd20-64d2ee9cdb11 for instance 525e6c6b-65b0-4690-b512-af46be389f3e on hv-cinder-86236 Oct 28 20:40:51.717291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-1261183f-530d-45f1-841c-7e0571a17b05 req-c68a71d4-e5df-409a-88d2-2f8263850c0f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032217 Oct 28 20:40:51.718091 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1647/3315] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:40:52.559144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-86bf5b6d-2232-40bc-8859-3ca5b67805fd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:52.559753 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-86bf5b6d-2232-40bc-8859-3ca5b67805fd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:52.561716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:40:52.562510 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:40:52.567506 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86bf5b6d-2232-40bc-8859-3ca5b67805fd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:52.568696 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86bf5b6d-2232-40bc-8859-3ca5b67805fd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:52.572630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86bf5b6d-2232-40bc-8859-3ca5b67805fd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:52.572630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86bf5b6d-2232-40bc-8859-3ca5b67805fd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:52.572630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86bf5b6d-2232-40bc-8859-3ca5b67805fd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:52.572630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86bf5b6d-2232-40bc-8859-3ca5b67805fd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:52.705859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-86bf5b6d-2232-40bc-8859-3ca5b67805fd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:52.714181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-86bf5b6d-2232-40bc-8859-3ca5b67805fd tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e" status: 200 len: 1314 microversion: 2.1 time: 0.158905 Oct 28 20:40:52.715384 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1669/3316] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:52 2022] GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:53.738949 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5727a5ea-4fe5-4077-8136-f6cd19b6ecf5 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:53.740472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5727a5ea-4fe5-4077-8136-f6cd19b6ecf5 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:53.742597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:40:53.752572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5727a5ea-4fe5-4077-8136-f6cd19b6ecf5 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:53.752572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5727a5ea-4fe5-4077-8136-f6cd19b6ecf5 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:53.752572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5727a5ea-4fe5-4077-8136-f6cd19b6ecf5 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:53.752572 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5727a5ea-4fe5-4077-8136-f6cd19b6ecf5 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:53.752969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5727a5ea-4fe5-4077-8136-f6cd19b6ecf5 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:53.752969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5727a5ea-4fe5-4077-8136-f6cd19b6ecf5 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:53.888250 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5727a5ea-4fe5-4077-8136-f6cd19b6ecf5 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:53.895845 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5727a5ea-4fe5-4077-8136-f6cd19b6ecf5 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e" status: 200 len: 1497 microversion: 2.1 time: 0.161517 Oct 28 20:40:53.896420 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1648/3317] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:53 2022] GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:54.683001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7ad3417f-3640-4375-9d0f-de26af0f6d1b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:54.685487 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7ad3417f-3640-4375-9d0f-de26af0f6d1b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:54.690117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ad3417f-3640-4375-9d0f-de26af0f6d1b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:54.690602 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ad3417f-3640-4375-9d0f-de26af0f6d1b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:54.691064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ad3417f-3640-4375-9d0f-de26af0f6d1b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:54.691751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ad3417f-3640-4375-9d0f-de26af0f6d1b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:54.692210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ad3417f-3640-4375-9d0f-de26af0f6d1b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:54.693187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ad3417f-3640-4375-9d0f-de26af0f6d1b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:54.722015 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7ad3417f-3640-4375-9d0f-de26af0f6d1b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:40:54.939555 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7ad3417f-3640-4375-9d0f-de26af0f6d1b tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "DELETE /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e" status: 204 len: 0 microversion: 2.1 time: 0.260055 Oct 28 20:40:54.940076 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1670/3318] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:40:54 2022] DELETE /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 20:40:54.948532 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7ac1f839-83ae-49b9-bbdd-8fdb6b4f3bc0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:54.949142 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7ac1f839-83ae-49b9-bbdd-8fdb6b4f3bc0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:54.955220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ac1f839-83ae-49b9-bbdd-8fdb6b4f3bc0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:54.955694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ac1f839-83ae-49b9-bbdd-8fdb6b4f3bc0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:54.956144 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ac1f839-83ae-49b9-bbdd-8fdb6b4f3bc0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:54.956796 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ac1f839-83ae-49b9-bbdd-8fdb6b4f3bc0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:54.957242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ac1f839-83ae-49b9-bbdd-8fdb6b4f3bc0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:54.957681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7ac1f839-83ae-49b9-bbdd-8fdb6b4f3bc0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:55.093568 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7ac1f839-83ae-49b9-bbdd-8fdb6b4f3bc0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:55.095728 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=79 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:40:55.102281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7ac1f839-83ae-49b9-bbdd-8fdb6b4f3bc0 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e" status: 200 len: 1503 microversion: 2.1 time: 0.157718 Oct 28 20:40:55.102830 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1649/3319] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:54 2022] GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:56.126751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-254d88df-3890-4ca7-bc69-6be3a017b579 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:56.127444 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-254d88df-3890-4ca7-bc69-6be3a017b579 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:56.134413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-254d88df-3890-4ca7-bc69-6be3a017b579 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:56.134895 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-254d88df-3890-4ca7-bc69-6be3a017b579 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:56.135329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-254d88df-3890-4ca7-bc69-6be3a017b579 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:56.136018 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-254d88df-3890-4ca7-bc69-6be3a017b579 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:56.136468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-254d88df-3890-4ca7-bc69-6be3a017b579 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:56.136892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-254d88df-3890-4ca7-bc69-6be3a017b579 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:56.270657 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-254d88df-3890-4ca7-bc69-6be3a017b579 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:56.278416 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-254d88df-3890-4ca7-bc69-6be3a017b579 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e" status: 200 len: 1503 microversion: 2.1 time: 0.155963 Oct 28 20:40:56.280123 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1671/3320] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:56 2022] GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:56.903760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-0d0c051f-0f34-47ad-b957-9e5521a91322 req-7b8d8a2f-3d4a-45ef-a6c5-cd0a64289113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "525e6c6b-65b0-4690-b512-af46be389f3e", "name": "network-vif-deleted", "tag": "e6cf3c75-8b18-40d7-bd20-64d2ee9cdb11"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:40:56.916441 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0d0c051f-0f34-47ad-b957-9e5521a91322 req-7b8d8a2f-3d4a-45ef-a6c5-cd0a64289113 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:56.916918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0d0c051f-0f34-47ad-b957-9e5521a91322 req-7b8d8a2f-3d4a-45ef-a6c5-cd0a64289113 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:56.917373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0d0c051f-0f34-47ad-b957-9e5521a91322 req-7b8d8a2f-3d4a-45ef-a6c5-cd0a64289113 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:56.928956 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0d0c051f-0f34-47ad-b957-9e5521a91322 req-7b8d8a2f-3d4a-45ef-a6c5-cd0a64289113 service nova] Creating event network-vif-deleted:e6cf3c75-8b18-40d7-bd20-64d2ee9cdb11 for instance 525e6c6b-65b0-4690-b512-af46be389f3e on hv-cinder-86236 Oct 28 20:40:56.933874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-0d0c051f-0f34-47ad-b957-9e5521a91322 req-7b8d8a2f-3d4a-45ef-a6c5-cd0a64289113 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033825 Oct 28 20:40:56.934522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1650/3321] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:40:57.301738 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-511d3105-6d42-4fde-8b5d-ee7b9017dc10 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:57.302399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-511d3105-6d42-4fde-8b5d-ee7b9017dc10 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:57.309090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-511d3105-6d42-4fde-8b5d-ee7b9017dc10 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:57.309622 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-511d3105-6d42-4fde-8b5d-ee7b9017dc10 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:57.310062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-511d3105-6d42-4fde-8b5d-ee7b9017dc10 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:57.310755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-511d3105-6d42-4fde-8b5d-ee7b9017dc10 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:57.311210 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-511d3105-6d42-4fde-8b5d-ee7b9017dc10 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:57.311634 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-511d3105-6d42-4fde-8b5d-ee7b9017dc10 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:57.343956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-511d3105-6d42-4fde-8b5d-ee7b9017dc10 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:57.344448 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-511d3105-6d42-4fde-8b5d-ee7b9017dc10 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:57.344883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-511d3105-6d42-4fde-8b5d-ee7b9017dc10 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:57.345348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-511d3105-6d42-4fde-8b5d-ee7b9017dc10 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lazy-loading 'fault' on Instance uuid 525e6c6b-65b0-4690-b512-af46be389f3e {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:40:57.386981 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-511d3105-6d42-4fde-8b5d-ee7b9017dc10 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef6a70cbb564a55917ae1d9ae2f71e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b9acd32a1f4bbcb3bf71ac93bae1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:40:57.394594 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-511d3105-6d42-4fde-8b5d-ee7b9017dc10 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e" status: 200 len: 1304 microversion: 2.1 time: 0.096722 Oct 28 20:40:57.395167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1672/3322] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:57 2022] GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:58.419450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f5d0db7-1293-44ed-b68d-720c2bca3725 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:40:58.420159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6f5d0db7-1293-44ed-b68d-720c2bca3725 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] [instance: 525e6c6b-65b0-4690-b512-af46be389f3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:40:58.426366 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f5d0db7-1293-44ed-b68d-720c2bca3725 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:58.426908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f5d0db7-1293-44ed-b68d-720c2bca3725 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:58.427440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f5d0db7-1293-44ed-b68d-720c2bca3725 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:58.428160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f5d0db7-1293-44ed-b68d-720c2bca3725 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:58.428618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f5d0db7-1293-44ed-b68d-720c2bca3725 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:58.429049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f5d0db7-1293-44ed-b68d-720c2bca3725 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:58.441996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6f5d0db7-1293-44ed-b68d-720c2bca3725 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] HTTP exception thrown: Instance 525e6c6b-65b0-4690-b512-af46be389f3e could not be found. Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f5d0db7-1293-44ed-b68d-720c2bca3725 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Request method failure captured: Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e HTTP/1.1 Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXD4xS4Dev-M3zKCke_FZC64CHMrMHzvH156vq5GxjG9ZRpQYQLYsKXO0wpniMoNMFWOko08pQSU-MXnhxL156_iGpyCM1aGKt_T-SuvQbH4LP1seQRZXm-d8Hn0y3wKfJC2_LV-V3SG6RXLM1CHfxxl6CyW6aLLN0jeXYNRRXdEkEiM Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 40b9acd32a1f4bbcb3bf71ac93bae1f5 Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesActionsTest-1858789419 Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:40:58.443926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:40:58.447332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/40b9acd32a1f4bbcb3bf71ac93bae1f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/40b9acd32a1f4bbcb3bf71ac93bae1f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/40b9acd32a1f4bbcb3bf71ac93bae1f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_40b9acd32a1f4bbcb3bf71ac93bae1f5", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:40:58.447332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-VolumesActionsTest-1858789419 Oct 28 20:40:58.447332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 40b9acd32a1f4bbcb3bf71ac93bae1f5 Oct 28 20:40:58.447332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesActionsTest-1858789419 Oct 28 20:40:58.447332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-VolumesActionsTest-1858789419-project Oct 28 20:40:58.447332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:40:58.447332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:40:58.447332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: fef6a70cbb564a55917ae1d9ae2f71e1 Oct 28 20:40:58.447332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-VolumesActionsTest-1858789419-project Oct 28 20:40:58.447332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:40:58.447332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Instance 525e6c6b-65b0-4690-b512-af46be389f3e could not be found. Oct 28 20:40:58.447332 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': '525e6c6b-65b0-4690-b512-af46be389f3e'} Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 525e6c6b-65b0-4690-b512-af46be389f3e could not be found. Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:40:58.448002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 525e6c6b-65b0-4690-b512-af46be389f3e could not be found. Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 525e6c6b-65b0-4690-b512-af46be389f3e could not be found. Oct 28 20:40:58.449060 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:40:58.450072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f5d0db7-1293-44ed-b68d-720c2bca3725 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] Returning 404 to user: Instance 525e6c6b-65b0-4690-b512-af46be389f3e could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:40:58.450072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6f5d0db7-1293-44ed-b68d-720c2bca3725 tempest-VolumesActionsTest-1858789419 tempest-VolumesActionsTest-1858789419-project] 10.222.0.66 "GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e" status: 404 len: 111 microversion: 2.1 time: 0.030506 Oct 28 20:40:58.450072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1651/3323] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:40:58 2022] GET /compute/v2.1/servers/525e6c6b-65b0-4690-b512-af46be389f3e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:41:25.467316 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2045329213", "imageRef": "914d5761-a3dd-435f-9282-9f8a5e21b72b", "flavorRef": "452"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:41:25.474553 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:41:25.475220 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:41:25.521508 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:41:25.799128 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:41:25.799575 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:41:25.800027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:41:25.800430 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:41:25.800838 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:41:25.811258 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:25.811774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:25.812219 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:25.812916 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:25.813387 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:25.813810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:25.831192 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Getting quotas for project 6d8416b8a3a7493b941261eb5297a798. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:41:25.835290 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Getting quotas for user 9835cd7baa6b412398797dcdd63db416 and project 6d8416b8a3a7493b941261eb5297a798. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:41:25.847088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:41:25.849417 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='914d5761-a3dd-435f-9282-9f8a5e21b72b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:41:25.958489 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-55fb39c8-9488-473d-893c-470a59c04b7a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495264 Oct 28 20:41:25.959375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1673/3324] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:41:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:41:25.970848 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c4f9e4a8-2ec8-45ee-a119-093f728f0bca tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:25.973801 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c4f9e4a8-2ec8-45ee-a119-093f728f0bca tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:25.975879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=9 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:41:25.976691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=5 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:41:26.031249 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-c4f9e4a8-2ec8-45ee-a119-093f728f0bca tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:26.038570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c4f9e4a8-2ec8-45ee-a119-093f728f0bca tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1215 microversion: 2.1 time: 0.071790 Oct 28 20:41:26.039294 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1652/3325] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:25 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:41:27.062105 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e0e206a7-9222-41eb-b84a-89c669609dbd tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:27.062765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e0e206a7-9222-41eb-b84a-89c669609dbd tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:27.070265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e206a7-9222-41eb-b84a-89c669609dbd tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:27.070760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e206a7-9222-41eb-b84a-89c669609dbd tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:27.071326 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e206a7-9222-41eb-b84a-89c669609dbd tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:27.072204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e206a7-9222-41eb-b84a-89c669609dbd tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:27.072664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e206a7-9222-41eb-b84a-89c669609dbd tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:27.073148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e206a7-9222-41eb-b84a-89c669609dbd tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:27.154070 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e0e206a7-9222-41eb-b84a-89c669609dbd tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:27.162079 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e0e206a7-9222-41eb-b84a-89c669609dbd tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1219 microversion: 2.1 time: 0.103840 Oct 28 20:41:27.165822 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1674/3326] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:27 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:41:28.187032 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-59e0cd6c-c351-4974-84ba-9ec0ad642587 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:28.188302 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-59e0cd6c-c351-4974-84ba-9ec0ad642587 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:28.197851 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59e0cd6c-c351-4974-84ba-9ec0ad642587 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:28.198318 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59e0cd6c-c351-4974-84ba-9ec0ad642587 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:28.198966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59e0cd6c-c351-4974-84ba-9ec0ad642587 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:28.199669 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59e0cd6c-c351-4974-84ba-9ec0ad642587 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:28.200283 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59e0cd6c-c351-4974-84ba-9ec0ad642587 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:28.200867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59e0cd6c-c351-4974-84ba-9ec0ad642587 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:28.285677 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-59e0cd6c-c351-4974-84ba-9ec0ad642587 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:28.296327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-59e0cd6c-c351-4974-84ba-9ec0ad642587 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1285 microversion: 2.1 time: 0.113477 Oct 28 20:41:28.296930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1653/3327] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:28 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:41:29.322115 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2f73d25b-e644-4758-8932-8e0ebdeeee0a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:29.322736 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2f73d25b-e644-4758-8932-8e0ebdeeee0a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:29.329069 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f73d25b-e644-4758-8932-8e0ebdeeee0a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:29.329587 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f73d25b-e644-4758-8932-8e0ebdeeee0a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:29.330051 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f73d25b-e644-4758-8932-8e0ebdeeee0a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:29.330827 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f73d25b-e644-4758-8932-8e0ebdeeee0a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:29.331281 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f73d25b-e644-4758-8932-8e0ebdeeee0a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:29.331706 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f73d25b-e644-4758-8932-8e0ebdeeee0a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:29.534212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2f73d25b-e644-4758-8932-8e0ebdeeee0a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:29.543796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2f73d25b-e644-4758-8932-8e0ebdeeee0a tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1315 microversion: 2.1 time: 0.226267 Oct 28 20:41:29.548518 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1675/3328] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:29 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:41:30.067016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-8610e5ee-e6aa-4b03-9bb2-8380ccf4ceec req-9889daf5-24fd-43b4-8b7e-61d3348fe2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6", "tag": "c4e77376-cdd4-4c64-800b-b1968abea45d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:41:30.077503 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8610e5ee-e6aa-4b03-9bb2-8380ccf4ceec req-9889daf5-24fd-43b4-8b7e-61d3348fe2b6 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:30.077988 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8610e5ee-e6aa-4b03-9bb2-8380ccf4ceec req-9889daf5-24fd-43b4-8b7e-61d3348fe2b6 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:30.078432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8610e5ee-e6aa-4b03-9bb2-8380ccf4ceec req-9889daf5-24fd-43b4-8b7e-61d3348fe2b6 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:30.089445 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-8610e5ee-e6aa-4b03-9bb2-8380ccf4ceec req-9889daf5-24fd-43b4-8b7e-61d3348fe2b6 service nova] Creating event network-changed:c4e77376-cdd4-4c64-800b-b1968abea45d for instance c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 on hv-cinder-86236 Oct 28 20:41:30.094591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-8610e5ee-e6aa-4b03-9bb2-8380ccf4ceec req-9889daf5-24fd-43b4-8b7e-61d3348fe2b6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031077 Oct 28 20:41:30.095183 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1654/3329] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:41:30.567685 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-66577f27-8de4-4eeb-a0ec-1d8fe283d114 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:30.568351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-66577f27-8de4-4eeb-a0ec-1d8fe283d114 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:30.575017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66577f27-8de4-4eeb-a0ec-1d8fe283d114 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:30.575749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66577f27-8de4-4eeb-a0ec-1d8fe283d114 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:30.576181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66577f27-8de4-4eeb-a0ec-1d8fe283d114 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:30.576960 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66577f27-8de4-4eeb-a0ec-1d8fe283d114 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:30.577467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66577f27-8de4-4eeb-a0ec-1d8fe283d114 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:30.577888 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66577f27-8de4-4eeb-a0ec-1d8fe283d114 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:30.783892 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-66577f27-8de4-4eeb-a0ec-1d8fe283d114 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:30.791810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-66577f27-8de4-4eeb-a0ec-1d8fe283d114 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1315 microversion: 2.1 time: 0.228198 Oct 28 20:41:30.792482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1676/3330] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:30 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:41:31.815130 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-97799069-9303-4e44-a272-5d7c70a601fc tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:31.815829 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-97799069-9303-4e44-a272-5d7c70a601fc tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:31.821864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97799069-9303-4e44-a272-5d7c70a601fc tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:31.822349 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97799069-9303-4e44-a272-5d7c70a601fc tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:31.822782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97799069-9303-4e44-a272-5d7c70a601fc tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:31.823494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97799069-9303-4e44-a272-5d7c70a601fc tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:31.823917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97799069-9303-4e44-a272-5d7c70a601fc tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:31.824343 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97799069-9303-4e44-a272-5d7c70a601fc tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:31.955432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-97799069-9303-4e44-a272-5d7c70a601fc tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:31.963620 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-97799069-9303-4e44-a272-5d7c70a601fc tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1315 microversion: 2.1 time: 0.153120 Oct 28 20:41:31.964192 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1655/3331] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:31 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:41:32.987238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cc20ba75-ed3e-4fe3-8f1d-71b9c184e041 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:32.987976 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cc20ba75-ed3e-4fe3-8f1d-71b9c184e041 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:32.994691 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc20ba75-ed3e-4fe3-8f1d-71b9c184e041 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:32.995173 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc20ba75-ed3e-4fe3-8f1d-71b9c184e041 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:32.995617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc20ba75-ed3e-4fe3-8f1d-71b9c184e041 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:32.996300 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc20ba75-ed3e-4fe3-8f1d-71b9c184e041 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:32.996751 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc20ba75-ed3e-4fe3-8f1d-71b9c184e041 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:32.997181 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cc20ba75-ed3e-4fe3-8f1d-71b9c184e041 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:33.124674 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-cc20ba75-ed3e-4fe3-8f1d-71b9c184e041 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:33.132226 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cc20ba75-ed3e-4fe3-8f1d-71b9c184e041 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1315 microversion: 2.1 time: 0.148854 Oct 28 20:41:33.140146 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1677/3332] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:32 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:41:34.161280 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-62030b4c-83ce-4651-a220-6e583477d6f5 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:34.161923 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-62030b4c-83ce-4651-a220-6e583477d6f5 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:34.168710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62030b4c-83ce-4651-a220-6e583477d6f5 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:34.169191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62030b4c-83ce-4651-a220-6e583477d6f5 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:34.169668 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62030b4c-83ce-4651-a220-6e583477d6f5 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:34.170352 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62030b4c-83ce-4651-a220-6e583477d6f5 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:34.170874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62030b4c-83ce-4651-a220-6e583477d6f5 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:34.171301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62030b4c-83ce-4651-a220-6e583477d6f5 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:34.301679 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-62030b4c-83ce-4651-a220-6e583477d6f5 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:34.310239 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-62030b4c-83ce-4651-a220-6e583477d6f5 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1315 microversion: 2.1 time: 0.152770 Oct 28 20:41:34.310804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1656/3333] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:34 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:41:35.333332 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8fe6b426-dabb-4a11-a2b4-c32590808492 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:35.333957 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8fe6b426-dabb-4a11-a2b4-c32590808492 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:35.341407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe6b426-dabb-4a11-a2b4-c32590808492 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:35.341889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe6b426-dabb-4a11-a2b4-c32590808492 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:35.342330 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe6b426-dabb-4a11-a2b4-c32590808492 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:35.343013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe6b426-dabb-4a11-a2b4-c32590808492 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:35.343467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe6b426-dabb-4a11-a2b4-c32590808492 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:35.343889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe6b426-dabb-4a11-a2b4-c32590808492 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:35.474429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8fe6b426-dabb-4a11-a2b4-c32590808492 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:35.477953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8fe6b426-dabb-4a11-a2b4-c32590808492 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1315 microversion: 2.1 time: 0.148492 Oct 28 20:41:35.478516 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1678/3334] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:35 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:41:36.501353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-44f40c8b-7e8d-429c-922b-2deca3961ee0 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:36.502570 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-44f40c8b-7e8d-429c-922b-2deca3961ee0 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:36.505042 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:41:36.509939 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44f40c8b-7e8d-429c-922b-2deca3961ee0 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:36.510558 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44f40c8b-7e8d-429c-922b-2deca3961ee0 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:36.510994 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44f40c8b-7e8d-429c-922b-2deca3961ee0 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:36.512083 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44f40c8b-7e8d-429c-922b-2deca3961ee0 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:36.512543 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44f40c8b-7e8d-429c-922b-2deca3961ee0 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:36.512968 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44f40c8b-7e8d-429c-922b-2deca3961ee0 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:36.642742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-44f40c8b-7e8d-429c-922b-2deca3961ee0 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:36.650413 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-44f40c8b-7e8d-429c-922b-2deca3961ee0 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1315 microversion: 2.1 time: 0.153334 Oct 28 20:41:36.651777 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1657/3335] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:36 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:41:37.674004 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eaf9dac0-1b4e-496c-819b-e8b6260369ff tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:37.674684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eaf9dac0-1b4e-496c-819b-e8b6260369ff tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:37.676554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:41:37.677240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:41:37.683451 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf9dac0-1b4e-496c-819b-e8b6260369ff tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:37.683938 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf9dac0-1b4e-496c-819b-e8b6260369ff tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:37.684380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf9dac0-1b4e-496c-819b-e8b6260369ff tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:37.685089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf9dac0-1b4e-496c-819b-e8b6260369ff tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:37.685840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf9dac0-1b4e-496c-819b-e8b6260369ff tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:37.687407 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaf9dac0-1b4e-496c-819b-e8b6260369ff tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:37.819306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-eaf9dac0-1b4e-496c-819b-e8b6260369ff tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:37.827398 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eaf9dac0-1b4e-496c-819b-e8b6260369ff tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1315 microversion: 2.1 time: 0.157414 Oct 28 20:41:37.828462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1679/3336] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:37 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:41:38.605831 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d9f5c85f-2613-4285-8ff0-d26ad632f81f req-5366674e-57d5-4e74-aa1a-f6dc689ae93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6", "name": "network-vif-plugged", "status": "completed", "tag": "c4e77376-cdd4-4c64-800b-b1968abea45d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:41:38.615365 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d9f5c85f-2613-4285-8ff0-d26ad632f81f req-5366674e-57d5-4e74-aa1a-f6dc689ae93c service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:38.616108 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d9f5c85f-2613-4285-8ff0-d26ad632f81f req-5366674e-57d5-4e74-aa1a-f6dc689ae93c service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:38.616542 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d9f5c85f-2613-4285-8ff0-d26ad632f81f req-5366674e-57d5-4e74-aa1a-f6dc689ae93c service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:38.629772 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d9f5c85f-2613-4285-8ff0-d26ad632f81f req-5366674e-57d5-4e74-aa1a-f6dc689ae93c service nova] Creating event network-vif-plugged:c4e77376-cdd4-4c64-800b-b1968abea45d for instance c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 on hv-cinder-86236 Oct 28 20:41:38.634768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d9f5c85f-2613-4285-8ff0-d26ad632f81f req-5366674e-57d5-4e74-aa1a-f6dc689ae93c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033709 Oct 28 20:41:38.636121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1658/3337] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:41:38.851266 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1d8b5f33-8d51-462b-8640-a239ae8d5000 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:38.851803 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1d8b5f33-8d51-462b-8640-a239ae8d5000 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:38.858905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d8b5f33-8d51-462b-8640-a239ae8d5000 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:38.859388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d8b5f33-8d51-462b-8640-a239ae8d5000 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:38.859828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d8b5f33-8d51-462b-8640-a239ae8d5000 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:38.860509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d8b5f33-8d51-462b-8640-a239ae8d5000 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:38.860962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d8b5f33-8d51-462b-8640-a239ae8d5000 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:38.861432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d8b5f33-8d51-462b-8640-a239ae8d5000 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:39.051747 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-1d8b5f33-8d51-462b-8640-a239ae8d5000 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:39.059642 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1d8b5f33-8d51-462b-8640-a239ae8d5000 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1315 microversion: 2.1 time: 0.212634 Oct 28 20:41:39.062655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1680/3338] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:38 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:41:40.083194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-26af3e53-bef8-4473-983c-4d1221618c82 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:40.083925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-26af3e53-bef8-4473-983c-4d1221618c82 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:40.090561 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26af3e53-bef8-4473-983c-4d1221618c82 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:40.091121 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26af3e53-bef8-4473-983c-4d1221618c82 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:40.091553 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26af3e53-bef8-4473-983c-4d1221618c82 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:40.092227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26af3e53-bef8-4473-983c-4d1221618c82 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:40.092675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26af3e53-bef8-4473-983c-4d1221618c82 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:40.093093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26af3e53-bef8-4473-983c-4d1221618c82 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:40.242420 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-26af3e53-bef8-4473-983c-4d1221618c82 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:40.251891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-26af3e53-bef8-4473-983c-4d1221618c82 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1315 microversion: 2.1 time: 0.173259 Oct 28 20:41:40.252611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1659/3339] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:40 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:41:41.274823 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc3ec6a6-205b-4f6e-8aa6-0c93d0f43436 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:41.275434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dc3ec6a6-205b-4f6e-8aa6-0c93d0f43436 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:41.281810 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc3ec6a6-205b-4f6e-8aa6-0c93d0f43436 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:41.282280 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc3ec6a6-205b-4f6e-8aa6-0c93d0f43436 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:41.282707 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc3ec6a6-205b-4f6e-8aa6-0c93d0f43436 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:41.283429 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc3ec6a6-205b-4f6e-8aa6-0c93d0f43436 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:41.283821 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc3ec6a6-205b-4f6e-8aa6-0c93d0f43436 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:41.284236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc3ec6a6-205b-4f6e-8aa6-0c93d0f43436 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:41.417148 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-dc3ec6a6-205b-4f6e-8aa6-0c93d0f43436 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:41.425635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc3ec6a6-205b-4f6e-8aa6-0c93d0f43436 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1465 microversion: 2.1 time: 0.154547 Oct 28 20:41:41.426202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1681/3340] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:41 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:41:41.472231 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7efa1d73-75c9-4821-aa00-66038bc176d1 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:41.472763 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7efa1d73-75c9-4821-aa00-66038bc176d1 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:41.479011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7efa1d73-75c9-4821-aa00-66038bc176d1 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:41.479485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7efa1d73-75c9-4821-aa00-66038bc176d1 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:41.480435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7efa1d73-75c9-4821-aa00-66038bc176d1 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:41.481105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7efa1d73-75c9-4821-aa00-66038bc176d1 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:41.481588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7efa1d73-75c9-4821-aa00-66038bc176d1 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:41.482008 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7efa1d73-75c9-4821-aa00-66038bc176d1 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:41.507257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7efa1d73-75c9-4821-aa00-66038bc176d1 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:41:41.716943 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7efa1d73-75c9-4821-aa00-66038bc176d1 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 204 len: 0 microversion: 2.1 time: 0.248751 Oct 28 20:41:41.717569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1660/3341] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:41:41 2022] DELETE /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:41:41.725778 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3c94ff0b-61c4-4f06-9e04-bc62a658a580 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:41.726414 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3c94ff0b-61c4-4f06-9e04-bc62a658a580 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:41.732901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c94ff0b-61c4-4f06-9e04-bc62a658a580 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:41.733410 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c94ff0b-61c4-4f06-9e04-bc62a658a580 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:41.733850 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c94ff0b-61c4-4f06-9e04-bc62a658a580 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:41.734537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c94ff0b-61c4-4f06-9e04-bc62a658a580 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:41.734994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c94ff0b-61c4-4f06-9e04-bc62a658a580 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:41.735422 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c94ff0b-61c4-4f06-9e04-bc62a658a580 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:41.863312 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3c94ff0b-61c4-4f06-9e04-bc62a658a580 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:41.871294 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3c94ff0b-61c4-4f06-9e04-bc62a658a580 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1471 microversion: 2.1 time: 0.149402 Oct 28 20:41:41.871872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1682/3342] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:41 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:41:42.894527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-194c7e46-8aae-478d-9a06-64d7035a2bc4 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:42.895136 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-194c7e46-8aae-478d-9a06-64d7035a2bc4 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:42.901443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-194c7e46-8aae-478d-9a06-64d7035a2bc4 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:42.902650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-194c7e46-8aae-478d-9a06-64d7035a2bc4 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:42.903116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-194c7e46-8aae-478d-9a06-64d7035a2bc4 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:42.903825 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-194c7e46-8aae-478d-9a06-64d7035a2bc4 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:42.904288 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-194c7e46-8aae-478d-9a06-64d7035a2bc4 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:42.904713 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-194c7e46-8aae-478d-9a06-64d7035a2bc4 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:43.037088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-194c7e46-8aae-478d-9a06-64d7035a2bc4 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:43.044934 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-194c7e46-8aae-478d-9a06-64d7035a2bc4 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1471 microversion: 2.1 time: 0.154708 Oct 28 20:41:43.045521 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1661/3343] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:42 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:41:43.594700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-f8c6e10f-a10b-40a1-b8a1-d6941fcb2a54 req-b2f8db7c-fb16-4274-9b90-991959d56b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6", "name": "network-vif-deleted", "tag": "c4e77376-cdd4-4c64-800b-b1968abea45d"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:41:43.604603 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f8c6e10f-a10b-40a1-b8a1-d6941fcb2a54 req-b2f8db7c-fb16-4274-9b90-991959d56b40 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:43.607732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f8c6e10f-a10b-40a1-b8a1-d6941fcb2a54 req-b2f8db7c-fb16-4274-9b90-991959d56b40 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:43.607732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f8c6e10f-a10b-40a1-b8a1-d6941fcb2a54 req-b2f8db7c-fb16-4274-9b90-991959d56b40 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:43.618647 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-f8c6e10f-a10b-40a1-b8a1-d6941fcb2a54 req-b2f8db7c-fb16-4274-9b90-991959d56b40 service nova] Creating event network-vif-deleted:c4e77376-cdd4-4c64-800b-b1968abea45d for instance c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 on hv-cinder-86236 Oct 28 20:41:43.624987 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-f8c6e10f-a10b-40a1-b8a1-d6941fcb2a54 req-b2f8db7c-fb16-4274-9b90-991959d56b40 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033815 Oct 28 20:41:43.625840 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1683/3344] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:41:44.067977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-257031e5-e0cb-43a1-96e4-48a6a19f4f17 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:44.068597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-257031e5-e0cb-43a1-96e4-48a6a19f4f17 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:44.075674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-257031e5-e0cb-43a1-96e4-48a6a19f4f17 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:44.076160 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-257031e5-e0cb-43a1-96e4-48a6a19f4f17 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:44.076599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-257031e5-e0cb-43a1-96e4-48a6a19f4f17 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:44.077285 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-257031e5-e0cb-43a1-96e4-48a6a19f4f17 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:44.077789 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-257031e5-e0cb-43a1-96e4-48a6a19f4f17 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:44.078213 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-257031e5-e0cb-43a1-96e4-48a6a19f4f17 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:44.108674 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-257031e5-e0cb-43a1-96e4-48a6a19f4f17 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:44.109157 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-257031e5-e0cb-43a1-96e4-48a6a19f4f17 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:44.109640 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-257031e5-e0cb-43a1-96e4-48a6a19f4f17 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:44.110090 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-257031e5-e0cb-43a1-96e4-48a6a19f4f17 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lazy-loading 'fault' on Instance uuid c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:41:44.150210 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-257031e5-e0cb-43a1-96e4-48a6a19f4f17 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9835cd7baa6b412398797dcdd63db416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8416b8a3a7493b941261eb5297a798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:41:44.159031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-257031e5-e0cb-43a1-96e4-48a6a19f4f17 tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 200 len: 1305 microversion: 2.1 time: 0.094938 Oct 28 20:41:44.159594 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1662/3345] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:44 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:41:45.183050 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e85604c6-f1e2-47d1-9a91-f87ebc3f1c2b tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:41:45.183775 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e85604c6-f1e2-47d1-9a91-f87ebc3f1c2b tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] [instance: c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:45.189980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e85604c6-f1e2-47d1-9a91-f87ebc3f1c2b tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:45.190462 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e85604c6-f1e2-47d1-9a91-f87ebc3f1c2b tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:45.190899 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e85604c6-f1e2-47d1-9a91-f87ebc3f1c2b tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:45.191623 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e85604c6-f1e2-47d1-9a91-f87ebc3f1c2b tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:45.192072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e85604c6-f1e2-47d1-9a91-f87ebc3f1c2b tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:45.192493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e85604c6-f1e2-47d1-9a91-f87ebc3f1c2b tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:45.206092 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-e85604c6-f1e2-47d1-9a91-f87ebc3f1c2b tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] HTTP exception thrown: Instance c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 could not be found. Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e85604c6-f1e2-47d1-9a91-f87ebc3f1c2b tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Request method failure captured: Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 HTTP/1.1 Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXD5zKNDprM2aPnwWomdciHVNbq-pO6VpkwDG14n5l_CfszLowCT1jbfvHflPez1XJnN6Nei-4ijEYnJsSntZ1uE5rkN7yIa5rp4QAzoMdPggBuJeyr-N0cyAP45xa5Fl497wE4xDLSw1lrcXBbhhS5-GltyHTpssjMIa5GbBearMi9s Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 6d8416b8a3a7493b941261eb5297a798 Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-VolumesNegativeTest-362974278 Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:41:45.207750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:41:45.210335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6d8416b8a3a7493b941261eb5297a798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6d8416b8a3a7493b941261eb5297a798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6d8416b8a3a7493b941261eb5297a798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6d8416b8a3a7493b941261eb5297a798", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:41:45.210335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-VolumesNegativeTest-362974278 Oct 28 20:41:45.210335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 6d8416b8a3a7493b941261eb5297a798 Oct 28 20:41:45.210335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-VolumesNegativeTest-362974278 Oct 28 20:41:45.210335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-VolumesNegativeTest-362974278-project Oct 28 20:41:45.210335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:41:45.210335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:41:45.210335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: 9835cd7baa6b412398797dcdd63db416 Oct 28 20:41:45.210335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-VolumesNegativeTest-362974278-project Oct 28 20:41:45.210335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:41:45.210335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 could not be found. Oct 28 20:41:45.210335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': 'c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6'} Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 could not be found. Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:41:45.211664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 could not be found. Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 could not be found. Oct 28 20:41:45.214039 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:41:45.217231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e85604c6-f1e2-47d1-9a91-f87ebc3f1c2b tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] Returning 404 to user: Instance c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:41:45.217231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e85604c6-f1e2-47d1-9a91-f87ebc3f1c2b tempest-VolumesNegativeTest-362974278 tempest-VolumesNegativeTest-362974278-project] 10.222.0.66 "GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6" status: 404 len: 111 microversion: 2.1 time: 0.030750 Oct 28 20:41:45.217231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1684/3346] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:41:45 2022] GET /compute/v2.1/servers/c82f78ae-62b0-4bdd-bb1d-8b2c6b368ac6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:43:05.753890 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:43:05.754639 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:43:05.755654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:43:05.755804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:43:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 (ip 10.222.0.66) !!! Oct 28 20:43:05.756812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:43:05.756919 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:43:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 (ip 10.222.0.66) !!! Oct 28 20:43:05.761489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d304aff5-e54f-451e-9609-457813b27552 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:43:05.769693 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d304aff5-e54f-451e-9609-457813b27552 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:43:05.770084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d304aff5-e54f-451e-9609-457813b27552 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:43:05.770569 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d304aff5-e54f-451e-9609-457813b27552 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:43:05.771002 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d304aff5-e54f-451e-9609-457813b27552 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:43:05.771687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d304aff5-e54f-451e-9609-457813b27552 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:43:05.772142 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d304aff5-e54f-451e-9609-457813b27552 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:43:05.772563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d304aff5-e54f-451e-9609-457813b27552 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:43:05.786143 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-d304aff5-e54f-451e-9609-457813b27552 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] HTTP exception thrown: Instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 could not be found. Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d304aff5-e54f-451e-9609-457813b27552 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Request method failure captured: Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 HTTP/1.1 Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDYQ8xIP36w8D6cczE8W9KvY4BLBpdUmPKJO1ioUT3uqwgpfatEPgwAHvUc5SOoZGWs-Zq2VghnaalMc9FMYU4vqRug0rAxlDQPRhjDPPiHdupPmqow6lirdrIPRLWknwIqWkuJ4oyV7nsQ2qY2p8J7NRUFIQXLiWW86wx-MXiPCRgE Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 8b163bdfc7544a3d833bd69dc027c7d6 Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeTestJSON-1697363972 Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:43:05.787815 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:43:05.789155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b163bdfc7544a3d833bd69dc027c7d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b163bdfc7544a3d833bd69dc027c7d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8b163bdfc7544a3d833bd69dc027c7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8b163bdfc7544a3d833bd69dc027c7d6", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:43:05.789155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeTestJSON-1697363972 Oct 28 20:43:05.789155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 8b163bdfc7544a3d833bd69dc027c7d6 Oct 28 20:43:05.789155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1697363972 Oct 28 20:43:05.789155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-AttachVolumeTestJSON-1697363972-project Oct 28 20:43:05.789155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:43:05.789155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:43:05.789155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: 15db5106efbd434f99a4d102810cc7a6 Oct 28 20:43:05.789155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeTestJSON-1697363972-project Oct 28 20:43:05.789155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:43:05.789155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 could not be found. Oct 28 20:43:05.789155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': '5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91'} Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 could not be found. Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:43:05.789925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 could not be found. Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 could not be found. Oct 28 20:43:05.791159 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:43:05.792642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d304aff5-e54f-451e-9609-457813b27552 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Returning 404 to user: Instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:43:05.792642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d304aff5-e54f-451e-9609-457813b27552 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 404 len: 111 microversion: 2.1 time: 0.038157 Oct 28 20:43:05.792642 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1663/3347] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:43:05 2022] DELETE /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:43:05.795835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:43:05.796589 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=60 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:43:05.802196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fcf7f757-14ef-441f-b485-82fe97186588 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:43:05.802873 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fcf7f757-14ef-441f-b485-82fe97186588 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] [instance: 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:43:05.808770 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcf7f757-14ef-441f-b485-82fe97186588 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:43:05.809764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcf7f757-14ef-441f-b485-82fe97186588 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:43:05.809764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcf7f757-14ef-441f-b485-82fe97186588 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:43:05.810460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcf7f757-14ef-441f-b485-82fe97186588 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:43:05.810917 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcf7f757-14ef-441f-b485-82fe97186588 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:43:05.811343 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcf7f757-14ef-441f-b485-82fe97186588 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:43:05.825841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-fcf7f757-14ef-441f-b485-82fe97186588 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] HTTP exception thrown: Instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 could not be found. Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fcf7f757-14ef-441f-b485-82fe97186588 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Request method failure captured: Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 HTTP/1.1 Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYQ8xIP36w8D6cczE8W9KvY4BLBpdUmPKJO1ioUT3uqwgpfatEPgwAHvUc5SOoZGWs-Zq2VghnaalMc9FMYU4vqRug0rAxlDQPRhjDPPiHdupPmqow6lirdrIPRLWknwIqWkuJ4oyV7nsQ2qY2p8J7NRUFIQXLiWW86wx-MXiPCRgE Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 8b163bdfc7544a3d833bd69dc027c7d6 Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeTestJSON-1697363972 Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:43:05.827401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:43:05.828983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b163bdfc7544a3d833bd69dc027c7d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b163bdfc7544a3d833bd69dc027c7d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8b163bdfc7544a3d833bd69dc027c7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8b163bdfc7544a3d833bd69dc027c7d6", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:43:05.828983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeTestJSON-1697363972 Oct 28 20:43:05.828983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 8b163bdfc7544a3d833bd69dc027c7d6 Oct 28 20:43:05.828983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1697363972 Oct 28 20:43:05.828983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-AttachVolumeTestJSON-1697363972-project Oct 28 20:43:05.828983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:43:05.828983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:43:05.828983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: 15db5106efbd434f99a4d102810cc7a6 Oct 28 20:43:05.828983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeTestJSON-1697363972-project Oct 28 20:43:05.828983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:43:05.828983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 could not be found. Oct 28 20:43:05.828983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': '5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91'} Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 could not be found. Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:43:05.829811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 could not be found. Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 could not be found. Oct 28 20:43:05.831204 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:43:05.832418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fcf7f757-14ef-441f-b485-82fe97186588 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] Returning 404 to user: Instance 5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:43:05.832418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fcf7f757-14ef-441f-b485-82fe97186588 tempest-AttachVolumeTestJSON-1697363972 tempest-AttachVolumeTestJSON-1697363972-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91" status: 404 len: 111 microversion: 2.1 time: 0.034808 Oct 28 20:43:05.832418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1685/3348] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:43:05 2022] GET /compute/v2.1/servers/5dd89c3c-a5e5-4446-9bb3-4e9250ab8f91 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:43:54.221208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-65fd549d-66bd-4497-ad0a-a9e25c02f70c tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Action: 'create', calling method: .version_select at 0x7f1f506cf280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1233854547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWvneGpFvV9pBTk3695lnj1cABGQsP+BrZKjoAu3DUyihhmGeQE9Lkdu+SgmL8nWyIer3NEUgwHxt6drngH1/tW4NlbVLuo1dJGVHeLZpjelJakg6HDWf9Vh9NRw34z7g=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:43:54.236744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-65fd549d-66bd-4497-ad0a-a9e25c02f70c tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Getting quotas for project 2d9ea1131d80461da67996b2dc844f49. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:43:54.241019 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-65fd549d-66bd-4497-ad0a-a9e25c02f70c tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Getting quotas for user d41ea52c88f1436188152eab37f47ab6 and project 2d9ea1131d80461da67996b2dc844f49. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:43:54.349106 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-65fd549d-66bd-4497-ad0a-a9e25c02f70c tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.305632 Oct 28 20:43:54.349780 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1664/3349] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Oct 28 20:43:54 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:44:12.219428 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6548a184-a31e-406e-bd30-e54522fafbbb] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 20:44:12.220782 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:44:12.220925 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Fri Oct 28 20:44:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.66) !!! Oct 28 20:44:12.226246 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1876114367", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1233854547", "security_groups": [{"name": "tempest-secgroup-smoke-385587382"}], "networks": [{"uuid": "cdd8735e-ef89-4af1-a44b-cb271d1e4021"}], "block_device_mapping_v2": [{"uuid": "81183c27-00cd-4f79-a3c3-22708a7de516", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:44:12.442802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] validate_networks() for [('cdd8735e-ef89-4af1-a44b-cb271d1e4021', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:44:12.807339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:44:12.807764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:44:12.808272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:44:12.808683 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:44:12.809272 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:44:12.817940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:12.818460 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:12.818942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:12.819649 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:12.820103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:12.820535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:12.837025 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Getting quotas for project 2d9ea1131d80461da67996b2dc844f49. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:44:12.840964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Getting quotas for user d41ea52c88f1436188152eab37f47ab6 and project 2d9ea1131d80461da67996b2dc844f49. Resources: {'instances', 'ram', 'cores'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:44:12.897446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:44:12.899565 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='81183c27-00cd-4f79-a3c3-22708a7de516',volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:44:13.227669 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] [6548a184-a31e-406e-bd30-e54522fafbbb] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 34132. Oct 28 20:44:13.297344 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1fada96a-ae34-460b-bac2-156348fb4e76 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.079567 Oct 28 20:44:13.297998 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1686/3350] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:44:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:44:13.307240 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:44:13.307999 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:44:13.308625 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:44:13.313571 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f6763bb6-d58a-475b-be47-976d0d125658 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:13.315088 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f6763bb6-d58a-475b-be47-976d0d125658 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:13.477925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f6763bb6-d58a-475b-be47-976d0d125658 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:13.484786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f6763bb6-d58a-475b-be47-976d0d125658 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1089 microversion: 2.1 time: 0.179173 Oct 28 20:44:13.485376 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1665/3351] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:13 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1089 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:14.508881 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-488819f1-3d92-492f-b07f-672e23449862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:14.509530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-488819f1-3d92-492f-b07f-672e23449862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:14.515749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-488819f1-3d92-492f-b07f-672e23449862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:14.516231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-488819f1-3d92-492f-b07f-672e23449862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:14.516673 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-488819f1-3d92-492f-b07f-672e23449862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:14.517388 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-488819f1-3d92-492f-b07f-672e23449862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:14.517844 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-488819f1-3d92-492f-b07f-672e23449862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:14.518274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-488819f1-3d92-492f-b07f-672e23449862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:14.581016 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-488819f1-3d92-492f-b07f-672e23449862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:14.589027 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-488819f1-3d92-492f-b07f-672e23449862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1139 microversion: 2.1 time: 0.085748 Oct 28 20:44:14.589639 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1687/3352] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:14 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:15.611248 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5784e297-e8a8-4142-bb13-f2c9d22086d7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:15.611856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5784e297-e8a8-4142-bb13-f2c9d22086d7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:15.618525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5784e297-e8a8-4142-bb13-f2c9d22086d7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:15.623414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5784e297-e8a8-4142-bb13-f2c9d22086d7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:15.623414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5784e297-e8a8-4142-bb13-f2c9d22086d7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:15.623414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5784e297-e8a8-4142-bb13-f2c9d22086d7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:15.623414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5784e297-e8a8-4142-bb13-f2c9d22086d7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:15.623854 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5784e297-e8a8-4142-bb13-f2c9d22086d7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:15.689892 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5784e297-e8a8-4142-bb13-f2c9d22086d7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:15.700262 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5784e297-e8a8-4142-bb13-f2c9d22086d7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1195 microversion: 2.1 time: 0.092821 Oct 28 20:44:15.701016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1666/3353] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:15 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1195 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:16.735124 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a100a3c2-8be9-44f4-9ef1-215d1b6d7783 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:16.735740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a100a3c2-8be9-44f4-9ef1-215d1b6d7783 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:16.742855 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a100a3c2-8be9-44f4-9ef1-215d1b6d7783 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:16.746442 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a100a3c2-8be9-44f4-9ef1-215d1b6d7783 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:16.746893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a100a3c2-8be9-44f4-9ef1-215d1b6d7783 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:16.747605 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a100a3c2-8be9-44f4-9ef1-215d1b6d7783 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:16.748062 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a100a3c2-8be9-44f4-9ef1-215d1b6d7783 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:16.748481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a100a3c2-8be9-44f4-9ef1-215d1b6d7783 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:16.974572 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a100a3c2-8be9-44f4-9ef1-215d1b6d7783 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:16.982449 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a100a3c2-8be9-44f4-9ef1-215d1b6d7783 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1272 microversion: 2.1 time: 0.251190 Oct 28 20:44:16.983120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1688/3354] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:16 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:17.504936 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-5c238e93-3dc9-4677-a621-b94061c98d94 req-f4e76089-58ff-4d13-a7ec-27eb4ec13d8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b775e781-f50c-4ea6-a803-6cff2219f02a", "tag": "57d50b64-a05f-43d5-ae01-a156aa5b9e62"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:44:17.515036 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5c238e93-3dc9-4677-a621-b94061c98d94 req-f4e76089-58ff-4d13-a7ec-27eb4ec13d8c service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:17.515514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5c238e93-3dc9-4677-a621-b94061c98d94 req-f4e76089-58ff-4d13-a7ec-27eb4ec13d8c service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:17.515945 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5c238e93-3dc9-4677-a621-b94061c98d94 req-f4e76089-58ff-4d13-a7ec-27eb4ec13d8c service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:17.528256 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-5c238e93-3dc9-4677-a621-b94061c98d94 req-f4e76089-58ff-4d13-a7ec-27eb4ec13d8c service nova] Creating event network-changed:57d50b64-a05f-43d5-ae01-a156aa5b9e62 for instance b775e781-f50c-4ea6-a803-6cff2219f02a on hv-cinder-86236 Oct 28 20:44:17.533692 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-5c238e93-3dc9-4677-a621-b94061c98d94 req-f4e76089-58ff-4d13-a7ec-27eb4ec13d8c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032155 Oct 28 20:44:17.534273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1667/3355] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:44:18.007846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-42d962bb-1786-48b5-9c72-d02f709164da tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:18.008558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-42d962bb-1786-48b5-9c72-d02f709164da tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:18.014954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42d962bb-1786-48b5-9c72-d02f709164da tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:18.015522 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42d962bb-1786-48b5-9c72-d02f709164da tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:18.016055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42d962bb-1786-48b5-9c72-d02f709164da tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:18.016846 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42d962bb-1786-48b5-9c72-d02f709164da tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:18.017308 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42d962bb-1786-48b5-9c72-d02f709164da tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:18.017762 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42d962bb-1786-48b5-9c72-d02f709164da tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:18.215413 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-42d962bb-1786-48b5-9c72-d02f709164da tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:18.223075 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-42d962bb-1786-48b5-9c72-d02f709164da tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1260 microversion: 2.1 time: 0.219526 Oct 28 20:44:18.226072 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1689/3356] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:18 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:19.248722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-572da581-0828-4218-8349-9088d9e16192 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:19.249460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-572da581-0828-4218-8349-9088d9e16192 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:19.256487 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-572da581-0828-4218-8349-9088d9e16192 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:19.256974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-572da581-0828-4218-8349-9088d9e16192 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:19.257453 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-572da581-0828-4218-8349-9088d9e16192 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:19.258149 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-572da581-0828-4218-8349-9088d9e16192 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:19.258608 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-572da581-0828-4218-8349-9088d9e16192 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:19.259038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-572da581-0828-4218-8349-9088d9e16192 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:19.392276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-572da581-0828-4218-8349-9088d9e16192 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:19.401037 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-572da581-0828-4218-8349-9088d9e16192 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1260 microversion: 2.1 time: 0.157866 Oct 28 20:44:19.401645 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1668/3357] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:19 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:20.424199 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d8929118-86f2-4596-9690-e4165a62b087 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:20.424741 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d8929118-86f2-4596-9690-e4165a62b087 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:20.431755 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8929118-86f2-4596-9690-e4165a62b087 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:20.432240 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8929118-86f2-4596-9690-e4165a62b087 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:20.432697 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8929118-86f2-4596-9690-e4165a62b087 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:20.433403 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8929118-86f2-4596-9690-e4165a62b087 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:20.433857 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8929118-86f2-4596-9690-e4165a62b087 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:20.434285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8929118-86f2-4596-9690-e4165a62b087 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:20.565183 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d8929118-86f2-4596-9690-e4165a62b087 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:20.573875 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d8929118-86f2-4596-9690-e4165a62b087 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1260 microversion: 2.1 time: 0.153654 Oct 28 20:44:20.574446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1690/3358] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:20 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:21.596180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-951351c2-4ea1-47bb-aef3-b13ecc346c8a tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:21.596800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-951351c2-4ea1-47bb-aef3-b13ecc346c8a tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:21.603508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-951351c2-4ea1-47bb-aef3-b13ecc346c8a tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:21.603991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-951351c2-4ea1-47bb-aef3-b13ecc346c8a tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:21.604430 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-951351c2-4ea1-47bb-aef3-b13ecc346c8a tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:21.605117 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-951351c2-4ea1-47bb-aef3-b13ecc346c8a tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:21.605609 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-951351c2-4ea1-47bb-aef3-b13ecc346c8a tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:21.606033 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-951351c2-4ea1-47bb-aef3-b13ecc346c8a tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:21.738065 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-951351c2-4ea1-47bb-aef3-b13ecc346c8a tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:21.746563 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-951351c2-4ea1-47bb-aef3-b13ecc346c8a tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1260 microversion: 2.1 time: 0.154290 Oct 28 20:44:21.747122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1669/3359] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:21 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:22.768018 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b1df621f-00bb-458b-b904-89f6b3ff60e0 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:22.768626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b1df621f-00bb-458b-b904-89f6b3ff60e0 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:22.775655 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1df621f-00bb-458b-b904-89f6b3ff60e0 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:22.780065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1df621f-00bb-458b-b904-89f6b3ff60e0 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:22.780065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1df621f-00bb-458b-b904-89f6b3ff60e0 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:22.780065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1df621f-00bb-458b-b904-89f6b3ff60e0 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:22.780065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1df621f-00bb-458b-b904-89f6b3ff60e0 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:22.780486 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1df621f-00bb-458b-b904-89f6b3ff60e0 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:22.828042 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:44:22.847467 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:44:22.910458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b1df621f-00bb-458b-b904-89f6b3ff60e0 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:22.918974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b1df621f-00bb-458b-b904-89f6b3ff60e0 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1260 microversion: 2.1 time: 0.154857 Oct 28 20:44:22.919530 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1691/3360] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:22 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:23.940932 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-24e56d38-a150-4f60-9edf-e3daa136c23d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:23.941588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-24e56d38-a150-4f60-9edf-e3daa136c23d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:23.944288 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:44:23.948966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e56d38-a150-4f60-9edf-e3daa136c23d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:23.955727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e56d38-a150-4f60-9edf-e3daa136c23d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:23.955727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e56d38-a150-4f60-9edf-e3daa136c23d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:23.955727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e56d38-a150-4f60-9edf-e3daa136c23d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:23.955727 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e56d38-a150-4f60-9edf-e3daa136c23d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:23.956110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e56d38-a150-4f60-9edf-e3daa136c23d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:24.085021 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-24e56d38-a150-4f60-9edf-e3daa136c23d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:24.092588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-24e56d38-a150-4f60-9edf-e3daa136c23d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1260 microversion: 2.1 time: 0.155451 Oct 28 20:44:24.093163 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1670/3361] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:23 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:25.114879 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a5e83c3e-638a-46cb-a853-bb354d1b84f1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:25.116094 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a5e83c3e-638a-46cb-a853-bb354d1b84f1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:25.122441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5e83c3e-638a-46cb-a853-bb354d1b84f1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:25.122923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5e83c3e-638a-46cb-a853-bb354d1b84f1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:25.123357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5e83c3e-638a-46cb-a853-bb354d1b84f1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:25.124034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5e83c3e-638a-46cb-a853-bb354d1b84f1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:25.124539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5e83c3e-638a-46cb-a853-bb354d1b84f1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:25.124901 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5e83c3e-638a-46cb-a853-bb354d1b84f1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:25.258239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a5e83c3e-638a-46cb-a853-bb354d1b84f1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:25.266048 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a5e83c3e-638a-46cb-a853-bb354d1b84f1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1260 microversion: 2.1 time: 0.155226 Oct 28 20:44:25.266631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1692/3362] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:25 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:26.289079 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-05c3dbb5-1090-4dd5-971f-3b7832fad5e3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:26.289656 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-05c3dbb5-1090-4dd5-971f-3b7832fad5e3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:26.295908 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05c3dbb5-1090-4dd5-971f-3b7832fad5e3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:26.296514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05c3dbb5-1090-4dd5-971f-3b7832fad5e3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:26.296950 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05c3dbb5-1090-4dd5-971f-3b7832fad5e3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:26.297668 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05c3dbb5-1090-4dd5-971f-3b7832fad5e3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:26.298116 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05c3dbb5-1090-4dd5-971f-3b7832fad5e3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:26.298533 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05c3dbb5-1090-4dd5-971f-3b7832fad5e3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:26.431358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-05c3dbb5-1090-4dd5-971f-3b7832fad5e3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:26.439005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-05c3dbb5-1090-4dd5-971f-3b7832fad5e3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1260 microversion: 2.1 time: 0.154525 Oct 28 20:44:26.439557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1671/3363] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:26 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:27.351298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-889fcc7e-375c-48f4-bf30-7a63e1fce87b req-c0db22cd-2dc9-4164-b9c4-30b2df7cf4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b775e781-f50c-4ea6-a803-6cff2219f02a", "name": "network-vif-plugged", "status": "completed", "tag": "57d50b64-a05f-43d5-ae01-a156aa5b9e62"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:44:27.361250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-889fcc7e-375c-48f4-bf30-7a63e1fce87b req-c0db22cd-2dc9-4164-b9c4-30b2df7cf4e2 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:27.361760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-889fcc7e-375c-48f4-bf30-7a63e1fce87b req-c0db22cd-2dc9-4164-b9c4-30b2df7cf4e2 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:27.362194 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-889fcc7e-375c-48f4-bf30-7a63e1fce87b req-c0db22cd-2dc9-4164-b9c4-30b2df7cf4e2 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:27.373805 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-889fcc7e-375c-48f4-bf30-7a63e1fce87b req-c0db22cd-2dc9-4164-b9c4-30b2df7cf4e2 service nova] Creating event network-vif-plugged:57d50b64-a05f-43d5-ae01-a156aa5b9e62 for instance b775e781-f50c-4ea6-a803-6cff2219f02a on hv-cinder-86236 Oct 28 20:44:27.377447 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [req-889fcc7e-375c-48f4-bf30-7a63e1fce87b req-c0db22cd-2dc9-4164-b9c4-30b2df7cf4e2 service nova] [e706360a-a90b-4d87-819b-5d51ee38db36] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:44:27.461071 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a3fcd06-5268-4f5d-bc29-017ade0209d1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:27.461802 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3a3fcd06-5268-4f5d-bc29-017ade0209d1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:27.467992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a3fcd06-5268-4f5d-bc29-017ade0209d1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:27.468481 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a3fcd06-5268-4f5d-bc29-017ade0209d1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:27.468922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a3fcd06-5268-4f5d-bc29-017ade0209d1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:27.469687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a3fcd06-5268-4f5d-bc29-017ade0209d1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:27.470154 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a3fcd06-5268-4f5d-bc29-017ade0209d1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:27.470578 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a3fcd06-5268-4f5d-bc29-017ade0209d1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:27.600329 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a3fcd06-5268-4f5d-bc29-017ade0209d1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:27.607909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a3fcd06-5268-4f5d-bc29-017ade0209d1 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1260 microversion: 2.1 time: 0.150810 Oct 28 20:44:27.608823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1672/3364] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:27 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:44:28.384980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [req-889fcc7e-375c-48f4-bf30-7a63e1fce87b req-c0db22cd-2dc9-4164-b9c4-30b2df7cf4e2 service nova] [e706360a-a90b-4d87-819b-5d51ee38db36] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 34206. Oct 28 20:44:28.388511 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-889fcc7e-375c-48f4-bf30-7a63e1fce87b req-c0db22cd-2dc9-4164-b9c4-30b2df7cf4e2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.041218 Oct 28 20:44:28.389117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1693/3365] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:44:28.632385 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8015936d-40e8-43a7-bbe4-798532d09eac tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:28.633015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8015936d-40e8-43a7-bbe4-798532d09eac tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:28.639496 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8015936d-40e8-43a7-bbe4-798532d09eac tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:28.639912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8015936d-40e8-43a7-bbe4-798532d09eac tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:28.640338 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8015936d-40e8-43a7-bbe4-798532d09eac tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:28.641011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8015936d-40e8-43a7-bbe4-798532d09eac tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:28.641491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8015936d-40e8-43a7-bbe4-798532d09eac tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:28.646035 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8015936d-40e8-43a7-bbe4-798532d09eac tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:28.824335 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8015936d-40e8-43a7-bbe4-798532d09eac tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:28.831823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8015936d-40e8-43a7-bbe4-798532d09eac tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1260 microversion: 2.1 time: 0.203885 Oct 28 20:44:28.832388 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1673/3366] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:28 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:29.856186 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc16cf29-5a5f-44ea-8d2b-d9ec20d1d495 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:29.856882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bc16cf29-5a5f-44ea-8d2b-d9ec20d1d495 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:29.862950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc16cf29-5a5f-44ea-8d2b-d9ec20d1d495 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:29.868029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc16cf29-5a5f-44ea-8d2b-d9ec20d1d495 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:29.868029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc16cf29-5a5f-44ea-8d2b-d9ec20d1d495 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:29.868029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc16cf29-5a5f-44ea-8d2b-d9ec20d1d495 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:29.868029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc16cf29-5a5f-44ea-8d2b-d9ec20d1d495 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:29.868432 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc16cf29-5a5f-44ea-8d2b-d9ec20d1d495 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:29.996733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-bc16cf29-5a5f-44ea-8d2b-d9ec20d1d495 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:30.004457 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bc16cf29-5a5f-44ea-8d2b-d9ec20d1d495 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1260 microversion: 2.1 time: 0.153054 Oct 28 20:44:30.005055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1694/3367] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:29 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:31.028242 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8e48ddd3-7510-471c-bbfa-8ebacb38f0ba tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:31.028864 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8e48ddd3-7510-471c-bbfa-8ebacb38f0ba tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:31.035295 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e48ddd3-7510-471c-bbfa-8ebacb38f0ba tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:31.035786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e48ddd3-7510-471c-bbfa-8ebacb38f0ba tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:31.036228 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e48ddd3-7510-471c-bbfa-8ebacb38f0ba tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:31.036980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e48ddd3-7510-471c-bbfa-8ebacb38f0ba tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:31.037485 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e48ddd3-7510-471c-bbfa-8ebacb38f0ba tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:31.037916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e48ddd3-7510-471c-bbfa-8ebacb38f0ba tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:31.167577 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8e48ddd3-7510-471c-bbfa-8ebacb38f0ba tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:31.175257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8e48ddd3-7510-471c-bbfa-8ebacb38f0ba tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1444 microversion: 2.1 time: 0.150862 Oct 28 20:44:31.175814 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1674/3368] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:31 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:31.197993 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-354370c7-9b98-4fd2-b356-4b324b8ec85d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:31.198602 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-354370c7-9b98-4fd2-b356-4b324b8ec85d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:31.204882 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-354370c7-9b98-4fd2-b356-4b324b8ec85d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:31.205393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-354370c7-9b98-4fd2-b356-4b324b8ec85d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:31.205834 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-354370c7-9b98-4fd2-b356-4b324b8ec85d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:31.206521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-354370c7-9b98-4fd2-b356-4b324b8ec85d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:31.206972 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-354370c7-9b98-4fd2-b356-4b324b8ec85d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:31.207393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-354370c7-9b98-4fd2-b356-4b324b8ec85d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:31.336336 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-354370c7-9b98-4fd2-b356-4b324b8ec85d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:31.346369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-354370c7-9b98-4fd2-b356-4b324b8ec85d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1444 microversion: 2.1 time: 0.149903 Oct 28 20:44:31.346369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1695/3369] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:31 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:33.603020 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-41e69f16-7072-4bb4-bdcc-46d87e454e76 req-07aacc57-82c9-4978-886a-de5ed80e0ecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b775e781-f50c-4ea6-a803-6cff2219f02a", "tag": "57d50b64-a05f-43d5-ae01-a156aa5b9e62"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:44:33.613687 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-41e69f16-7072-4bb4-bdcc-46d87e454e76 req-07aacc57-82c9-4978-886a-de5ed80e0ecf service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:33.614199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-41e69f16-7072-4bb4-bdcc-46d87e454e76 req-07aacc57-82c9-4978-886a-de5ed80e0ecf service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:33.615258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-41e69f16-7072-4bb4-bdcc-46d87e454e76 req-07aacc57-82c9-4978-886a-de5ed80e0ecf service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:33.626629 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-41e69f16-7072-4bb4-bdcc-46d87e454e76 req-07aacc57-82c9-4978-886a-de5ed80e0ecf service nova] Creating event network-changed:57d50b64-a05f-43d5-ae01-a156aa5b9e62 for instance b775e781-f50c-4ea6-a803-6cff2219f02a on hv-cinder-86236 Oct 28 20:44:33.632438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-41e69f16-7072-4bb4-bdcc-46d87e454e76 req-07aacc57-82c9-4978-886a-de5ed80e0ecf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033784 Oct 28 20:44:33.633174 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1675/3370] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:45:30.685592 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94c9f3a3-fbb8-475c-b6a2-46c990bf57c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:45:30.686166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-94c9f3a3-fbb8-475c-b6a2-46c990bf57c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:45:30.688297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:45:30.688956 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=54 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:45:30.694171 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94c9f3a3-fbb8-475c-b6a2-46c990bf57c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:45:30.694652 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94c9f3a3-fbb8-475c-b6a2-46c990bf57c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:45:30.695088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94c9f3a3-fbb8-475c-b6a2-46c990bf57c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:45:30.696709 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94c9f3a3-fbb8-475c-b6a2-46c990bf57c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:45:30.697177 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94c9f3a3-fbb8-475c-b6a2-46c990bf57c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:45:30.697641 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94c9f3a3-fbb8-475c-b6a2-46c990bf57c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:45:30.711158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-94c9f3a3-fbb8-475c-b6a2-46c990bf57c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] HTTP exception thrown: Instance 83fb8150-cbd4-4139-bb47-a0fd318f8b86 could not be found. Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94c9f3a3-fbb8-475c-b6a2-46c990bf57c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Request method failure captured: Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 HTTP/1.1 Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXDYMvyQboftNRryWd3Rs40sLFlwhGaFtwYfaIeJnxRaNivrbjxkcoU7hik0GmB2LCAF23QhzK0jde7TY6jjLMWtp3be2qb3ioW4B_DmUzK25G3ialtqsuYDsquFjDhl4JMbgP7SnsYrOor-VBrDZUeFYQ9rlIGxqZsR02x8jWolIc1k Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:45:30.713038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:45:30.714760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_940ce72c42534c5196dfb909cc2a8d54", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:45:30.714760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:45:30.714760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:45:30.714760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:45:30.714760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:45:30.714760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:45:30.714760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:45:30.714760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: 724baaa4aa834e609fe4f513f9fc0b4b Oct 28 20:45:30.714760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:45:30.714760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:45:30.714760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance 83fb8150-cbd4-4139-bb47-a0fd318f8b86 could not be found. Oct 28 20:45:30.714760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': '83fb8150-cbd4-4139-bb47-a0fd318f8b86'} Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83fb8150-cbd4-4139-bb47-a0fd318f8b86 could not be found. Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:45:30.715617 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83fb8150-cbd4-4139-bb47-a0fd318f8b86 could not be found. Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83fb8150-cbd4-4139-bb47-a0fd318f8b86 could not be found. Oct 28 20:45:30.716796 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:45:30.718028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94c9f3a3-fbb8-475c-b6a2-46c990bf57c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Returning 404 to user: Instance 83fb8150-cbd4-4139-bb47-a0fd318f8b86 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:45:30.718028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-94c9f3a3-fbb8-475c-b6a2-46c990bf57c9 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "DELETE /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 404 len: 111 microversion: 2.1 time: 0.033029 Oct 28 20:45:30.718028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1696/3371] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:45:30 2022] DELETE /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:45:30.720959 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=24 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:45:30.721733 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=52 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:45:30.726460 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6c7d37c4-6d9c-4e99-b99e-9c1061d4def1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:45:30.727812 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6c7d37c4-6d9c-4e99-b99e-9c1061d4def1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] [instance: 83fb8150-cbd4-4139-bb47-a0fd318f8b86] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:45:30.734156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c7d37c4-6d9c-4e99-b99e-9c1061d4def1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:45:30.734637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c7d37c4-6d9c-4e99-b99e-9c1061d4def1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:45:30.735072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c7d37c4-6d9c-4e99-b99e-9c1061d4def1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:45:30.736014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c7d37c4-6d9c-4e99-b99e-9c1061d4def1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:45:30.736466 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c7d37c4-6d9c-4e99-b99e-9c1061d4def1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:45:30.736888 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c7d37c4-6d9c-4e99-b99e-9c1061d4def1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:45:30.750690 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6c7d37c4-6d9c-4e99-b99e-9c1061d4def1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] HTTP exception thrown: Instance 83fb8150-cbd4-4139-bb47-a0fd318f8b86 could not be found. Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6c7d37c4-6d9c-4e99-b99e-9c1061d4def1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Request method failure captured: Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 HTTP/1.1 Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXDYMvyQboftNRryWd3Rs40sLFlwhGaFtwYfaIeJnxRaNivrbjxkcoU7hik0GmB2LCAF23QhzK0jde7TY6jjLMWtp3be2qb3ioW4B_DmUzK25G3ialtqsuYDsquFjDhl4JMbgP7SnsYrOor-VBrDZUeFYQ9rlIGxqZsR02x8jWolIc1k Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:45:30.752327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:45:30.753849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/940ce72c42534c5196dfb909cc2a8d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_940ce72c42534c5196dfb909cc2a8d54", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:45:30.753849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:45:30.753849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 940ce72c42534c5196dfb909cc2a8d54 Oct 28 20:45:30.753849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398261764 Oct 28 20:45:30.753849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:45:30.753849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:45:30.753849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:45:30.753849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: 724baaa4aa834e609fe4f513f9fc0b4b Oct 28 20:45:30.753849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeNegativeTest-398261764-project Oct 28 20:45:30.753849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:45:30.753849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Instance 83fb8150-cbd4-4139-bb47-a0fd318f8b86 could not be found. Oct 28 20:45:30.753849 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': '83fb8150-cbd4-4139-bb47-a0fd318f8b86'} Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83fb8150-cbd4-4139-bb47-a0fd318f8b86 could not be found. Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:45:30.754783 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83fb8150-cbd4-4139-bb47-a0fd318f8b86 could not be found. Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83fb8150-cbd4-4139-bb47-a0fd318f8b86 could not be found. Oct 28 20:45:30.756199 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:45:30.757499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6c7d37c4-6d9c-4e99-b99e-9c1061d4def1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] Returning 404 to user: Instance 83fb8150-cbd4-4139-bb47-a0fd318f8b86 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:45:30.757499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6c7d37c4-6d9c-4e99-b99e-9c1061d4def1 tempest-AttachVolumeNegativeTest-398261764 tempest-AttachVolumeNegativeTest-398261764-project] 10.222.0.66 "GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86" status: 404 len: 111 microversion: 2.1 time: 0.034604 Oct 28 20:45:30.757499 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1676/3372] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:45:30 2022] GET /compute/v2.1/servers/83fb8150-cbd4-4139-bb47-a0fd318f8b86 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:46:27.720096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6bc05b61-f174-436a-88a7-dd8cc1e79862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:46:27.720666 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6bc05b61-f174-436a-88a7-dd8cc1e79862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:27.728559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bc05b61-f174-436a-88a7-dd8cc1e79862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:27.729055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bc05b61-f174-436a-88a7-dd8cc1e79862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:27.729535 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bc05b61-f174-436a-88a7-dd8cc1e79862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:27.735374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bc05b61-f174-436a-88a7-dd8cc1e79862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:27.735374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bc05b61-f174-436a-88a7-dd8cc1e79862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:27.735374 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bc05b61-f174-436a-88a7-dd8cc1e79862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:27.754064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-6bc05b61-f174-436a-88a7-dd8cc1e79862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lazy-loading 'flavor' on Instance uuid b775e781-f50c-4ea6-a803-6cff2219f02a {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:46:28.078225 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6bc05b61-f174-436a-88a7-dd8cc1e79862 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "POST /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a/action" status: 202 len: 0 microversion: 2.1 time: 0.362505 Oct 28 20:46:28.079013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1697/3373] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Oct 28 20:46:27 2022] POST /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:46:28.089233 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a7ffefe-d5a8-4d0e-af0a-fb4abc2daf85 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:28.089842 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a7ffefe-d5a8-4d0e-af0a-fb4abc2daf85 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:28.096215 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a7ffefe-d5a8-4d0e-af0a-fb4abc2daf85 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:28.096750 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a7ffefe-d5a8-4d0e-af0a-fb4abc2daf85 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:28.097203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a7ffefe-d5a8-4d0e-af0a-fb4abc2daf85 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:28.097942 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a7ffefe-d5a8-4d0e-af0a-fb4abc2daf85 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:28.098403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a7ffefe-d5a8-4d0e-af0a-fb4abc2daf85 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:28.098834 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a7ffefe-d5a8-4d0e-af0a-fb4abc2daf85 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:28.233996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1a7ffefe-d5a8-4d0e-af0a-fb4abc2daf85 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:28.242421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a7ffefe-d5a8-4d0e-af0a-fb4abc2daf85 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1569 microversion: 2.1 time: 0.159100 Oct 28 20:46:28.242975 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1677/3374] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:28 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:29.267515 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-87c7c65f-68e4-49bb-bafb-d2e5c23f3a15 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:29.268202 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-87c7c65f-68e4-49bb-bafb-d2e5c23f3a15 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:29.274390 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87c7c65f-68e4-49bb-bafb-d2e5c23f3a15 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:29.274868 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87c7c65f-68e4-49bb-bafb-d2e5c23f3a15 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:29.275304 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87c7c65f-68e4-49bb-bafb-d2e5c23f3a15 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:29.276019 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87c7c65f-68e4-49bb-bafb-d2e5c23f3a15 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:29.276487 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87c7c65f-68e4-49bb-bafb-d2e5c23f3a15 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:29.276906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87c7c65f-68e4-49bb-bafb-d2e5c23f3a15 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:29.414250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-87c7c65f-68e4-49bb-bafb-d2e5c23f3a15 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:29.421851 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-87c7c65f-68e4-49bb-bafb-d2e5c23f3a15 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1569 microversion: 2.1 time: 0.159256 Oct 28 20:46:29.422409 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1698/3375] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:29 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:30.446670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bf44e544-2439-491d-bd68-10108619cce3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:30.446670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bf44e544-2439-491d-bd68-10108619cce3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:30.452741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf44e544-2439-491d-bd68-10108619cce3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:30.453225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf44e544-2439-491d-bd68-10108619cce3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:30.453732 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf44e544-2439-491d-bd68-10108619cce3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:30.454419 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf44e544-2439-491d-bd68-10108619cce3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:30.454873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf44e544-2439-491d-bd68-10108619cce3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:30.455389 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf44e544-2439-491d-bd68-10108619cce3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:30.592494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bf44e544-2439-491d-bd68-10108619cce3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:30.600072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bf44e544-2439-491d-bd68-10108619cce3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1569 microversion: 2.1 time: 0.158462 Oct 28 20:46:30.601529 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1678/3376] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:30 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:31.624298 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d0ff95c7-1fc4-4dfb-90ca-b179cee03ec7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:31.626267 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d0ff95c7-1fc4-4dfb-90ca-b179cee03ec7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:31.632111 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0ff95c7-1fc4-4dfb-90ca-b179cee03ec7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:31.632858 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0ff95c7-1fc4-4dfb-90ca-b179cee03ec7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:31.633303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0ff95c7-1fc4-4dfb-90ca-b179cee03ec7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:31.634022 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0ff95c7-1fc4-4dfb-90ca-b179cee03ec7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:31.634476 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0ff95c7-1fc4-4dfb-90ca-b179cee03ec7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:31.634909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0ff95c7-1fc4-4dfb-90ca-b179cee03ec7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:31.768454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0ff95c7-1fc4-4dfb-90ca-b179cee03ec7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:31.779248 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d0ff95c7-1fc4-4dfb-90ca-b179cee03ec7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1569 microversion: 2.1 time: 0.158897 Oct 28 20:46:31.779969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1699/3377] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:31 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:32.802555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-839aabe9-e832-4fd5-9f6b-43297e2e6abd tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:32.803216 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-839aabe9-e832-4fd5-9f6b-43297e2e6abd tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:32.810005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839aabe9-e832-4fd5-9f6b-43297e2e6abd tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:32.813377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839aabe9-e832-4fd5-9f6b-43297e2e6abd tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:32.813377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839aabe9-e832-4fd5-9f6b-43297e2e6abd tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:32.813377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839aabe9-e832-4fd5-9f6b-43297e2e6abd tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:32.813377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839aabe9-e832-4fd5-9f6b-43297e2e6abd tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:32.813705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839aabe9-e832-4fd5-9f6b-43297e2e6abd tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:32.940751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-839aabe9-e832-4fd5-9f6b-43297e2e6abd tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:32.949049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-839aabe9-e832-4fd5-9f6b-43297e2e6abd tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1569 microversion: 2.1 time: 0.150490 Oct 28 20:46:32.949654 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1679/3378] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:32 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:33.973220 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e89db627-fd37-47c7-b28e-670ec8c7bd98 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:33.973994 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e89db627-fd37-47c7-b28e-670ec8c7bd98 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:33.980816 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e89db627-fd37-47c7-b28e-670ec8c7bd98 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:33.981295 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e89db627-fd37-47c7-b28e-670ec8c7bd98 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:33.981763 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e89db627-fd37-47c7-b28e-670ec8c7bd98 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:33.982450 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e89db627-fd37-47c7-b28e-670ec8c7bd98 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:33.982910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e89db627-fd37-47c7-b28e-670ec8c7bd98 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:33.983598 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e89db627-fd37-47c7-b28e-670ec8c7bd98 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:34.112445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e89db627-fd37-47c7-b28e-670ec8c7bd98 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:34.120263 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e89db627-fd37-47c7-b28e-670ec8c7bd98 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1569 microversion: 2.1 time: 0.151032 Oct 28 20:46:34.120826 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1700/3379] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:33 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:35.143300 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-26f258a1-dff9-4c3e-ba27-60b1e7c73b62 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:35.143917 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-26f258a1-dff9-4c3e-ba27-60b1e7c73b62 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:35.152112 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26f258a1-dff9-4c3e-ba27-60b1e7c73b62 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:35.152597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26f258a1-dff9-4c3e-ba27-60b1e7c73b62 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:35.153041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26f258a1-dff9-4c3e-ba27-60b1e7c73b62 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:35.153757 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26f258a1-dff9-4c3e-ba27-60b1e7c73b62 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:35.154219 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26f258a1-dff9-4c3e-ba27-60b1e7c73b62 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:35.154648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26f258a1-dff9-4c3e-ba27-60b1e7c73b62 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:35.288703 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-26f258a1-dff9-4c3e-ba27-60b1e7c73b62 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:35.296315 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-26f258a1-dff9-4c3e-ba27-60b1e7c73b62 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1569 microversion: 2.1 time: 0.156851 Oct 28 20:46:35.296869 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1680/3380] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:35 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:36.318412 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b4ae98ea-1385-4a44-ac85-292b19b07b3b tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:36.319253 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b4ae98ea-1385-4a44-ac85-292b19b07b3b tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:36.325946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4ae98ea-1385-4a44-ac85-292b19b07b3b tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:36.326500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4ae98ea-1385-4a44-ac85-292b19b07b3b tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:36.326889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4ae98ea-1385-4a44-ac85-292b19b07b3b tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:36.327573 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4ae98ea-1385-4a44-ac85-292b19b07b3b tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:36.328017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4ae98ea-1385-4a44-ac85-292b19b07b3b tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:36.328434 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4ae98ea-1385-4a44-ac85-292b19b07b3b tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:36.463038 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-b4ae98ea-1385-4a44-ac85-292b19b07b3b tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:36.470808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b4ae98ea-1385-4a44-ac85-292b19b07b3b tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1569 microversion: 2.1 time: 0.156183 Oct 28 20:46:36.471377 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1701/3381] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:36 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:37.494743 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1554e990-a46f-4267-a7eb-4f7149fb71ce tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:37.495334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1554e990-a46f-4267-a7eb-4f7149fb71ce tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:37.501774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1554e990-a46f-4267-a7eb-4f7149fb71ce tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:37.502253 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1554e990-a46f-4267-a7eb-4f7149fb71ce tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:37.502691 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1554e990-a46f-4267-a7eb-4f7149fb71ce tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:37.503370 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1554e990-a46f-4267-a7eb-4f7149fb71ce tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:37.503821 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1554e990-a46f-4267-a7eb-4f7149fb71ce tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:37.504265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1554e990-a46f-4267-a7eb-4f7149fb71ce tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:37.640131 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1554e990-a46f-4267-a7eb-4f7149fb71ce tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:37.647791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1554e990-a46f-4267-a7eb-4f7149fb71ce tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1569 microversion: 2.1 time: 0.156906 Oct 28 20:46:37.648357 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1681/3382] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:37 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:38.672578 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3eb0b50c-0794-44fc-86d8-7271ff80be68 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:38.673190 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3eb0b50c-0794-44fc-86d8-7271ff80be68 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:38.679560 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3eb0b50c-0794-44fc-86d8-7271ff80be68 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:38.680040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3eb0b50c-0794-44fc-86d8-7271ff80be68 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:38.680473 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3eb0b50c-0794-44fc-86d8-7271ff80be68 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:38.681154 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3eb0b50c-0794-44fc-86d8-7271ff80be68 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:38.681625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3eb0b50c-0794-44fc-86d8-7271ff80be68 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:38.682106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3eb0b50c-0794-44fc-86d8-7271ff80be68 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:38.919728 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-3eb0b50c-0794-44fc-86d8-7271ff80be68 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:38.928141 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3eb0b50c-0794-44fc-86d8-7271ff80be68 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1569 microversion: 2.1 time: 0.259475 Oct 28 20:46:38.928713 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1702/3383] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:38 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1569 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:39.952353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d7ca1a72-9343-4601-9442-8c8e486294a7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:39.953015 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d7ca1a72-9343-4601-9442-8c8e486294a7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:39.959525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7ca1a72-9343-4601-9442-8c8e486294a7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:39.960014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7ca1a72-9343-4601-9442-8c8e486294a7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:39.960462 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7ca1a72-9343-4601-9442-8c8e486294a7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:39.961151 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7ca1a72-9343-4601-9442-8c8e486294a7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:39.961643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7ca1a72-9343-4601-9442-8c8e486294a7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:39.962073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7ca1a72-9343-4601-9442-8c8e486294a7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:40.093650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d7ca1a72-9343-4601-9442-8c8e486294a7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:40.101458 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d7ca1a72-9343-4601-9442-8c8e486294a7 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1569 microversion: 2.1 time: 0.153660 Oct 28 20:46:40.102100 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1682/3384] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:39 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:41.126484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c30f0d3d-c9b7-4013-8e71-922fdb1354bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:41.132453 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c30f0d3d-c9b7-4013-8e71-922fdb1354bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:41.133198 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c30f0d3d-c9b7-4013-8e71-922fdb1354bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:41.133710 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c30f0d3d-c9b7-4013-8e71-922fdb1354bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:41.134151 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c30f0d3d-c9b7-4013-8e71-922fdb1354bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:41.134843 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c30f0d3d-c9b7-4013-8e71-922fdb1354bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:41.135309 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c30f0d3d-c9b7-4013-8e71-922fdb1354bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:41.135749 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c30f0d3d-c9b7-4013-8e71-922fdb1354bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:41.275548 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-c30f0d3d-c9b7-4013-8e71-922fdb1354bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:41.283924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c30f0d3d-c9b7-4013-8e71-922fdb1354bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1569 microversion: 2.1 time: 0.161537 Oct 28 20:46:41.284441 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1703/3385] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:41 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:46:42.308049 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d5c39815-4c0b-492a-80f1-e6174550b3c3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:42.308666 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d5c39815-4c0b-492a-80f1-e6174550b3c3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:42.316164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5c39815-4c0b-492a-80f1-e6174550b3c3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:42.316651 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5c39815-4c0b-492a-80f1-e6174550b3c3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:42.317093 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5c39815-4c0b-492a-80f1-e6174550b3c3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:42.317813 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5c39815-4c0b-492a-80f1-e6174550b3c3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:42.318274 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5c39815-4c0b-492a-80f1-e6174550b3c3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:42.318704 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5c39815-4c0b-492a-80f1-e6174550b3c3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:42.452387 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-d5c39815-4c0b-492a-80f1-e6174550b3c3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:42.461804 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d5c39815-4c0b-492a-80f1-e6174550b3c3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1510 microversion: 2.1 time: 0.157673 Oct 28 20:46:42.462382 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1683/3386] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:42 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:42.485307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1be4a272-f889-4835-bbc5-88cacdea2437 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:46:42.486040 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1be4a272-f889-4835-bbc5-88cacdea2437 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:42.492227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1be4a272-f889-4835-bbc5-88cacdea2437 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:42.492716 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1be4a272-f889-4835-bbc5-88cacdea2437 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:42.493161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1be4a272-f889-4835-bbc5-88cacdea2437 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:42.493874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1be4a272-f889-4835-bbc5-88cacdea2437 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:42.494329 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1be4a272-f889-4835-bbc5-88cacdea2437 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:42.494756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1be4a272-f889-4835-bbc5-88cacdea2437 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:42.644480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1be4a272-f889-4835-bbc5-88cacdea2437 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119407) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 20:46:42.949013 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1be4a272-f889-4835-bbc5-88cacdea2437 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [a6c6203f-d0f7-40a4-a08a-1f004f6679f9] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:46:43.908992 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-c3734bb2-ae89-4e83-918e-4d6eccc59c9c req-fa8370cf-edc3-4ec0-a7d3-f2210c590246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b775e781-f50c-4ea6-a803-6cff2219f02a", "name": "network-vif-unplugged", "status": "completed", "tag": "57d50b64-a05f-43d5-ae01-a156aa5b9e62"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:46:43.918362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c3734bb2-ae89-4e83-918e-4d6eccc59c9c req-fa8370cf-edc3-4ec0-a7d3-f2210c590246 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:43.918833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c3734bb2-ae89-4e83-918e-4d6eccc59c9c req-fa8370cf-edc3-4ec0-a7d3-f2210c590246 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:43.919261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c3734bb2-ae89-4e83-918e-4d6eccc59c9c req-fa8370cf-edc3-4ec0-a7d3-f2210c590246 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:43.930258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.compute.server_external_events [req-c3734bb2-ae89-4e83-918e-4d6eccc59c9c req-fa8370cf-edc3-4ec0-a7d3-f2210c590246 service nova] Unable to find a host for instance b775e781-f50c-4ea6-a803-6cff2219f02a. Dropping event network-vif-unplugged {{(pid=119406) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 20:46:43.931103 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-c3734bb2-ae89-4e83-918e-4d6eccc59c9c req-fa8370cf-edc3-4ec0-a7d3-f2210c590246 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.157187 Oct 28 20:46:43.931659 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1684/3387] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 158 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 28 20:46:43.959165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [None req-1be4a272-f889-4835-bbc5-88cacdea2437 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [a6c6203f-d0f7-40a4-a08a-1f004f6679f9] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 34964. Oct 28 20:46:43.962211 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1be4a272-f889-4835-bbc5-88cacdea2437 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "POST /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a/action" status: 202 len: 0 microversion: 2.1 time: 1.482139 Oct 28 20:46:43.963103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1704/3388] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Oct 28 20:46:42 2022] POST /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a/action => generated 0 bytes in 1483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:46:43.971091 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-efcca92e-c0fc-4793-bed1-3725de5318fb tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:43.971698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-efcca92e-c0fc-4793-bed1-3725de5318fb tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:43.977513 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efcca92e-c0fc-4793-bed1-3725de5318fb tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:43.977989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efcca92e-c0fc-4793-bed1-3725de5318fb tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:43.978424 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efcca92e-c0fc-4793-bed1-3725de5318fb tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:43.979107 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efcca92e-c0fc-4793-bed1-3725de5318fb tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:43.979556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efcca92e-c0fc-4793-bed1-3725de5318fb tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:43.979972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efcca92e-c0fc-4793-bed1-3725de5318fb tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:44.126833 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-efcca92e-c0fc-4793-bed1-3725de5318fb tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:44.134586 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-efcca92e-c0fc-4793-bed1-3725de5318fb tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1518 microversion: 2.1 time: 0.167686 Oct 28 20:46:44.135150 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1685/3389] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:43 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:45.158093 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-18816e3f-4a52-4f7f-909f-60793e485eb3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:45.158733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-18816e3f-4a52-4f7f-909f-60793e485eb3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:45.165479 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18816e3f-4a52-4f7f-909f-60793e485eb3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:45.165962 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18816e3f-4a52-4f7f-909f-60793e485eb3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:45.166400 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18816e3f-4a52-4f7f-909f-60793e485eb3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:45.167083 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18816e3f-4a52-4f7f-909f-60793e485eb3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:45.167532 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18816e3f-4a52-4f7f-909f-60793e485eb3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:45.167954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18816e3f-4a52-4f7f-909f-60793e485eb3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:45.301773 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-18816e3f-4a52-4f7f-909f-60793e485eb3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:45.309940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-18816e3f-4a52-4f7f-909f-60793e485eb3 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1518 microversion: 2.1 time: 0.156227 Oct 28 20:46:45.310509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1705/3390] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:45 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:46.335202 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-20ffbbab-8be3-46da-9dfe-0c0a38407cee tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:46.335742 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-20ffbbab-8be3-46da-9dfe-0c0a38407cee tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:46.342118 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20ffbbab-8be3-46da-9dfe-0c0a38407cee tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:46.342595 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20ffbbab-8be3-46da-9dfe-0c0a38407cee tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:46.343024 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20ffbbab-8be3-46da-9dfe-0c0a38407cee tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:46.343699 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20ffbbab-8be3-46da-9dfe-0c0a38407cee tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:46.344146 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20ffbbab-8be3-46da-9dfe-0c0a38407cee tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:46.345208 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20ffbbab-8be3-46da-9dfe-0c0a38407cee tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:46.480694 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-20ffbbab-8be3-46da-9dfe-0c0a38407cee tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:46.490486 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-20ffbbab-8be3-46da-9dfe-0c0a38407cee tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1518 microversion: 2.1 time: 0.159104 Oct 28 20:46:46.491072 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1686/3391] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:46 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:47.513243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78193fe7-8203-49cf-96d0-626f9dc306ff tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:47.513886 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-78193fe7-8203-49cf-96d0-626f9dc306ff tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:47.521149 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78193fe7-8203-49cf-96d0-626f9dc306ff tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:47.521699 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78193fe7-8203-49cf-96d0-626f9dc306ff tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:47.522138 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78193fe7-8203-49cf-96d0-626f9dc306ff tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:47.522828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78193fe7-8203-49cf-96d0-626f9dc306ff tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:47.523275 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78193fe7-8203-49cf-96d0-626f9dc306ff tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:47.523694 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78193fe7-8203-49cf-96d0-626f9dc306ff tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:47.655236 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-78193fe7-8203-49cf-96d0-626f9dc306ff tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:47.663239 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-78193fe7-8203-49cf-96d0-626f9dc306ff tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1518 microversion: 2.1 time: 0.153873 Oct 28 20:46:47.663811 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1706/3392] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:47 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:48.686515 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f355abb8-8092-4bc0-8188-1c23d1461759 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:48.687170 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f355abb8-8092-4bc0-8188-1c23d1461759 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:48.693808 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f355abb8-8092-4bc0-8188-1c23d1461759 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:48.694293 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f355abb8-8092-4bc0-8188-1c23d1461759 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:48.694730 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f355abb8-8092-4bc0-8188-1c23d1461759 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:48.695421 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f355abb8-8092-4bc0-8188-1c23d1461759 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:48.695882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f355abb8-8092-4bc0-8188-1c23d1461759 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:48.696307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f355abb8-8092-4bc0-8188-1c23d1461759 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:48.830972 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-f355abb8-8092-4bc0-8188-1c23d1461759 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:48.840261 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f355abb8-8092-4bc0-8188-1c23d1461759 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1518 microversion: 2.1 time: 0.157349 Oct 28 20:46:48.841016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1687/3393] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:48 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:49.865270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f18c46d0-8961-4b2d-addb-1275b5a74e99 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:49.865929 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f18c46d0-8961-4b2d-addb-1275b5a74e99 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:49.872404 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f18c46d0-8961-4b2d-addb-1275b5a74e99 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:49.872875 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f18c46d0-8961-4b2d-addb-1275b5a74e99 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:49.873305 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f18c46d0-8961-4b2d-addb-1275b5a74e99 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:49.874000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f18c46d0-8961-4b2d-addb-1275b5a74e99 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:49.874626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f18c46d0-8961-4b2d-addb-1275b5a74e99 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:49.874854 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f18c46d0-8961-4b2d-addb-1275b5a74e99 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:50.015136 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f18c46d0-8961-4b2d-addb-1275b5a74e99 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:50.023100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f18c46d0-8961-4b2d-addb-1275b5a74e99 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1520 microversion: 2.1 time: 0.161969 Oct 28 20:46:50.031317 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1707/3394] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:49 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:51.047203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2a99d165-2963-43d6-93de-84e7b5c4f4bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:51.048960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2a99d165-2963-43d6-93de-84e7b5c4f4bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:51.055086 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a99d165-2963-43d6-93de-84e7b5c4f4bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:51.055676 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a99d165-2963-43d6-93de-84e7b5c4f4bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:51.056180 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a99d165-2963-43d6-93de-84e7b5c4f4bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:51.056940 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a99d165-2963-43d6-93de-84e7b5c4f4bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:51.057498 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a99d165-2963-43d6-93de-84e7b5c4f4bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:51.057930 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a99d165-2963-43d6-93de-84e7b5c4f4bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:51.264227 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2a99d165-2963-43d6-93de-84e7b5c4f4bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:51.272591 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2a99d165-2963-43d6-93de-84e7b5c4f4bf tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1576 microversion: 2.1 time: 0.229192 Oct 28 20:46:51.273161 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1688/3395] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:51 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1576 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:52.295912 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8ab8b3bc-aff8-47c3-ab85-c8b4e2f09cf8 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:52.296466 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8ab8b3bc-aff8-47c3-ab85-c8b4e2f09cf8 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:52.302873 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ab8b3bc-aff8-47c3-ab85-c8b4e2f09cf8 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:52.303355 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ab8b3bc-aff8-47c3-ab85-c8b4e2f09cf8 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:52.303792 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ab8b3bc-aff8-47c3-ab85-c8b4e2f09cf8 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:52.304477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ab8b3bc-aff8-47c3-ab85-c8b4e2f09cf8 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:52.304930 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ab8b3bc-aff8-47c3-ab85-c8b4e2f09cf8 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:52.305375 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ab8b3bc-aff8-47c3-ab85-c8b4e2f09cf8 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:52.433739 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8ab8b3bc-aff8-47c3-ab85-c8b4e2f09cf8 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:52.441633 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8ab8b3bc-aff8-47c3-ab85-c8b4e2f09cf8 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1576 microversion: 2.1 time: 0.149576 Oct 28 20:46:52.442225 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1708/3396] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:52 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:53.464342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2b8ebe9d-e0ee-497c-bc4f-77f6c56736ad tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:53.464958 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2b8ebe9d-e0ee-497c-bc4f-77f6c56736ad tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:53.471354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b8ebe9d-e0ee-497c-bc4f-77f6c56736ad tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:53.471837 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b8ebe9d-e0ee-497c-bc4f-77f6c56736ad tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:53.472273 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b8ebe9d-e0ee-497c-bc4f-77f6c56736ad tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:53.472964 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b8ebe9d-e0ee-497c-bc4f-77f6c56736ad tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:53.473449 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b8ebe9d-e0ee-497c-bc4f-77f6c56736ad tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:53.473873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b8ebe9d-e0ee-497c-bc4f-77f6c56736ad tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:53.603765 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2b8ebe9d-e0ee-497c-bc4f-77f6c56736ad tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:53.611676 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2b8ebe9d-e0ee-497c-bc4f-77f6c56736ad tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1576 microversion: 2.1 time: 0.151157 Oct 28 20:46:53.612238 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1689/3397] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:53 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:54.634781 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e446077a-300a-480c-a3bd-5aa9c0865a28 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:54.635381 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e446077a-300a-480c-a3bd-5aa9c0865a28 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:54.642000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e446077a-300a-480c-a3bd-5aa9c0865a28 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:54.642475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e446077a-300a-480c-a3bd-5aa9c0865a28 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:54.642906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e446077a-300a-480c-a3bd-5aa9c0865a28 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:54.643581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e446077a-300a-480c-a3bd-5aa9c0865a28 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:54.644028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e446077a-300a-480c-a3bd-5aa9c0865a28 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:54.644447 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e446077a-300a-480c-a3bd-5aa9c0865a28 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:54.779024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e446077a-300a-480c-a3bd-5aa9c0865a28 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:54.787495 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e446077a-300a-480c-a3bd-5aa9c0865a28 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1576 microversion: 2.1 time: 0.156467 Oct 28 20:46:54.788059 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1709/3398] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:54 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:55.811353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a62111c9-f8cc-426f-866b-690a7f8e1419 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:55.811967 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a62111c9-f8cc-426f-866b-690a7f8e1419 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:55.818041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a62111c9-f8cc-426f-866b-690a7f8e1419 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:55.818527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a62111c9-f8cc-426f-866b-690a7f8e1419 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:55.818965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a62111c9-f8cc-426f-866b-690a7f8e1419 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:55.819648 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a62111c9-f8cc-426f-866b-690a7f8e1419 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:55.820105 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a62111c9-f8cc-426f-866b-690a7f8e1419 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:55.820538 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a62111c9-f8cc-426f-866b-690a7f8e1419 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:55.951675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-a62111c9-f8cc-426f-866b-690a7f8e1419 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:55.960045 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a62111c9-f8cc-426f-866b-690a7f8e1419 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1576 microversion: 2.1 time: 0.152781 Oct 28 20:46:55.960605 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1690/3399] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:55 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:56.983870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7cd80ac2-13ff-4baa-aaf5-0fc498b4e005 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:56.985217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7cd80ac2-13ff-4baa-aaf5-0fc498b4e005 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:56.991750 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cd80ac2-13ff-4baa-aaf5-0fc498b4e005 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:56.992232 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cd80ac2-13ff-4baa-aaf5-0fc498b4e005 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:56.992670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cd80ac2-13ff-4baa-aaf5-0fc498b4e005 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:56.993380 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cd80ac2-13ff-4baa-aaf5-0fc498b4e005 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:56.993835 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cd80ac2-13ff-4baa-aaf5-0fc498b4e005 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:56.994256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cd80ac2-13ff-4baa-aaf5-0fc498b4e005 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:56.998402 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:46:57.123433 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-7cd80ac2-13ff-4baa-aaf5-0fc498b4e005 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:57.131120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7cd80ac2-13ff-4baa-aaf5-0fc498b4e005 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1576 microversion: 2.1 time: 0.151314 Oct 28 20:46:57.131678 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1710/3400] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:56 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:58.153938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1287f25d-0d20-414b-bee5-b2801b452e22 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:58.154584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1287f25d-0d20-414b-bee5-b2801b452e22 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:58.157800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=31 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:46:58.163438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1287f25d-0d20-414b-bee5-b2801b452e22 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:58.175996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1287f25d-0d20-414b-bee5-b2801b452e22 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:58.175996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1287f25d-0d20-414b-bee5-b2801b452e22 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:58.175996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1287f25d-0d20-414b-bee5-b2801b452e22 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:58.175996 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1287f25d-0d20-414b-bee5-b2801b452e22 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:58.176495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1287f25d-0d20-414b-bee5-b2801b452e22 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:58.176495 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=83 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:46:58.306845 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1287f25d-0d20-414b-bee5-b2801b452e22 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:58.315431 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1287f25d-0d20-414b-bee5-b2801b452e22 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1576 microversion: 2.1 time: 0.165413 Oct 28 20:46:58.316014 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1691/3401] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:58 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:59.339256 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a5a817d5-9a8e-4e24-b0f4-1696a5fb2089 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:46:59.339820 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a5a817d5-9a8e-4e24-b0f4-1696a5fb2089 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:46:59.342137 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:46:59.349812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5a817d5-9a8e-4e24-b0f4-1696a5fb2089 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:59.349812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5a817d5-9a8e-4e24-b0f4-1696a5fb2089 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:59.349812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5a817d5-9a8e-4e24-b0f4-1696a5fb2089 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:59.349812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5a817d5-9a8e-4e24-b0f4-1696a5fb2089 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:59.350252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5a817d5-9a8e-4e24-b0f4-1696a5fb2089 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:59.350252 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5a817d5-9a8e-4e24-b0f4-1696a5fb2089 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:59.484539 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a5a817d5-9a8e-4e24-b0f4-1696a5fb2089 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:46:59.492521 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a5a817d5-9a8e-4e24-b0f4-1696a5fb2089 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1576 microversion: 2.1 time: 0.157081 Oct 28 20:46:59.493087 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1711/3402] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:46:59 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:46:59.973440 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-074ddd8e-6e5c-4b9c-9a84-deb6a887a32a req-bcb67779-fa47-4a4b-8247-51b9ea867a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b775e781-f50c-4ea6-a803-6cff2219f02a", "name": "network-vif-plugged", "status": "completed", "tag": "57d50b64-a05f-43d5-ae01-a156aa5b9e62"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:46:59.983195 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-074ddd8e-6e5c-4b9c-9a84-deb6a887a32a req-bcb67779-fa47-4a4b-8247-51b9ea867a99 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:46:59.983676 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-074ddd8e-6e5c-4b9c-9a84-deb6a887a32a req-bcb67779-fa47-4a4b-8247-51b9ea867a99 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:46:59.984675 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-074ddd8e-6e5c-4b9c-9a84-deb6a887a32a req-bcb67779-fa47-4a4b-8247-51b9ea867a99 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:46:59.995452 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-074ddd8e-6e5c-4b9c-9a84-deb6a887a32a req-bcb67779-fa47-4a4b-8247-51b9ea867a99 service nova] Creating event network-vif-plugged:57d50b64-a05f-43d5-ae01-a156aa5b9e62 for instance b775e781-f50c-4ea6-a803-6cff2219f02a on hv-cinder-86236 Oct 28 20:47:00.001304 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-074ddd8e-6e5c-4b9c-9a84-deb6a887a32a req-bcb67779-fa47-4a4b-8247-51b9ea867a99 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032594 Oct 28 20:47:00.006484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1692/3403] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:47:00.516974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f57700bc-c39e-48b8-9d8e-af865d75d394 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:00.517632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f57700bc-c39e-48b8-9d8e-af865d75d394 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:00.524231 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f57700bc-c39e-48b8-9d8e-af865d75d394 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:00.524719 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f57700bc-c39e-48b8-9d8e-af865d75d394 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:00.525158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f57700bc-c39e-48b8-9d8e-af865d75d394 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:00.525889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f57700bc-c39e-48b8-9d8e-af865d75d394 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:00.526464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f57700bc-c39e-48b8-9d8e-af865d75d394 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:00.526828 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f57700bc-c39e-48b8-9d8e-af865d75d394 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:00.664960 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f57700bc-c39e-48b8-9d8e-af865d75d394 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:00.673906 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f57700bc-c39e-48b8-9d8e-af865d75d394 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1576 microversion: 2.1 time: 0.161097 Oct 28 20:47:00.674903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1712/3404] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:00 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:01.700491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aab395a3-bb21-46b4-85cc-a4d8763d1151 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:01.701194 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aab395a3-bb21-46b4-85cc-a4d8763d1151 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:01.707507 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aab395a3-bb21-46b4-85cc-a4d8763d1151 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:01.707993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aab395a3-bb21-46b4-85cc-a4d8763d1151 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:01.708434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aab395a3-bb21-46b4-85cc-a4d8763d1151 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:01.709119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aab395a3-bb21-46b4-85cc-a4d8763d1151 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:01.709604 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aab395a3-bb21-46b4-85cc-a4d8763d1151 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:01.710024 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aab395a3-bb21-46b4-85cc-a4d8763d1151 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:01.841752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-aab395a3-bb21-46b4-85cc-a4d8763d1151 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:01.850311 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aab395a3-bb21-46b4-85cc-a4d8763d1151 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1563 microversion: 2.1 time: 0.154691 Oct 28 20:47:01.850881 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1693/3405] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:01 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:47:29.571029 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5419e8f3-f0d2-4650-885e-899597a0de8a tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Action: 'create', calling method: .version_select at 0x7f1f4cf17160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1893421814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpZ3DjN15xRzM+W2ODNXleQPfAI92AB5Z/P7e98cMNdX3nlefogsZyL3vhe+qUsnyP8WnXWO42AJyW7TOitW2QfUrCWHaC1KkTKwR6g5H3JIZVSHY1PNg5PMR9+Azg7ZA=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:47:29.576953 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:47:29.577691 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=16 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:47:29.590117 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-5419e8f3-f0d2-4650-885e-899597a0de8a tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Getting quotas for project 7b5c9ffe3749453b8d677e173d102be1. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:47:29.594208 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.quota [None req-5419e8f3-f0d2-4650-885e-899597a0de8a tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Getting quotas for user 8daa1cb0ade042589bc26ecaaf59b0f7 and project 7b5c9ffe3749453b8d677e173d102be1. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:47:29.607167 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5419e8f3-f0d2-4650-885e-899597a0de8a tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [0bc930ec-6817-4a62-847d-456c972b3902] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:47:30.613653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [None req-5419e8f3-f0d2-4650-885e-899597a0de8a tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [0bc930ec-6817-4a62-847d-456c972b3902] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 35256. Oct 28 20:47:30.711497 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5419e8f3-f0d2-4650-885e-899597a0de8a tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.144681 Oct 28 20:47:30.712096 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1713/3406] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Oct 28 20:47:29 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:47:30.764978 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1617326198", "imageRef": "4e39efc0-7049-4f3e-ad1b-2f20227bdc1f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1893421814", "networks": [{"uuid": "08486017-9b83-4bec-81f1-a675460e1489"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:47:30.774482 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:47:30.774630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:47:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.66) !!! Oct 28 20:47:30.776085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:47:30.776206 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Fri Oct 28 20:47:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.66) !!! Oct 28 20:47:30.777526 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=5 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:47:30.778263 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=13 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:47:30.825867 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] validate_networks() for [('08486017-9b83-4bec-81f1-a675460e1489', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:47:31.535435 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:47:31.535857 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:47:31.536328 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:47:31.536738 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:47:31.537252 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:47:31.546203 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:31.546705 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:31.547132 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:31.547854 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:31.548909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:31.549364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:31.566525 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Getting quotas for project 7b5c9ffe3749453b8d677e173d102be1. Resources: {'instances', 'ram', 'cores'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:47:31.570374 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.quota [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Getting quotas for user 8daa1cb0ade042589bc26ecaaf59b0f7 and project 7b5c9ffe3749453b8d677e173d102be1. Resources: {'instances', 'ram', 'cores'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:47:31.582162 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:47:31.584354 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4e39efc0-7049-4f3e-ad1b-2f20227bdc1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:47:31.741220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dd15ce39-797a-43fa-9e5b-14e4063e883b tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980253 Oct 28 20:47:31.741922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1694/3407] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Oct 28 20:47:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:47:31.754325 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-06bf4783-b5f5-437c-b489-821e19992942 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:31.754948 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-06bf4783-b5f5-437c-b489-821e19992942 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:31.808286 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-06bf4783-b5f5-437c-b489-821e19992942 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:31.816488 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-06bf4783-b5f5-437c-b489-821e19992942 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1259 microversion: 2.1 time: 0.066930 Oct 28 20:47:31.817037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1714/3408] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:31 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:32.839845 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7be5effe-118e-4a25-be6b-79b82a7181c1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:32.840417 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7be5effe-118e-4a25-be6b-79b82a7181c1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:32.897624 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-7be5effe-118e-4a25-be6b-79b82a7181c1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:32.904520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7be5effe-118e-4a25-be6b-79b82a7181c1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1259 microversion: 2.1 time: 0.069381 Oct 28 20:47:32.905078 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1695/3409] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:32 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:33.929740 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-18ce7555-31c2-4a10-9bbb-643552a9e50e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:33.930327 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-18ce7555-31c2-4a10-9bbb-643552a9e50e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:33.937247 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18ce7555-31c2-4a10-9bbb-643552a9e50e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:33.937764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18ce7555-31c2-4a10-9bbb-643552a9e50e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:33.938205 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18ce7555-31c2-4a10-9bbb-643552a9e50e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:33.938893 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18ce7555-31c2-4a10-9bbb-643552a9e50e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:33.939346 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18ce7555-31c2-4a10-9bbb-643552a9e50e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:33.940011 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18ce7555-31c2-4a10-9bbb-643552a9e50e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:34.001599 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-18ce7555-31c2-4a10-9bbb-643552a9e50e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:34.009468 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-18ce7555-31c2-4a10-9bbb-643552a9e50e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1311 microversion: 2.1 time: 0.083924 Oct 28 20:47:34.015140 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1715/3410] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:33 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:35.033631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b06ecd8b-f91d-43de-a38a-1be9aa62c5c0 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:35.034175 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b06ecd8b-f91d-43de-a38a-1be9aa62c5c0 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:35.051017 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b06ecd8b-f91d-43de-a38a-1be9aa62c5c0 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:35.052598 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b06ecd8b-f91d-43de-a38a-1be9aa62c5c0 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:35.053061 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b06ecd8b-f91d-43de-a38a-1be9aa62c5c0 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:35.053839 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b06ecd8b-f91d-43de-a38a-1be9aa62c5c0 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:35.054308 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b06ecd8b-f91d-43de-a38a-1be9aa62c5c0 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:35.057450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b06ecd8b-f91d-43de-a38a-1be9aa62c5c0 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:35.250102 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-b06ecd8b-f91d-43de-a38a-1be9aa62c5c0 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:35.260811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b06ecd8b-f91d-43de-a38a-1be9aa62c5c0 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1359 microversion: 2.1 time: 0.230781 Oct 28 20:47:35.261954 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1696/3411] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:35 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:36.284212 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2d4182e1-d1d4-4989-b9a0-7b8ebf05ae43 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:36.286166 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2d4182e1-d1d4-4989-b9a0-7b8ebf05ae43 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:36.293439 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d4182e1-d1d4-4989-b9a0-7b8ebf05ae43 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:36.294003 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d4182e1-d1d4-4989-b9a0-7b8ebf05ae43 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:36.294445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d4182e1-d1d4-4989-b9a0-7b8ebf05ae43 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:36.295154 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d4182e1-d1d4-4989-b9a0-7b8ebf05ae43 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:36.295618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d4182e1-d1d4-4989-b9a0-7b8ebf05ae43 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:36.296045 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d4182e1-d1d4-4989-b9a0-7b8ebf05ae43 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:36.443591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-2d4182e1-d1d4-4989-b9a0-7b8ebf05ae43 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:36.451100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2d4182e1-d1d4-4989-b9a0-7b8ebf05ae43 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1359 microversion: 2.1 time: 0.171092 Oct 28 20:47:36.451665 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1716/3412] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:36 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:37.475925 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9c9d7b97-b662-427b-9701-01f32f26139f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:37.476667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9c9d7b97-b662-427b-9701-01f32f26139f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:37.483610 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c9d7b97-b662-427b-9701-01f32f26139f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:37.484110 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c9d7b97-b662-427b-9701-01f32f26139f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:37.484557 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c9d7b97-b662-427b-9701-01f32f26139f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:37.485289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c9d7b97-b662-427b-9701-01f32f26139f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:37.485823 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c9d7b97-b662-427b-9701-01f32f26139f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:37.486284 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c9d7b97-b662-427b-9701-01f32f26139f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:37.646774 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-9c9d7b97-b662-427b-9701-01f32f26139f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:37.654588 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9c9d7b97-b662-427b-9701-01f32f26139f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1359 microversion: 2.1 time: 0.184036 Oct 28 20:47:37.655404 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1697/3413] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:37 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:47:38.678676 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8f01df21-5717-485e-9e29-2ef49069f166 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:38.679354 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8f01df21-5717-485e-9e29-2ef49069f166 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:38.685788 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f01df21-5717-485e-9e29-2ef49069f166 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:38.686258 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f01df21-5717-485e-9e29-2ef49069f166 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:38.686684 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f01df21-5717-485e-9e29-2ef49069f166 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:38.687361 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f01df21-5717-485e-9e29-2ef49069f166 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:38.687802 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f01df21-5717-485e-9e29-2ef49069f166 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:38.688217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f01df21-5717-485e-9e29-2ef49069f166 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:38.832921 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-8f01df21-5717-485e-9e29-2ef49069f166 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:38.840368 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8f01df21-5717-485e-9e29-2ef49069f166 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1359 microversion: 2.1 time: 0.165700 Oct 28 20:47:38.840923 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1717/3414] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:38 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:39.864993 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bbe4a1d9-033d-4716-92b6-750291051960 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:39.865643 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bbe4a1d9-033d-4716-92b6-750291051960 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:39.871938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbe4a1d9-033d-4716-92b6-750291051960 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:39.872414 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbe4a1d9-033d-4716-92b6-750291051960 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:39.872844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbe4a1d9-033d-4716-92b6-750291051960 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:39.873556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbe4a1d9-033d-4716-92b6-750291051960 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:39.874010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbe4a1d9-033d-4716-92b6-750291051960 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:39.874429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bbe4a1d9-033d-4716-92b6-750291051960 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:40.009874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-bbe4a1d9-033d-4716-92b6-750291051960 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:40.020156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bbe4a1d9-033d-4716-92b6-750291051960 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1359 microversion: 2.1 time: 0.159726 Oct 28 20:47:40.025756 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1698/3415] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:39 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:41.044306 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9759c920-48e9-45e8-8235-87ecc9f5b2b6 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:41.044905 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9759c920-48e9-45e8-8235-87ecc9f5b2b6 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:41.051954 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9759c920-48e9-45e8-8235-87ecc9f5b2b6 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:41.052446 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9759c920-48e9-45e8-8235-87ecc9f5b2b6 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:41.052889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9759c920-48e9-45e8-8235-87ecc9f5b2b6 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:41.058650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9759c920-48e9-45e8-8235-87ecc9f5b2b6 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:41.058650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9759c920-48e9-45e8-8235-87ecc9f5b2b6 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:41.058650 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9759c920-48e9-45e8-8235-87ecc9f5b2b6 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:41.205643 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-9759c920-48e9-45e8-8235-87ecc9f5b2b6 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:41.214579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9759c920-48e9-45e8-8235-87ecc9f5b2b6 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1359 microversion: 2.1 time: 0.174578 Oct 28 20:47:41.215158 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1718/3416] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:41 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:42.239218 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-09589700-dc9c-41d6-91e4-d61f7710aa7f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:42.240011 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-09589700-dc9c-41d6-91e4-d61f7710aa7f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:42.244016 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:47:42.247676 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09589700-dc9c-41d6-91e4-d61f7710aa7f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:42.248235 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09589700-dc9c-41d6-91e4-d61f7710aa7f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:42.248741 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09589700-dc9c-41d6-91e4-d61f7710aa7f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:42.249593 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09589700-dc9c-41d6-91e4-d61f7710aa7f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:42.250127 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09589700-dc9c-41d6-91e4-d61f7710aa7f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:42.250630 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09589700-dc9c-41d6-91e4-d61f7710aa7f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:42.411768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-09589700-dc9c-41d6-91e4-d61f7710aa7f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:42.420597 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-09589700-dc9c-41d6-91e4-d61f7710aa7f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1359 microversion: 2.1 time: 0.186228 Oct 28 20:47:42.421181 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1699/3417] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:42 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:43.443733 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d9565240-9622-471a-86ad-ac9e99f51788 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:43.444353 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d9565240-9622-471a-86ad-ac9e99f51788 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:43.446214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:47:43.450898 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9565240-9622-471a-86ad-ac9e99f51788 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:43.451372 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9565240-9622-471a-86ad-ac9e99f51788 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:43.451808 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9565240-9622-471a-86ad-ac9e99f51788 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:43.452493 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9565240-9622-471a-86ad-ac9e99f51788 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:43.452974 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9565240-9622-471a-86ad-ac9e99f51788 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:43.453421 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9565240-9622-471a-86ad-ac9e99f51788 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:43.583120 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d9565240-9622-471a-86ad-ac9e99f51788 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:43.590712 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d9565240-9622-471a-86ad-ac9e99f51788 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1359 microversion: 2.1 time: 0.151212 Oct 28 20:47:43.591265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1719/3418] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:43 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:44.614346 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1194b792-fad4-4161-8078-156697cfb078 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:44.616070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1194b792-fad4-4161-8078-156697cfb078 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:44.616944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:47:44.622140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1194b792-fad4-4161-8078-156697cfb078 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:44.622631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1194b792-fad4-4161-8078-156697cfb078 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:44.623073 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1194b792-fad4-4161-8078-156697cfb078 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:44.623768 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1194b792-fad4-4161-8078-156697cfb078 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:44.624224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1194b792-fad4-4161-8078-156697cfb078 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:44.624650 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1194b792-fad4-4161-8078-156697cfb078 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:44.798667 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1194b792-fad4-4161-8078-156697cfb078 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:44.806307 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1194b792-fad4-4161-8078-156697cfb078 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1359 microversion: 2.1 time: 0.195931 Oct 28 20:47:44.806876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1700/3419] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:44 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:44.993100 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-3fb61379-1b31-468e-b83c-2872997a4dbe req-ecadf540-9dee-4799-9ef6-57e5745ea7ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3fe572-09d1-4a0c-a220-324cf61ab8df", "tag": "cc979357-8791-4ca1-8418-3b1a99022b5f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:47:45.002440 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3fb61379-1b31-468e-b83c-2872997a4dbe req-ecadf540-9dee-4799-9ef6-57e5745ea7ba service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:45.002924 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3fb61379-1b31-468e-b83c-2872997a4dbe req-ecadf540-9dee-4799-9ef6-57e5745ea7ba service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:45.003348 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3fb61379-1b31-468e-b83c-2872997a4dbe req-ecadf540-9dee-4799-9ef6-57e5745ea7ba service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:45.015046 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-3fb61379-1b31-468e-b83c-2872997a4dbe req-ecadf540-9dee-4799-9ef6-57e5745ea7ba service nova] Creating event network-changed:cc979357-8791-4ca1-8418-3b1a99022b5f for instance dd3fe572-09d1-4a0c-a220-324cf61ab8df on hv-cinder-86236 Oct 28 20:47:45.020491 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-3fb61379-1b31-468e-b83c-2872997a4dbe req-ecadf540-9dee-4799-9ef6-57e5745ea7ba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166919 Oct 28 20:47:45.021103 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1720/3420] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:47:45.829145 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2ecc84a0-fe9d-4287-b199-86afc8c2045d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:45.829789 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2ecc84a0-fe9d-4287-b199-86afc8c2045d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:45.836681 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ecc84a0-fe9d-4287-b199-86afc8c2045d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:45.837170 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ecc84a0-fe9d-4287-b199-86afc8c2045d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:45.837641 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ecc84a0-fe9d-4287-b199-86afc8c2045d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:45.838327 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ecc84a0-fe9d-4287-b199-86afc8c2045d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:45.838786 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ecc84a0-fe9d-4287-b199-86afc8c2045d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:45.839214 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ecc84a0-fe9d-4287-b199-86afc8c2045d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:45.968989 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-2ecc84a0-fe9d-4287-b199-86afc8c2045d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:45.977508 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2ecc84a0-fe9d-4287-b199-86afc8c2045d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1359 microversion: 2.1 time: 0.152167 Oct 28 20:47:45.978071 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1701/3421] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:45 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:47.001507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d93af5f0-59a2-4a17-b289-c1387996d471 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:47.002243 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d93af5f0-59a2-4a17-b289-c1387996d471 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:47.008285 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d93af5f0-59a2-4a17-b289-c1387996d471 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:47.008760 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d93af5f0-59a2-4a17-b289-c1387996d471 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:47.009186 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d93af5f0-59a2-4a17-b289-c1387996d471 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:47.009894 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d93af5f0-59a2-4a17-b289-c1387996d471 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:47.010341 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d93af5f0-59a2-4a17-b289-c1387996d471 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:47.010756 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d93af5f0-59a2-4a17-b289-c1387996d471 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:47.145085 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-d93af5f0-59a2-4a17-b289-c1387996d471 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:47.152559 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d93af5f0-59a2-4a17-b289-c1387996d471 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1359 microversion: 2.1 time: 0.155748 Oct 28 20:47:47.153250 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1721/3422] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:46 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:48.175722 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0860dcaa-11ca-4a23-869c-4c29497f894f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:48.184602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0860dcaa-11ca-4a23-869c-4c29497f894f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:48.184602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0860dcaa-11ca-4a23-869c-4c29497f894f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:48.184602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0860dcaa-11ca-4a23-869c-4c29497f894f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:48.184602 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0860dcaa-11ca-4a23-869c-4c29497f894f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:48.185155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0860dcaa-11ca-4a23-869c-4c29497f894f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:48.185155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0860dcaa-11ca-4a23-869c-4c29497f894f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:48.185155 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0860dcaa-11ca-4a23-869c-4c29497f894f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:48.317265 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-0860dcaa-11ca-4a23-869c-4c29497f894f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:48.324960 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0860dcaa-11ca-4a23-869c-4c29497f894f tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1359 microversion: 2.1 time: 0.153789 Oct 28 20:47:48.325551 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1702/3423] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:48 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:49.348551 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-37eacaaa-b51b-40bf-99db-e08b230af8ee tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:49.349089 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-37eacaaa-b51b-40bf-99db-e08b230af8ee tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:49.355483 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37eacaaa-b51b-40bf-99db-e08b230af8ee tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:49.356214 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37eacaaa-b51b-40bf-99db-e08b230af8ee tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:49.356645 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37eacaaa-b51b-40bf-99db-e08b230af8ee tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:49.357351 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37eacaaa-b51b-40bf-99db-e08b230af8ee tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:49.357806 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37eacaaa-b51b-40bf-99db-e08b230af8ee tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:49.358227 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37eacaaa-b51b-40bf-99db-e08b230af8ee tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:49.488849 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-37eacaaa-b51b-40bf-99db-e08b230af8ee tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:49.496389 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-37eacaaa-b51b-40bf-99db-e08b230af8ee tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1359 microversion: 2.1 time: 0.152376 Oct 28 20:47:49.496959 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1722/3424] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:49 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:50.303071 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b1eb56dc-cf55-49cf-b6e4-636d1d4c9da5 req-8a0ade39-3145-44c2-8508-6365240a7809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3fe572-09d1-4a0c-a220-324cf61ab8df", "name": "network-vif-plugged", "status": "completed", "tag": "cc979357-8791-4ca1-8418-3b1a99022b5f"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:47:50.312800 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b1eb56dc-cf55-49cf-b6e4-636d1d4c9da5 req-8a0ade39-3145-44c2-8508-6365240a7809 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:50.313272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b1eb56dc-cf55-49cf-b6e4-636d1d4c9da5 req-8a0ade39-3145-44c2-8508-6365240a7809 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:50.313731 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b1eb56dc-cf55-49cf-b6e4-636d1d4c9da5 req-8a0ade39-3145-44c2-8508-6365240a7809 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:50.325281 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b1eb56dc-cf55-49cf-b6e4-636d1d4c9da5 req-8a0ade39-3145-44c2-8508-6365240a7809 service nova] Creating event network-vif-plugged:cc979357-8791-4ca1-8418-3b1a99022b5f for instance dd3fe572-09d1-4a0c-a220-324cf61ab8df on hv-cinder-86236 Oct 28 20:47:50.331025 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b1eb56dc-cf55-49cf-b6e4-636d1d4c9da5 req-8a0ade39-3145-44c2-8508-6365240a7809 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031643 Oct 28 20:47:50.334097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1703/3425] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:47:50.520364 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fafe87e2-629a-479c-b41c-204c262bea98 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:50.520983 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fafe87e2-629a-479c-b41c-204c262bea98 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:50.527481 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fafe87e2-629a-479c-b41c-204c262bea98 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:50.527963 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fafe87e2-629a-479c-b41c-204c262bea98 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:50.528401 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fafe87e2-629a-479c-b41c-204c262bea98 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:50.529090 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fafe87e2-629a-479c-b41c-204c262bea98 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:50.529624 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fafe87e2-629a-479c-b41c-204c262bea98 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:50.530055 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fafe87e2-629a-479c-b41c-204c262bea98 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:50.706339 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-fafe87e2-629a-479c-b41c-204c262bea98 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:50.714861 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fafe87e2-629a-479c-b41c-204c262bea98 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1359 microversion: 2.1 time: 0.199034 Oct 28 20:47:50.715475 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1723/3426] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:50 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:51.739758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-11d31b05-8d76-4388-ac9d-d5126cc8416e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:51.740489 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-11d31b05-8d76-4388-ac9d-d5126cc8416e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:51.746698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11d31b05-8d76-4388-ac9d-d5126cc8416e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:51.747179 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11d31b05-8d76-4388-ac9d-d5126cc8416e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:51.747618 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11d31b05-8d76-4388-ac9d-d5126cc8416e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:51.748301 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11d31b05-8d76-4388-ac9d-d5126cc8416e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:51.748752 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11d31b05-8d76-4388-ac9d-d5126cc8416e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:51.749179 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11d31b05-8d76-4388-ac9d-d5126cc8416e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:51.878085 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-11d31b05-8d76-4388-ac9d-d5126cc8416e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:51.885751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-11d31b05-8d76-4388-ac9d-d5126cc8416e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1359 microversion: 2.1 time: 0.151443 Oct 28 20:47:51.886334 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1704/3427] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:51 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:52.908017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-96f28e4c-c05a-4f94-8b82-40e49d1fcb08 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:52.908625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-96f28e4c-c05a-4f94-8b82-40e49d1fcb08 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:52.915116 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96f28e4c-c05a-4f94-8b82-40e49d1fcb08 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:52.915595 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96f28e4c-c05a-4f94-8b82-40e49d1fcb08 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:52.916035 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96f28e4c-c05a-4f94-8b82-40e49d1fcb08 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:52.916714 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96f28e4c-c05a-4f94-8b82-40e49d1fcb08 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:52.917163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96f28e4c-c05a-4f94-8b82-40e49d1fcb08 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:52.917618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96f28e4c-c05a-4f94-8b82-40e49d1fcb08 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:53.047801 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-96f28e4c-c05a-4f94-8b82-40e49d1fcb08 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:53.056528 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-96f28e4c-c05a-4f94-8b82-40e49d1fcb08 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1549 microversion: 2.1 time: 0.152406 Oct 28 20:47:53.057107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1724/3428] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:52 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:53.079362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8337dfda-1713-41dc-b38e-015be13d23f9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:53.080010 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8337dfda-1713-41dc-b38e-015be13d23f9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:53.087234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8337dfda-1713-41dc-b38e-015be13d23f9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:53.087718 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8337dfda-1713-41dc-b38e-015be13d23f9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:53.088156 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8337dfda-1713-41dc-b38e-015be13d23f9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:53.088841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8337dfda-1713-41dc-b38e-015be13d23f9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:53.089303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8337dfda-1713-41dc-b38e-015be13d23f9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:53.089751 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8337dfda-1713-41dc-b38e-015be13d23f9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:53.223140 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-8337dfda-1713-41dc-b38e-015be13d23f9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:53.231276 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8337dfda-1713-41dc-b38e-015be13d23f9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1549 microversion: 2.1 time: 0.155800 Oct 28 20:47:53.231844 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1705/3429] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:53 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:53.253196 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0d5c4852-037b-4a4f-83b6-f8b332c1783c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:53.258862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0d5c4852-037b-4a4f-83b6-f8b332c1783c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:53.259628 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0d5c4852-037b-4a4f-83b6-f8b332c1783c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Searching by: {'deleted': False, 'project_id': '7b5c9ffe3749453b8d677e173d102be1'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 20:47:53.266160 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d5c4852-037b-4a4f-83b6-f8b332c1783c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:53.266635 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d5c4852-037b-4a4f-83b6-f8b332c1783c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:53.267066 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d5c4852-037b-4a4f-83b6-f8b332c1783c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:53.267784 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d5c4852-037b-4a4f-83b6-f8b332c1783c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:53.268235 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d5c4852-037b-4a4f-83b6-f8b332c1783c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:53.268656 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d5c4852-037b-4a4f-83b6-f8b332c1783c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:53.358984 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-0d5c4852-037b-4a4f-83b6-f8b332c1783c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 20:47:53.450399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0d5c4852-037b-4a4f-83b6-f8b332c1783c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200894 Oct 28 20:47:53.450986 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1725/3430] 10.222.0.66 () {58 vars in 1125 bytes} [Fri Oct 28 20:47:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:47:53.463355 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03166142-cab9-46d0-a381-9a3b654e3ef1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:47:53.463970 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-03166142-cab9-46d0-a381-9a3b654e3ef1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:53.469912 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03166142-cab9-46d0-a381-9a3b654e3ef1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:53.470391 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03166142-cab9-46d0-a381-9a3b654e3ef1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:53.470819 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03166142-cab9-46d0-a381-9a3b654e3ef1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:53.471494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03166142-cab9-46d0-a381-9a3b654e3ef1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:53.471938 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03166142-cab9-46d0-a381-9a3b654e3ef1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:53.472985 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03166142-cab9-46d0-a381-9a3b654e3ef1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:53.598633 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-03166142-cab9-46d0-a381-9a3b654e3ef1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:47:53.606905 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-03166142-cab9-46d0-a381-9a3b654e3ef1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1549 microversion: 2.1 time: 0.147717 Oct 28 20:47:53.607457 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1706/3431] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:47:53 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:47:55.555637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1f80fa7b-cd2e-4396-bc1a-8687eab5e8e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b43e2a4d-9cb4-4626-a661-1fdec7bbf5d8"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:47:55.558021 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1f80fa7b-cd2e-4396-bc1a-8687eab5e8e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:47:55.564393 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f80fa7b-cd2e-4396-bc1a-8687eab5e8e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:55.564874 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f80fa7b-cd2e-4396-bc1a-8687eab5e8e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:55.565335 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f80fa7b-cd2e-4396-bc1a-8687eab5e8e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:55.566024 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f80fa7b-cd2e-4396-bc1a-8687eab5e8e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:47:55.566484 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f80fa7b-cd2e-4396-bc1a-8687eab5e8e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:47:55.566946 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f80fa7b-cd2e-4396-bc1a-8687eab5e8e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:47:56.294613 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1f80fa7b-cd2e-4396-bc1a-8687eab5e8e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "POST /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.743450 Oct 28 20:47:56.295297 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1726/3432] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Oct 28 20:47:55 2022] POST /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/os-volume_attachments => generated 194 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:48:03.886977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5c7362f1-7ad6-4d9f-ad18-1aa4a0901a7d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:03.890847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5c7362f1-7ad6-4d9f-ad18-1aa4a0901a7d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:03.890847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:48:03.890847 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=64 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:48:03.895084 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c7362f1-7ad6-4d9f-ad18-1aa4a0901a7d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:03.895565 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c7362f1-7ad6-4d9f-ad18-1aa4a0901a7d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:03.895997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c7362f1-7ad6-4d9f-ad18-1aa4a0901a7d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:03.897342 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c7362f1-7ad6-4d9f-ad18-1aa4a0901a7d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:03.897790 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c7362f1-7ad6-4d9f-ad18-1aa4a0901a7d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:03.898212 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c7362f1-7ad6-4d9f-ad18-1aa4a0901a7d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:04.029041 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-5c7362f1-7ad6-4d9f-ad18-1aa4a0901a7d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:04.037710 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5c7362f1-7ad6-4d9f-ad18-1aa4a0901a7d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1595 microversion: 2.1 time: 0.154422 Oct 28 20:48:04.038269 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1707/3433] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:03 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1595 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:48:06.258581 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:48:06.259584 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:48:06.260331 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:48:06.264708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-0e78e295-14e0-4227-b824-9a563cdef243 req-8ee2e568-3f0c-471b-a4d8-0109713ed64f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3fe572-09d1-4a0c-a220-324cf61ab8df", "tag": "cc979357-8791-4ca1-8418-3b1a99022b5f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:48:06.275643 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0e78e295-14e0-4227-b824-9a563cdef243 req-8ee2e568-3f0c-471b-a4d8-0109713ed64f service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:06.276238 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0e78e295-14e0-4227-b824-9a563cdef243 req-8ee2e568-3f0c-471b-a4d8-0109713ed64f service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:06.276767 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0e78e295-14e0-4227-b824-9a563cdef243 req-8ee2e568-3f0c-471b-a4d8-0109713ed64f service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:06.288949 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-0e78e295-14e0-4227-b824-9a563cdef243 req-8ee2e568-3f0c-471b-a4d8-0109713ed64f service nova] Creating event network-changed:cc979357-8791-4ca1-8418-3b1a99022b5f for instance dd3fe572-09d1-4a0c-a220-324cf61ab8df on hv-cinder-86236 Oct 28 20:48:06.294425 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-0e78e295-14e0-4227-b824-9a563cdef243 req-8ee2e568-3f0c-471b-a4d8-0109713ed64f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037246 Oct 28 20:48:06.294927 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1727/3434] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:48:09.295461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8a6c6a44-49b9-4f9f-aac0-77e7e2a6c347 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1323586663"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:48:09.295991 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8a6c6a44-49b9-4f9f-aac0-77e7e2a6c347 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:09.302893 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a6c6a44-49b9-4f9f-aac0-77e7e2a6c347 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:09.303472 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a6c6a44-49b9-4f9f-aac0-77e7e2a6c347 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:09.303907 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a6c6a44-49b9-4f9f-aac0-77e7e2a6c347 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:09.304584 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a6c6a44-49b9-4f9f-aac0-77e7e2a6c347 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:09.305031 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a6c6a44-49b9-4f9f-aac0-77e7e2a6c347 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:09.305491 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a6c6a44-49b9-4f9f-aac0-77e7e2a6c347 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:09.436556 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.network.security_group_api [None req-8a6c6a44-49b9-4f9f-aac0-77e7e2a6c347 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Adding security group 946abb42-e39d-4bac-bd15-72cee8c13d7e to port cc979357-8791-4ca1-8418-3b1a99022b5f Oct 28 20:48:09.853364 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8a6c6a44-49b9-4f9f-aac0-77e7e2a6c347 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "POST /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/action" status: 202 len: 0 microversion: 2.1 time: 0.561384 Oct 28 20:48:09.853673 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1708/3435] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Oct 28 20:48:09 2022] POST /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:48:09.865152 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a7ca666d-c2dc-42f6-8302-b184a54cbc0d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:09.866914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a7ca666d-c2dc-42f6-8302-b184a54cbc0d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:09.875717 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7ca666d-c2dc-42f6-8302-b184a54cbc0d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:09.876337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7ca666d-c2dc-42f6-8302-b184a54cbc0d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:09.876841 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7ca666d-c2dc-42f6-8302-b184a54cbc0d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:09.877940 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7ca666d-c2dc-42f6-8302-b184a54cbc0d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:09.878494 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7ca666d-c2dc-42f6-8302-b184a54cbc0d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:09.879010 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7ca666d-c2dc-42f6-8302-b184a54cbc0d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:09.887386 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-bd4d2391-2490-4a06-8025-bb74e520713b req-aeb876b4-53fd-440d-afb1-5842a630dae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3fe572-09d1-4a0c-a220-324cf61ab8df", "tag": "cc979357-8791-4ca1-8418-3b1a99022b5f"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:48:09.907882 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bd4d2391-2490-4a06-8025-bb74e520713b req-aeb876b4-53fd-440d-afb1-5842a630dae6 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:09.908717 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bd4d2391-2490-4a06-8025-bb74e520713b req-aeb876b4-53fd-440d-afb1-5842a630dae6 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:09.909744 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bd4d2391-2490-4a06-8025-bb74e520713b req-aeb876b4-53fd-440d-afb1-5842a630dae6 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:09.934535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-bd4d2391-2490-4a06-8025-bb74e520713b req-aeb876b4-53fd-440d-afb1-5842a630dae6 service nova] Creating event network-changed:cc979357-8791-4ca1-8418-3b1a99022b5f for instance dd3fe572-09d1-4a0c-a220-324cf61ab8df on hv-cinder-86236 Oct 28 20:48:09.940944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-bd4d2391-2490-4a06-8025-bb74e520713b req-aeb876b4-53fd-440d-afb1-5842a630dae6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056652 Oct 28 20:48:09.941980 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1709/3436] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:48:10.139289 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-a7ca666d-c2dc-42f6-8302-b184a54cbc0d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:10.152399 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a7ca666d-c2dc-42f6-8302-b184a54cbc0d tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1760 microversion: 2.1 time: 0.292990 Oct 28 20:48:10.152990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1728/3437] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:09 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1760 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:48:16.055401 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-91a505cf-4468-40f6-b1e5-851e4327cd50 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:16.055977 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-91a505cf-4468-40f6-b1e5-851e4327cd50 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:16.063827 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91a505cf-4468-40f6-b1e5-851e4327cd50 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:16.064599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91a505cf-4468-40f6-b1e5-851e4327cd50 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:16.064781 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91a505cf-4468-40f6-b1e5-851e4327cd50 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:16.065483 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91a505cf-4468-40f6-b1e5-851e4327cd50 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:16.065944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91a505cf-4468-40f6-b1e5-851e4327cd50 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:16.066373 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91a505cf-4468-40f6-b1e5-851e4327cd50 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:16.094029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-91a505cf-4468-40f6-b1e5-851e4327cd50 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:48:16.113700 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-18ca54ce-0b8f-44c4-a5b9-ebb5d3bae332 req-c8cda633-a13a-4779-b835-98f07bb52228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b775e781-f50c-4ea6-a803-6cff2219f02a", "tag": "57d50b64-a05f-43d5-ae01-a156aa5b9e62"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:48:16.124990 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-18ca54ce-0b8f-44c4-a5b9-ebb5d3bae332 req-c8cda633-a13a-4779-b835-98f07bb52228 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:16.125606 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-18ca54ce-0b8f-44c4-a5b9-ebb5d3bae332 req-c8cda633-a13a-4779-b835-98f07bb52228 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:16.126104 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-18ca54ce-0b8f-44c4-a5b9-ebb5d3bae332 req-c8cda633-a13a-4779-b835-98f07bb52228 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:16.138424 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-18ca54ce-0b8f-44c4-a5b9-ebb5d3bae332 req-c8cda633-a13a-4779-b835-98f07bb52228 service nova] Creating event network-changed:57d50b64-a05f-43d5-ae01-a156aa5b9e62 for instance b775e781-f50c-4ea6-a803-6cff2219f02a on hv-cinder-86236 Oct 28 20:48:16.143693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-18ca54ce-0b8f-44c4-a5b9-ebb5d3bae332 req-c8cda633-a13a-4779-b835-98f07bb52228 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096448 Oct 28 20:48:16.144369 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1729/3438] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:48:16.366000 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-91a505cf-4468-40f6-b1e5-851e4327cd50 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 204 len: 0 microversion: 2.1 time: 0.320850 Oct 28 20:48:16.367359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1710/3439] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:48:16 2022] DELETE /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:48:16.386571 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0dfcd2fe-67e9-469e-886e-232e28fdc9ea tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:16.387583 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0dfcd2fe-67e9-469e-886e-232e28fdc9ea tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:16.394130 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2fe-67e9-469e-886e-232e28fdc9ea tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:16.394942 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2fe-67e9-469e-886e-232e28fdc9ea tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:16.395479 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2fe-67e9-469e-886e-232e28fdc9ea tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:16.396284 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2fe-67e9-469e-886e-232e28fdc9ea tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:16.396870 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2fe-67e9-469e-886e-232e28fdc9ea tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:16.397950 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2fe-67e9-469e-886e-232e28fdc9ea tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:16.554748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-0dfcd2fe-67e9-469e-886e-232e28fdc9ea tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:16.563492 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0dfcd2fe-67e9-469e-886e-232e28fdc9ea tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1569 microversion: 2.1 time: 0.181116 Oct 28 20:48:16.564241 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1730/3440] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:16 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:48:17.589422 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b011e2c-99e3-4a72-865f-20d2f62e3412 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:17.590224 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b011e2c-99e3-4a72-865f-20d2f62e3412 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:17.596698 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b011e2c-99e3-4a72-865f-20d2f62e3412 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:17.597540 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b011e2c-99e3-4a72-865f-20d2f62e3412 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:17.598277 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b011e2c-99e3-4a72-865f-20d2f62e3412 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:17.599147 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b011e2c-99e3-4a72-865f-20d2f62e3412 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:17.599599 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b011e2c-99e3-4a72-865f-20d2f62e3412 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:17.600122 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b011e2c-99e3-4a72-865f-20d2f62e3412 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:17.761138 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-4b011e2c-99e3-4a72-865f-20d2f62e3412 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:17.770432 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b011e2c-99e3-4a72-865f-20d2f62e3412 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1569 microversion: 2.1 time: 0.186008 Oct 28 20:48:17.771101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1711/3441] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:17 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:48:18.467088 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-22bf8859-776e-4096-931b-40d9fb04f292 req-728ee40f-5ce7-45fa-860a-f5245e568104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b775e781-f50c-4ea6-a803-6cff2219f02a", "name": "network-vif-deleted", "tag": "57d50b64-a05f-43d5-ae01-a156aa5b9e62"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:48:18.481107 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-22bf8859-776e-4096-931b-40d9fb04f292 req-728ee40f-5ce7-45fa-860a-f5245e568104 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:18.481612 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-22bf8859-776e-4096-931b-40d9fb04f292 req-728ee40f-5ce7-45fa-860a-f5245e568104 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:18.482037 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-22bf8859-776e-4096-931b-40d9fb04f292 req-728ee40f-5ce7-45fa-860a-f5245e568104 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:18.493980 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-22bf8859-776e-4096-931b-40d9fb04f292 req-728ee40f-5ce7-45fa-860a-f5245e568104 service nova] Creating event network-vif-deleted:57d50b64-a05f-43d5-ae01-a156aa5b9e62 for instance b775e781-f50c-4ea6-a803-6cff2219f02a on hv-cinder-86236 Oct 28 20:48:18.499075 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-22bf8859-776e-4096-931b-40d9fb04f292 req-728ee40f-5ce7-45fa-860a-f5245e568104 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035675 Oct 28 20:48:18.499748 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1731/3442] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:48:18.795333 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ff8587b0-7016-476e-a0d4-456b814465e2 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:18.795952 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ff8587b0-7016-476e-a0d4-456b814465e2 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:18.801974 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff8587b0-7016-476e-a0d4-456b814465e2 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:18.802464 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff8587b0-7016-476e-a0d4-456b814465e2 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:18.802902 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff8587b0-7016-476e-a0d4-456b814465e2 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:18.803670 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff8587b0-7016-476e-a0d4-456b814465e2 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:18.804198 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff8587b0-7016-476e-a0d4-456b814465e2 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:18.804622 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff8587b0-7016-476e-a0d4-456b814465e2 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:18.872631 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-ff8587b0-7016-476e-a0d4-456b814465e2 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:18.883297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ff8587b0-7016-476e-a0d4-456b814465e2 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1220 microversion: 2.1 time: 0.089533 Oct 28 20:48:18.883297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1712/3443] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:18 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:48:19.905764 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58ad4290-1573-427d-816f-194ba9bc744d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:19.906445 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-58ad4290-1573-427d-816f-194ba9bc744d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:19.912726 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58ad4290-1573-427d-816f-194ba9bc744d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:19.913547 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58ad4290-1573-427d-816f-194ba9bc744d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:19.913992 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58ad4290-1573-427d-816f-194ba9bc744d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:19.914687 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58ad4290-1573-427d-816f-194ba9bc744d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:19.915165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58ad4290-1573-427d-816f-194ba9bc744d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:19.915576 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58ad4290-1573-427d-816f-194ba9bc744d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:19.948394 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58ad4290-1573-427d-816f-194ba9bc744d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:19.948872 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58ad4290-1573-427d-816f-194ba9bc744d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:19.949307 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58ad4290-1573-427d-816f-194ba9bc744d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:19.949774 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-58ad4290-1573-427d-816f-194ba9bc744d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lazy-loading 'fault' on Instance uuid b775e781-f50c-4ea6-a803-6cff2219f02a {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:48:19.992423 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-58ad4290-1573-427d-816f-194ba9bc744d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41ea52c88f1436188152eab37f47ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ea1131d80461da67996b2dc844f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:19.999337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-58ad4290-1573-427d-816f-194ba9bc744d tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 200 len: 1179 microversion: 2.1 time: 0.098527 Oct 28 20:48:19.999909 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1732/3444] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:19 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 1179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:48:21.023880 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cf487c9a-af7f-48e1-bed6-1fd03df2c8db tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:21.024486 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cf487c9a-af7f-48e1-bed6-1fd03df2c8db tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] [instance: b775e781-f50c-4ea6-a803-6cff2219f02a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:21.030879 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf487c9a-af7f-48e1-bed6-1fd03df2c8db tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:21.031359 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf487c9a-af7f-48e1-bed6-1fd03df2c8db tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:21.031951 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf487c9a-af7f-48e1-bed6-1fd03df2c8db tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:21.032459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf487c9a-af7f-48e1-bed6-1fd03df2c8db tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:21.032932 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf487c9a-af7f-48e1-bed6-1fd03df2c8db tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:21.033371 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf487c9a-af7f-48e1-bed6-1fd03df2c8db tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:21.046257 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-cf487c9a-af7f-48e1-bed6-1fd03df2c8db tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] HTTP exception thrown: Instance b775e781-f50c-4ea6-a803-6cff2219f02a could not be found. Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cf487c9a-af7f-48e1-bed6-1fd03df2c8db tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Request method failure captured: Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a HTTP/1.1 Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept: application/json Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Accept-Encoding: identity Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Connection: close Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Length: 0 Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Content-Type: application/json Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Host: 10.222.0.66 Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: Openstack-System-Scope: None Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.12 Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Auth-Token: gAAAAABjXD8DdRHjoJVlFWagcVvt0pmf7RQjph9MvHtGjo-RCGG_pHfGbC1sqTThidSWixB_2TTH6McGsBWq_anWbx5XHGAxoB4YwW5NRnB-M6dyF9-IOMci8q655IVjcs_0BOMhH-ai23NuXq9IwdcEoosqZ-mAK7ODz6gnSnYNL2R3smlK-Ck Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Id: None Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Domain-Name: None Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Identity-Status: Confirmed Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Is-Admin-Project: True Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Id: default Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Domain-Name: Default Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Id: 2d9ea1131d80461da67996b2dc844f49 Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Project-Name: tempest-TestShelveInstance-1309000872 Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Role: reader,member Oct 28 20:48:21.047876 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Roles: reader,member Oct 28 20:48:21.049494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2d9ea1131d80461da67996b2dc844f49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2d9ea1131d80461da67996b2dc844f49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2d9ea1131d80461da67996b2dc844f49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2d9ea1131d80461da67996b2dc844f49", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:48:21.049494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant: tempest-TestShelveInstance-1309000872 Oct 28 20:48:21.049494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Id: 2d9ea1131d80461da67996b2dc844f49 Oct 28 20:48:21.049494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestShelveInstance-1309000872 Oct 28 20:48:21.049494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User: tempest-TestShelveInstance-1309000872-project Oct 28 20:48:21.049494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Id: default Oct 28 20:48:21.049494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Domain-Name: Default Oct 28 20:48:21.049494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Id: d41ea52c88f1436188152eab37f47ab6 Oct 28 20:48:21.049494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: X-User-Name: tempest-TestShelveInstance-1309000872-project Oct 28 20:48:21.049494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: method: > Oct 28 20:48:21.049494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: exception: Instance b775e781-f50c-4ea6-a803-6cff2219f02a could not be found. Oct 28 20:48:21.049494 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: action_args: {'id': 'b775e781-f50c-4ea6-a803-6cff2219f02a'} Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b775e781-f50c-4ea6-a803-6cff2219f02a could not be found. Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:48:21.050539 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b775e781-f50c-4ea6-a803-6cff2219f02a could not be found. Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b775e781-f50c-4ea6-a803-6cff2219f02a could not be found. Oct 28 20:48:21.052012 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Oct 28 20:48:21.053921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cf487c9a-af7f-48e1-bed6-1fd03df2c8db tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Returning 404 to user: Instance b775e781-f50c-4ea6-a803-6cff2219f02a could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:48:21.053921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cf487c9a-af7f-48e1-bed6-1fd03df2c8db tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a" status: 404 len: 111 microversion: 2.1 time: 0.029812 Oct 28 20:48:21.053921 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1713/3445] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:21 2022] GET /compute/v2.1/servers/b775e781-f50c-4ea6-a803-6cff2219f02a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:48:21.245987 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-95552fb2-8510-420e-8be7-77f6b9752d34 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] Calling method '.version_select at 0x7f1f507a6b80>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:21.319969 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-95552fb2-8510-420e-8be7-77f6b9752d34 tempest-TestShelveInstance-1309000872 tempest-TestShelveInstance-1309000872-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1233854547" status: 202 len: 0 microversion: 2.1 time: 0.079158 Oct 28 20:48:21.320564 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1733/3446] 10.222.0.66 () {58 vars in 1254 bytes} [Fri Oct 28 20:48:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1233854547 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:48:25.149381 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c870229-9a70-43ee-91b3-02a079571a06 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:48:25.151707 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8c870229-9a70-43ee-91b3-02a079571a06 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:25.157771 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c870229-9a70-43ee-91b3-02a079571a06 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:25.158312 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c870229-9a70-43ee-91b3-02a079571a06 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:25.158754 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c870229-9a70-43ee-91b3-02a079571a06 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:25.159438 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c870229-9a70-43ee-91b3-02a079571a06 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:25.159891 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c870229-9a70-43ee-91b3-02a079571a06 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:25.160318 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c870229-9a70-43ee-91b3-02a079571a06 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:25.363119 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8c870229-9a70-43ee-91b3-02a079571a06 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "POST /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/action" status: 202 len: 0 microversion: 2.1 time: 0.217111 Oct 28 20:48:25.366309 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1714/3447] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Oct 28 20:48:25 2022] POST /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:48:25.373519 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94922d95-9305-4b57-888e-f674829e3b49 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:25.374145 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-94922d95-9305-4b57-888e-f674829e3b49 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:25.380865 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94922d95-9305-4b57-888e-f674829e3b49 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:25.381964 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94922d95-9305-4b57-888e-f674829e3b49 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:25.382165 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94922d95-9305-4b57-888e-f674829e3b49 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:25.382853 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94922d95-9305-4b57-888e-f674829e3b49 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:25.383303 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94922d95-9305-4b57-888e-f674829e3b49 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:25.383795 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94922d95-9305-4b57-888e-f674829e3b49 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:25.549121 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-94922d95-9305-4b57-888e-f674829e3b49 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:25.557630 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-94922d95-9305-4b57-888e-f674829e3b49 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1752 microversion: 2.1 time: 0.188626 Oct 28 20:48:25.558203 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1734/3448] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:25 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1752 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:48:26.581637 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88fc451b-06de-49ca-ae4b-8e9454bf6c96 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:26.582369 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-88fc451b-06de-49ca-ae4b-8e9454bf6c96 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:26.589611 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88fc451b-06de-49ca-ae4b-8e9454bf6c96 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:26.590353 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88fc451b-06de-49ca-ae4b-8e9454bf6c96 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:26.590791 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88fc451b-06de-49ca-ae4b-8e9454bf6c96 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:26.591484 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88fc451b-06de-49ca-ae4b-8e9454bf6c96 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:26.591935 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88fc451b-06de-49ca-ae4b-8e9454bf6c96 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:26.592358 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88fc451b-06de-49ca-ae4b-8e9454bf6c96 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:26.778758 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-88fc451b-06de-49ca-ae4b-8e9454bf6c96 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:26.791873 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-88fc451b-06de-49ca-ae4b-8e9454bf6c96 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1757 microversion: 2.1 time: 0.214321 Oct 28 20:48:26.792459 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1715/3449] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:26 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1757 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:48:27.816591 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e5b441fe-6977-4aad-868f-ddbaa79629be tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:27.817877 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e5b441fe-6977-4aad-868f-ddbaa79629be tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:27.827625 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5b441fe-6977-4aad-868f-ddbaa79629be tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:27.827883 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5b441fe-6977-4aad-868f-ddbaa79629be tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:27.828347 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5b441fe-6977-4aad-868f-ddbaa79629be tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:27.829065 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5b441fe-6977-4aad-868f-ddbaa79629be tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:27.829558 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5b441fe-6977-4aad-868f-ddbaa79629be tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:27.830188 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5b441fe-6977-4aad-868f-ddbaa79629be tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:28.000798 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-e5b441fe-6977-4aad-868f-ddbaa79629be tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:28.009292 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e5b441fe-6977-4aad-868f-ddbaa79629be tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1757 microversion: 2.1 time: 0.197174 Oct 28 20:48:28.009889 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1735/3450] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:27 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:48:29.035381 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-563bfb74-fc54-4634-be6a-35ee2ba2506c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:29.036347 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-563bfb74-fc54-4634-be6a-35ee2ba2506c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:29.043696 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-563bfb74-fc54-4634-be6a-35ee2ba2506c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:29.045003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-563bfb74-fc54-4634-be6a-35ee2ba2506c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:29.045003 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-563bfb74-fc54-4634-be6a-35ee2ba2506c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:29.045476 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-563bfb74-fc54-4634-be6a-35ee2ba2506c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:29.045962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-563bfb74-fc54-4634-be6a-35ee2ba2506c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:29.046387 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-563bfb74-fc54-4634-be6a-35ee2ba2506c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:29.195535 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-563bfb74-fc54-4634-be6a-35ee2ba2506c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:29.203860 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-563bfb74-fc54-4634-be6a-35ee2ba2506c tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1757 microversion: 2.1 time: 0.173162 Oct 28 20:48:29.204443 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1716/3451] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:29 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:48:30.226812 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f81ff85a-d0f7-45b6-860d-c05b89c6a8cf tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:30.227531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f81ff85a-d0f7-45b6-860d-c05b89c6a8cf tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:30.234537 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f81ff85a-d0f7-45b6-860d-c05b89c6a8cf tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:30.235017 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f81ff85a-d0f7-45b6-860d-c05b89c6a8cf tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:30.235480 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f81ff85a-d0f7-45b6-860d-c05b89c6a8cf tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:30.236454 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f81ff85a-d0f7-45b6-860d-c05b89c6a8cf tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:30.236904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f81ff85a-d0f7-45b6-860d-c05b89c6a8cf tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:30.237357 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f81ff85a-d0f7-45b6-860d-c05b89c6a8cf tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:30.384075 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-f81ff85a-d0f7-45b6-860d-c05b89c6a8cf tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:30.392224 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f81ff85a-d0f7-45b6-860d-c05b89c6a8cf tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1757 microversion: 2.1 time: 0.169367 Oct 28 20:48:30.392809 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1736/3452] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:30 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:48:31.415177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a2e962e-6ffc-47b7-ba41-2629dce99b50 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:31.415784 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6a2e962e-6ffc-47b7-ba41-2629dce99b50 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:31.422377 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a2e962e-6ffc-47b7-ba41-2629dce99b50 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:31.422856 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a2e962e-6ffc-47b7-ba41-2629dce99b50 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:31.423289 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a2e962e-6ffc-47b7-ba41-2629dce99b50 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:31.423965 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a2e962e-6ffc-47b7-ba41-2629dce99b50 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:31.424415 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a2e962e-6ffc-47b7-ba41-2629dce99b50 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:31.424840 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a2e962e-6ffc-47b7-ba41-2629dce99b50 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:31.563944 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a2e962e-6ffc-47b7-ba41-2629dce99b50 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:31.572615 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a2e962e-6ffc-47b7-ba41-2629dce99b50 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1757 microversion: 2.1 time: 0.161663 Oct 28 20:48:31.573176 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1717/3453] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:31 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:48:32.595661 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-47cf9314-f9c2-4403-9c67-96d3537bd157 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:32.596205 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-47cf9314-f9c2-4403-9c67-96d3537bd157 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:32.603161 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47cf9314-f9c2-4403-9c67-96d3537bd157 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:32.603637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47cf9314-f9c2-4403-9c67-96d3537bd157 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:32.604074 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47cf9314-f9c2-4403-9c67-96d3537bd157 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:32.605007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47cf9314-f9c2-4403-9c67-96d3537bd157 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:32.605482 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47cf9314-f9c2-4403-9c67-96d3537bd157 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:32.605904 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47cf9314-f9c2-4403-9c67-96d3537bd157 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:32.749420 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-47cf9314-f9c2-4403-9c67-96d3537bd157 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:32.757653 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-47cf9314-f9c2-4403-9c67-96d3537bd157 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1757 microversion: 2.1 time: 0.165831 Oct 28 20:48:32.758217 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1737/3454] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:32 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:48:33.781372 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e9d2621d-fa3a-438f-8028-c92c9712b8b7 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:33.781997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e9d2621d-fa3a-438f-8028-c92c9712b8b7 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:33.788329 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9d2621d-fa3a-438f-8028-c92c9712b8b7 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:33.788817 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9d2621d-fa3a-438f-8028-c92c9712b8b7 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:33.789258 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9d2621d-fa3a-438f-8028-c92c9712b8b7 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:33.790101 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9d2621d-fa3a-438f-8028-c92c9712b8b7 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:33.790555 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9d2621d-fa3a-438f-8028-c92c9712b8b7 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:33.790981 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9d2621d-fa3a-438f-8028-c92c9712b8b7 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:33.938567 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e9d2621d-fa3a-438f-8028-c92c9712b8b7 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:33.947172 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e9d2621d-fa3a-438f-8028-c92c9712b8b7 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1757 microversion: 2.1 time: 0.169866 Oct 28 20:48:33.947738 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1718/3455] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:33 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:48:34.971014 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ae005684-82f4-4508-aabc-a168ed8381e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:34.971626 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ae005684-82f4-4508-aabc-a168ed8381e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:34.978182 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae005684-82f4-4508-aabc-a168ed8381e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:34.978664 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae005684-82f4-4508-aabc-a168ed8381e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:34.979106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae005684-82f4-4508-aabc-a168ed8381e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:34.980054 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae005684-82f4-4508-aabc-a168ed8381e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:34.980507 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae005684-82f4-4508-aabc-a168ed8381e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:34.980934 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae005684-82f4-4508-aabc-a168ed8381e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:35.123319 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-ae005684-82f4-4508-aabc-a168ed8381e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:35.132078 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ae005684-82f4-4508-aabc-a168ed8381e3 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1757 microversion: 2.1 time: 0.164929 Oct 28 20:48:35.132646 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1738/3456] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:34 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:48:36.156164 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e29f09cc-bd27-4757-af84-1c88e7e20bde tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:36.156773 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e29f09cc-bd27-4757-af84-1c88e7e20bde tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:36.159517 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:48:36.164841 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e29f09cc-bd27-4757-af84-1c88e7e20bde tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:36.165331 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e29f09cc-bd27-4757-af84-1c88e7e20bde tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:36.165782 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e29f09cc-bd27-4757-af84-1c88e7e20bde tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:36.166514 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e29f09cc-bd27-4757-af84-1c88e7e20bde tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:36.166966 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e29f09cc-bd27-4757-af84-1c88e7e20bde tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:36.167390 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e29f09cc-bd27-4757-af84-1c88e7e20bde tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:36.169926 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:48:36.312034 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-e29f09cc-bd27-4757-af84-1c88e7e20bde tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:36.320970 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e29f09cc-bd27-4757-af84-1c88e7e20bde tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1757 microversion: 2.1 time: 0.168695 Oct 28 20:48:36.327166 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1719/3457] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:36 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:48:37.344464 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-25959473-f89c-4d7f-a7bd-cf6a70595956 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:48:37.345008 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-25959473-f89c-4d7f-a7bd-cf6a70595956 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:48:37.351693 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25959473-f89c-4d7f-a7bd-cf6a70595956 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:37.352170 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25959473-f89c-4d7f-a7bd-cf6a70595956 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:37.352597 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25959473-f89c-4d7f-a7bd-cf6a70595956 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:37.353274 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25959473-f89c-4d7f-a7bd-cf6a70595956 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:48:37.353744 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25959473-f89c-4d7f-a7bd-cf6a70595956 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:48:37.354163 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25959473-f89c-4d7f-a7bd-cf6a70595956 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:48:37.500157 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-25959473-f89c-4d7f-a7bd-cf6a70595956 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:48:37.509418 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-25959473-f89c-4d7f-a7bd-cf6a70595956 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1760 microversion: 2.1 time: 0.168788 Oct 28 20:48:37.510000 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1739/3458] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:48:37 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:49:09.793478 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f7cc9b64-0230-4766-a98d-603bc5ffa8fe tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1323586663"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:49:09.794092 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f7cc9b64-0230-4766-a98d-603bc5ffa8fe tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:49:09.796339 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:49:09.800962 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7cc9b64-0230-4766-a98d-603bc5ffa8fe tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:09.801473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7cc9b64-0230-4766-a98d-603bc5ffa8fe tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:09.801909 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7cc9b64-0230-4766-a98d-603bc5ffa8fe tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:09.802589 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7cc9b64-0230-4766-a98d-603bc5ffa8fe tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:09.803546 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7cc9b64-0230-4766-a98d-603bc5ffa8fe tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:09.803969 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7cc9b64-0230-4766-a98d-603bc5ffa8fe tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:09.929623 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.network.security_group_api [None req-f7cc9b64-0230-4766-a98d-603bc5ffa8fe tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Removing security group 946abb42-e39d-4bac-bd15-72cee8c13d7e from port cc979357-8791-4ca1-8418-3b1a99022b5f Oct 28 20:49:10.320603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f7cc9b64-0230-4766-a98d-603bc5ffa8fe tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "POST /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/action" status: 202 len: 0 microversion: 2.1 time: 0.529144 Oct 28 20:49:10.320603 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1720/3459] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Oct 28 20:49:09 2022] POST /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:49:10.330144 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-0295432c-9de1-4d11-b8d9-546d88958c5c req-bb987cfc-8815-4ee1-9c00-5a9cd082c801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3fe572-09d1-4a0c-a220-324cf61ab8df", "tag": "cc979357-8791-4ca1-8418-3b1a99022b5f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:49:10.336007 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:49:10.338500 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=62 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:49:10.346288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0295432c-9de1-4d11-b8d9-546d88958c5c req-bb987cfc-8815-4ee1-9c00-5a9cd082c801 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:10.346862 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0295432c-9de1-4d11-b8d9-546d88958c5c req-bb987cfc-8815-4ee1-9c00-5a9cd082c801 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:10.347358 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0295432c-9de1-4d11-b8d9-546d88958c5c req-bb987cfc-8815-4ee1-9c00-5a9cd082c801 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:10.363742 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-0295432c-9de1-4d11-b8d9-546d88958c5c req-bb987cfc-8815-4ee1-9c00-5a9cd082c801 service nova] Creating event network-changed:cc979357-8791-4ca1-8418-3b1a99022b5f for instance dd3fe572-09d1-4a0c-a220-324cf61ab8df on hv-cinder-86236 Oct 28 20:49:10.370786 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-0295432c-9de1-4d11-b8d9-546d88958c5c req-bb987cfc-8815-4ee1-9c00-5a9cd082c801 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044304 Oct 28 20:49:10.372159 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1740/3460] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:49:12.223606 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-916df43f-dfd0-476d-9b19-a7f990f6c595 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:49:12.224153 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-916df43f-dfd0-476d-9b19-a7f990f6c595 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:49:12.231983 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-916df43f-dfd0-476d-9b19-a7f990f6c595 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:12.232473 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-916df43f-dfd0-476d-9b19-a7f990f6c595 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:12.232916 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-916df43f-dfd0-476d-9b19-a7f990f6c595 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:12.233638 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-916df43f-dfd0-476d-9b19-a7f990f6c595 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:12.234097 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-916df43f-dfd0-476d-9b19-a7f990f6c595 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:12.234527 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-916df43f-dfd0-476d-9b19-a7f990f6c595 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:12.315760 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-916df43f-dfd0-476d-9b19-a7f990f6c595 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lazy-loading 'services' on Instance uuid dd3fe572-09d1-4a0c-a220-324cf61ab8df {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:49:12.392192 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-9f471922-47d0-401b-9862-1e5c6f1938ba req-cdc8835f-e9e8-43a4-8661-66d5c285582e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3fe572-09d1-4a0c-a220-324cf61ab8df", "tag": "cc979357-8791-4ca1-8418-3b1a99022b5f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:49:12.402531 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9f471922-47d0-401b-9862-1e5c6f1938ba req-cdc8835f-e9e8-43a4-8661-66d5c285582e service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:12.403001 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9f471922-47d0-401b-9862-1e5c6f1938ba req-cdc8835f-e9e8-43a4-8661-66d5c285582e service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:12.403427 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9f471922-47d0-401b-9862-1e5c6f1938ba req-cdc8835f-e9e8-43a4-8661-66d5c285582e service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:12.414708 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-9f471922-47d0-401b-9862-1e5c6f1938ba req-cdc8835f-e9e8-43a4-8661-66d5c285582e service nova] Creating event network-changed:cc979357-8791-4ca1-8418-3b1a99022b5f for instance dd3fe572-09d1-4a0c-a220-324cf61ab8df on hv-cinder-86236 Oct 28 20:49:12.419680 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-9f471922-47d0-401b-9862-1e5c6f1938ba req-cdc8835f-e9e8-43a4-8661-66d5c285582e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032507 Oct 28 20:49:12.420270 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1741/3461] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:49:12.561225 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-916df43f-dfd0-476d-9b19-a7f990f6c595 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/os-volume_attachments/b43e2a4d-9cb4-4626-a661-1fdec7bbf5d8" status: 202 len: 0 microversion: 2.1 time: 0.342553 Oct 28 20:49:12.564918 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1721/3462] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Oct 28 20:49:12 2022] DELETE /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/os-volume_attachments/b43e2a4d-9cb4-4626-a661-1fdec7bbf5d8 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:49:12.571337 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b193a011-d610-426f-bfcf-0036011d936a tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:49:12.574056 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b193a011-d610-426f-bfcf-0036011d936a tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:49:12.582627 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b193a011-d610-426f-bfcf-0036011d936a tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:12.583579 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b193a011-d610-426f-bfcf-0036011d936a tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:12.584859 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b193a011-d610-426f-bfcf-0036011d936a tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:12.586020 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b193a011-d610-426f-bfcf-0036011d936a tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:12.586540 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b193a011-d610-426f-bfcf-0036011d936a tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:12.587156 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b193a011-d610-426f-bfcf-0036011d936a tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:12.619509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b193a011-d610-426f-bfcf-0036011d936a tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052752 Oct 28 20:49:12.620262 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1742/3463] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:49:12 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:49:13.633522 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-23b1e408-ee3d-4716-bd2c-c9fb438a312e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:49:13.635811 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-23b1e408-ee3d-4716-bd2c-c9fb438a312e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:49:13.642362 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23b1e408-ee3d-4716-bd2c-c9fb438a312e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:13.642871 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23b1e408-ee3d-4716-bd2c-c9fb438a312e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:13.643310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23b1e408-ee3d-4716-bd2c-c9fb438a312e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:13.643997 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23b1e408-ee3d-4716-bd2c-c9fb438a312e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:13.644450 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23b1e408-ee3d-4716-bd2c-c9fb438a312e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:13.644872 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23b1e408-ee3d-4716-bd2c-c9fb438a312e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:13.674877 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-23b1e408-ee3d-4716-bd2c-c9fb438a312e tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046868 Oct 28 20:49:13.675429 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1722/3464] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Oct 28 20:49:13 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 20:49:13.686509 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1331ca3e-d7c2-4582-b7e9-474584ab3343 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:49:13.687005 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1331ca3e-d7c2-4582-b7e9-474584ab3343 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:49:13.692928 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1331ca3e-d7c2-4582-b7e9-474584ab3343 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:13.694143 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1331ca3e-d7c2-4582-b7e9-474584ab3343 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:13.694607 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1331ca3e-d7c2-4582-b7e9-474584ab3343 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:13.695288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1331ca3e-d7c2-4582-b7e9-474584ab3343 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:13.695765 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1331ca3e-d7c2-4582-b7e9-474584ab3343 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:13.696187 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1331ca3e-d7c2-4582-b7e9-474584ab3343 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:13.969632 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-1331ca3e-d7c2-4582-b7e9-474584ab3343 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] HTTP exception thrown: Instance dd3fe572-09d1-4a0c-a220-324cf61ab8df is not attached to volume b43e2a4d-9cb4-4626-a661-1fdec7bbf5d8 Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1331ca3e-d7c2-4582-b7e9-474584ab3343 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Request method failure captured: Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/os-volume_attachments/b43e2a4d-9cb4-4626-a661-1fdec7bbf5d8 HTTP/1.1 Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXD_Qe4OBOS7Ue3ntMW5CxTygy4CBnv_8T6mEywHxdCoRLjJHefT2IdG0zRorgvDl-PUdSzXYCiEuLdsf6_tA7Gc3-CuMCG8v0JZwHUHCDWiSSGWvafCa8_vWIDw9E_4ohs9vCWrz99KizfrgCL7bEO4hAFZw4PIBeSBXsDgS6vvYaTo Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 7b5c9ffe3749453b8d677e173d102be1 Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-TestMinimumBasicScenario-1239776094 Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:49:13.971939 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:49:13.973618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b5c9ffe3749453b8d677e173d102be1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b5c9ffe3749453b8d677e173d102be1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7b5c9ffe3749453b8d677e173d102be1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7b5c9ffe3749453b8d677e173d102be1", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:49:13.973618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-TestMinimumBasicScenario-1239776094 Oct 28 20:49:13.973618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 7b5c9ffe3749453b8d677e173d102be1 Oct 28 20:49:13.973618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1239776094 Oct 28 20:49:13.973618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-TestMinimumBasicScenario-1239776094-project Oct 28 20:49:13.973618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:49:13.973618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:49:13.973618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: 8daa1cb0ade042589bc26ecaaf59b0f7 Oct 28 20:49:13.973618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-TestMinimumBasicScenario-1239776094-project Oct 28 20:49:13.973618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:49:13.973618 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance dd3fe572-09d1-4a0c-a220-324cf61ab8df is not attached to volume b43e2a4d-9cb4-4626-a661-1fdec7bbf5d8 Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'server_id': 'dd3fe572-09d1-4a0c-a220-324cf61ab8df', 'id': 'b43e2a4d-9cb4-4626-a661-1fdec7bbf5d8'} Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b43e2a4d-9cb4-4626-a661-1fdec7bbf5d8. Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:49:13.974536 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:49:13.976091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:49:13.976091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 20:49:13.976091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 20:49:13.976091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd3fe572-09d1-4a0c-a220-324cf61ab8df is not attached to volume b43e2a4d-9cb4-4626-a661-1fdec7bbf5d8 Oct 28 20:49:13.976091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:49:13.976091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:49:13.976091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:49:13.976091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:49:13.976091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:49:13.976091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:49:13.976091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:49:13.976091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:49:13.976091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd3fe572-09d1-4a0c-a220-324cf61ab8df is not attached to volume b43e2a4d-9cb4-4626-a661-1fdec7bbf5d8 Oct 28 20:49:13.976091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:49:13.976091 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1331ca3e-d7c2-4582-b7e9-474584ab3343 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Returning 404 to user: Instance dd3fe572-09d1-4a0c-a220-324cf61ab8df is not attached to volume b43e2a4d-9cb4-4626-a661-1fdec7bbf5d8 {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:49:13.977288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1331ca3e-d7c2-4582-b7e9-474584ab3343 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/os-volume_attachments/b43e2a4d-9cb4-4626-a661-1fdec7bbf5d8" status: 404 len: 154 microversion: 2.1 time: 0.290971 Oct 28 20:49:13.977288 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1743/3465] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Oct 28 20:49:13 2022] DELETE /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df/os-volume_attachments/b43e2a4d-9cb4-4626-a661-1fdec7bbf5d8 => generated 154 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:49:15.283038 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9d64c3c4-382b-471c-b42c-6a9440daf9b1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:49:15.283502 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9d64c3c4-382b-471c-b42c-6a9440daf9b1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:49:15.290549 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d64c3c4-382b-471c-b42c-6a9440daf9b1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:15.291029 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d64c3c4-382b-471c-b42c-6a9440daf9b1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:15.291461 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d64c3c4-382b-471c-b42c-6a9440daf9b1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:15.292177 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d64c3c4-382b-471c-b42c-6a9440daf9b1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:15.292627 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d64c3c4-382b-471c-b42c-6a9440daf9b1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:15.293051 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d64c3c4-382b-471c-b42c-6a9440daf9b1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:15.317434 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9d64c3c4-382b-471c-b42c-6a9440daf9b1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:49:15.608005 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9d64c3c4-382b-471c-b42c-6a9440daf9b1 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 204 len: 0 microversion: 2.1 time: 0.328480 Oct 28 20:49:15.608523 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1723/3466] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Oct 28 20:49:15 2022] DELETE /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:49:15.616759 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-76a70a37-d9f6-4454-a146-00ec918c4dc9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:49:15.619291 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-76a70a37-d9f6-4454-a146-00ec918c4dc9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:49:15.623790 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76a70a37-d9f6-4454-a146-00ec918c4dc9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:15.624302 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76a70a37-d9f6-4454-a146-00ec918c4dc9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:15.624732 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76a70a37-d9f6-4454-a146-00ec918c4dc9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:15.625458 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76a70a37-d9f6-4454-a146-00ec918c4dc9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:15.625903 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76a70a37-d9f6-4454-a146-00ec918c4dc9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:15.626321 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76a70a37-d9f6-4454-a146-00ec918c4dc9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:15.759776 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.policy [None req-76a70a37-d9f6-4454-a146-00ec918c4dc9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:49:15.768106 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-76a70a37-d9f6-4454-a146-00ec918c4dc9 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1555 microversion: 2.1 time: 0.155249 Oct 28 20:49:15.768670 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1744/3467] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:49:15 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:49:16.793291 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-97069478-5393-47b2-8e93-4039b57b8a73 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:49:16.794191 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-97069478-5393-47b2-8e93-4039b57b8a73 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:49:16.800886 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97069478-5393-47b2-8e93-4039b57b8a73 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:16.801403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97069478-5393-47b2-8e93-4039b57b8a73 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:16.801838 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97069478-5393-47b2-8e93-4039b57b8a73 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:16.803133 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97069478-5393-47b2-8e93-4039b57b8a73 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:16.803820 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97069478-5393-47b2-8e93-4039b57b8a73 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:16.804403 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97069478-5393-47b2-8e93-4039b57b8a73 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:17.049098 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-97069478-5393-47b2-8e93-4039b57b8a73 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:49:17.056715 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-97069478-5393-47b2-8e93-4039b57b8a73 tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1555 microversion: 2.1 time: 0.267811 Oct 28 20:49:17.057272 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1724/3468] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:49:16 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1555 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:49:17.818554 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5381cfb4-c1f1-4df1-9463-70e69e1d9a93 req-996c63ae-4511-4b2a-bef3-5b21f1405304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3fe572-09d1-4a0c-a220-324cf61ab8df", "name": "network-vif-deleted", "tag": "cc979357-8791-4ca1-8418-3b1a99022b5f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:49:17.828910 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5381cfb4-c1f1-4df1-9463-70e69e1d9a93 req-996c63ae-4511-4b2a-bef3-5b21f1405304 service nova] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:17.829411 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5381cfb4-c1f1-4df1-9463-70e69e1d9a93 req-996c63ae-4511-4b2a-bef3-5b21f1405304 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:17.829844 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5381cfb4-c1f1-4df1-9463-70e69e1d9a93 req-996c63ae-4511-4b2a-bef3-5b21f1405304 service nova] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:17.841034 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5381cfb4-c1f1-4df1-9463-70e69e1d9a93 req-996c63ae-4511-4b2a-bef3-5b21f1405304 service nova] Creating event network-vif-deleted:cc979357-8791-4ca1-8418-3b1a99022b5f for instance dd3fe572-09d1-4a0c-a220-324cf61ab8df on hv-cinder-86236 Oct 28 20:49:17.846063 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5381cfb4-c1f1-4df1-9463-70e69e1d9a93 req-996c63ae-4511-4b2a-bef3-5b21f1405304 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031485 Oct 28 20:49:17.846631 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1745/3469] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Oct 28 20:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:49:18.080220 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a76924e-29c6-44e4-81b0-fd6001f5d6aa tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:49:18.080922 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a76924e-29c6-44e4-81b0-fd6001f5d6aa tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:49:18.092310 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a76924e-29c6-44e4-81b0-fd6001f5d6aa tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:18.092803 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a76924e-29c6-44e4-81b0-fd6001f5d6aa tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:18.093243 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a76924e-29c6-44e4-81b0-fd6001f5d6aa tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:18.094057 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a76924e-29c6-44e4-81b0-fd6001f5d6aa tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:18.094520 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a76924e-29c6-44e4-81b0-fd6001f5d6aa tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:18.094947 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a76924e-29c6-44e4-81b0-fd6001f5d6aa tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:18.166234 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.policy [None req-1a76924e-29c6-44e4-81b0-fd6001f5d6aa tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daa1cb0ade042589bc26ecaaf59b0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c9ffe3749453b8d677e173d102be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:49:18.174303 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a76924e-29c6-44e4-81b0-fd6001f5d6aa tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 200 len: 1344 microversion: 2.1 time: 0.098161 Oct 28 20:49:18.175062 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1725/3470] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:49:18 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 1344 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:49:19.199265 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0e5fd121-03cd-4fa2-a37d-37ac789ba8ad tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:49:19.200092 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0e5fd121-03cd-4fa2-a37d-37ac789ba8ad tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] [instance: dd3fe572-09d1-4a0c-a220-324cf61ab8df] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:49:19.206392 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e5fd121-03cd-4fa2-a37d-37ac789ba8ad tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:19.206871 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e5fd121-03cd-4fa2-a37d-37ac789ba8ad tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:19.207323 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e5fd121-03cd-4fa2-a37d-37ac789ba8ad tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:19.208028 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e5fd121-03cd-4fa2-a37d-37ac789ba8ad tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Acquiring lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:49:19.208498 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e5fd121-03cd-4fa2-a37d-37ac789ba8ad tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:49:19.208914 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e5fd121-03cd-4fa2-a37d-37ac789ba8ad tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Lock "1f77e283-8dfe-4ddd-b40e-e3af731a397f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:49:19.222064 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-0e5fd121-03cd-4fa2-a37d-37ac789ba8ad tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] HTTP exception thrown: Instance dd3fe572-09d1-4a0c-a220-324cf61ab8df could not be found. Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0e5fd121-03cd-4fa2-a37d-37ac789ba8ad tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Request method failure captured: Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df HTTP/1.1 Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept: application/json Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Accept-Encoding: identity Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Connection: close Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Length: 0 Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Content-Type: application/json Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Host: 10.222.0.66 Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: Openstack-System-Scope: None Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.12 Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Auth-Token: gAAAAABjXD_Qe4OBOS7Ue3ntMW5CxTygy4CBnv_8T6mEywHxdCoRLjJHefT2IdG0zRorgvDl-PUdSzXYCiEuLdsf6_tA7Gc3-CuMCG8v0JZwHUHCDWiSSGWvafCa8_vWIDw9E_4ohs9vCWrz99KizfrgCL7bEO4hAFZw4PIBeSBXsDgS6vvYaTo Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Id: None Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Domain-Name: None Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Identity-Status: Confirmed Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Is-Admin-Project: True Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Id: default Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Domain-Name: Default Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Id: 7b5c9ffe3749453b8d677e173d102be1 Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Project-Name: tempest-TestMinimumBasicScenario-1239776094 Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Role: reader,member Oct 28 20:49:19.223637 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Roles: reader,member Oct 28 20:49:19.225234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b5c9ffe3749453b8d677e173d102be1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b5c9ffe3749453b8d677e173d102be1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7b5c9ffe3749453b8d677e173d102be1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7b5c9ffe3749453b8d677e173d102be1", "adminURL": "http://10.222.0.66:8080"}]}] Oct 28 20:49:19.225234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant: tempest-TestMinimumBasicScenario-1239776094 Oct 28 20:49:19.225234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Id: 7b5c9ffe3749453b8d677e173d102be1 Oct 28 20:49:19.225234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1239776094 Oct 28 20:49:19.225234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User: tempest-TestMinimumBasicScenario-1239776094-project Oct 28 20:49:19.225234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Id: default Oct 28 20:49:19.225234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Domain-Name: Default Oct 28 20:49:19.225234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Id: 8daa1cb0ade042589bc26ecaaf59b0f7 Oct 28 20:49:19.225234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: X-User-Name: tempest-TestMinimumBasicScenario-1239776094-project Oct 28 20:49:19.225234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: method: > Oct 28 20:49:19.225234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: exception: Instance dd3fe572-09d1-4a0c-a220-324cf61ab8df could not be found. Oct 28 20:49:19.225234 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: action_args: {'id': 'dd3fe572-09d1-4a0c-a220-324cf61ab8df'} Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd3fe572-09d1-4a0c-a220-324cf61ab8df could not be found. Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:49:19.226184 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd3fe572-09d1-4a0c-a220-324cf61ab8df could not be found. Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd3fe572-09d1-4a0c-a220-324cf61ab8df could not be found. Oct 28 20:49:19.227701 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Oct 28 20:49:19.229477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0e5fd121-03cd-4fa2-a37d-37ac789ba8ad tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Returning 404 to user: Instance dd3fe572-09d1-4a0c-a220-324cf61ab8df could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:49:19.229477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0e5fd121-03cd-4fa2-a37d-37ac789ba8ad tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df" status: 404 len: 111 microversion: 2.1 time: 0.030990 Oct 28 20:49:19.229477 dv-cinder-862365-2-iscsi devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1746/3471] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Oct 28 20:49:19 2022] GET /compute/v2.1/servers/dd3fe572-09d1-4a0c-a220-324cf61ab8df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:49:19.234070 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fa0caf1c-eaa4-4651-b8a5-afd0aea24adb tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] Calling method '.version_select at 0x7f1f4cea3ca0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:49:19.324297 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fa0caf1c-eaa4-4651-b8a5-afd0aea24adb tempest-TestMinimumBasicScenario-1239776094 tempest-TestMinimumBasicScenario-1239776094-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1893421814" status: 202 len: 0 microversion: 2.1 time: 0.093930 Oct 28 20:49:19.324874 dv-cinder-862365-2-iscsi devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1726/3472] 10.222.0.66 () {58 vars in 1272 bytes} [Fri Oct 28 20:49:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1893421814 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)